Oermann Publishes Article in Nursing Education Perspectives

Oermann Publishes Article in Nursing Education Perspectives

Marilyn Oermann recently published an article entitled "Establishing inter- and intrarater reliability for high stakes testing using simulation" in the March/April issue of Nursing Education Perspectives. Co-authors include experts from Robert Morris University in Pennsylvania, the National League for Nursing, and Washington State University.

Abstract: This article reports one method to develop a standardized training method to establish the inter- and intrarater reliability of a group of raters for high-stakes testing. Simulation is used increasingly for high-stakes testing, but without research into the development of inter- and intrarater reliability for raters. Eleven raters were trained using a standardized methodology. Raters scored 28 student videos over a six-week period. Raters then rescored all videos over a two-day period to establish both intra- and interrater reliability. One rater demonstrated poor intrarater reliability; a second rater failed all students. Kappa statistics improved from the moderate to substantial agreement range with the exclusion of the two outlier raters’ scores. There may be faculty who, for different reasons, should not be included in high-stakes testing evaluations. All faculty are content experts, but not all are expert evaluators.

Scroll back to top automatically