Improvement in Scoring Consistency for the Creighton Simulation Evaluation Instrument ^©

Background: The Creighton Simulation Evaluation Instrument ^© is a valid and reliable instrument for evaluation of students in the simulated clinical environment. Increased use of simulation and requests for widespread use of the instrument prompted the development of an educational program to maintain reliability. Method: The educational program included review of the instrument and dialogue among faculty to determine expectations of student performance. Percentage agreement and kappa coefficient scores were calculated pre- and posttraining. Results: Improved percentage agreement scores were noted. Seventy-five percent of the kappa scores after implementation of the educational program demonstrate moderate, substantial, or almost perfect agreement. Conclusions: Education and faculty dialogue improve consistency of student assessment and add richness to the learning experience.