Designing an assessment for an abilities-based curriculum

Michael S. Monaghan, Rhonda M. Jones

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Objectives. Our program adopted an abilities-based curriculum and established 12 terminal educational ability-based outcomes. We developed performance-based assessments to measure students' ability to accomplish the program's outcomes. Methods. Faculty teams defined expected outcomes and tasks for each of the 12 ability-based outcomes for the P1 and P2 years in the curriculum. These expected outcomes and tasks then became the basis for cases used in designing the performance-based assessments. Faculty members drafted 12 cases for each year and the corresponding performance criteria used in grading. All cases were validated by a national review panel. The cases were then converted into computer-based simulations for programmatic assessment at the end of the 2003 school year. All P1 and P2 students participated in the assessments. Two faculty members graded all cases. The interrater reliability between the 2 graders and the internal consistency of the assessment were measured. Results. The overall interrater reliabilities for the P1 and P2 years were 0.94 and 0.91, respectively. The overall internal consistency reliabilities for the P1 and P2 years were 0.86 and 0.80, respectively. Conclusions. Performance-based assessments produce reliable data that can be used to evaluate an abilities-based curriculum.

Original languageEnglish
Article number19
Pages (from-to)118-125
Number of pages8
JournalAmerican Journal of Pharmaceutical Education
Volume69
Issue number2
StatePublished - 2005

Fingerprint

Curriculum
curriculum
ability
Students
Computer Simulation
performance
grading
student
simulation
school

All Science Journal Classification (ASJC) codes

  • Pharmacology
  • Education

Cite this

Designing an assessment for an abilities-based curriculum. / Monaghan, Michael S.; Jones, Rhonda M.

In: American Journal of Pharmaceutical Education, Vol. 69, No. 2, 19, 2005, p. 118-125.

Research output: Contribution to journalArticle

@article{2de01a27d70a4a959439e7f49c6466e4,
title = "Designing an assessment for an abilities-based curriculum",
abstract = "Objectives. Our program adopted an abilities-based curriculum and established 12 terminal educational ability-based outcomes. We developed performance-based assessments to measure students' ability to accomplish the program's outcomes. Methods. Faculty teams defined expected outcomes and tasks for each of the 12 ability-based outcomes for the P1 and P2 years in the curriculum. These expected outcomes and tasks then became the basis for cases used in designing the performance-based assessments. Faculty members drafted 12 cases for each year and the corresponding performance criteria used in grading. All cases were validated by a national review panel. The cases were then converted into computer-based simulations for programmatic assessment at the end of the 2003 school year. All P1 and P2 students participated in the assessments. Two faculty members graded all cases. The interrater reliability between the 2 graders and the internal consistency of the assessment were measured. Results. The overall interrater reliabilities for the P1 and P2 years were 0.94 and 0.91, respectively. The overall internal consistency reliabilities for the P1 and P2 years were 0.86 and 0.80, respectively. Conclusions. Performance-based assessments produce reliable data that can be used to evaluate an abilities-based curriculum.",
author = "Monaghan, {Michael S.} and Jones, {Rhonda M.}",
year = "2005",
language = "English",
volume = "69",
pages = "118--125",
journal = "American Journal of Pharmaceutical Education",
issn = "0002-9459",
publisher = "American Association of Colleges of Pharmacy",
number = "2",

}

TY - JOUR

T1 - Designing an assessment for an abilities-based curriculum

AU - Monaghan, Michael S.

AU - Jones, Rhonda M.

PY - 2005

Y1 - 2005

N2 - Objectives. Our program adopted an abilities-based curriculum and established 12 terminal educational ability-based outcomes. We developed performance-based assessments to measure students' ability to accomplish the program's outcomes. Methods. Faculty teams defined expected outcomes and tasks for each of the 12 ability-based outcomes for the P1 and P2 years in the curriculum. These expected outcomes and tasks then became the basis for cases used in designing the performance-based assessments. Faculty members drafted 12 cases for each year and the corresponding performance criteria used in grading. All cases were validated by a national review panel. The cases were then converted into computer-based simulations for programmatic assessment at the end of the 2003 school year. All P1 and P2 students participated in the assessments. Two faculty members graded all cases. The interrater reliability between the 2 graders and the internal consistency of the assessment were measured. Results. The overall interrater reliabilities for the P1 and P2 years were 0.94 and 0.91, respectively. The overall internal consistency reliabilities for the P1 and P2 years were 0.86 and 0.80, respectively. Conclusions. Performance-based assessments produce reliable data that can be used to evaluate an abilities-based curriculum.

AB - Objectives. Our program adopted an abilities-based curriculum and established 12 terminal educational ability-based outcomes. We developed performance-based assessments to measure students' ability to accomplish the program's outcomes. Methods. Faculty teams defined expected outcomes and tasks for each of the 12 ability-based outcomes for the P1 and P2 years in the curriculum. These expected outcomes and tasks then became the basis for cases used in designing the performance-based assessments. Faculty members drafted 12 cases for each year and the corresponding performance criteria used in grading. All cases were validated by a national review panel. The cases were then converted into computer-based simulations for programmatic assessment at the end of the 2003 school year. All P1 and P2 students participated in the assessments. Two faculty members graded all cases. The interrater reliability between the 2 graders and the internal consistency of the assessment were measured. Results. The overall interrater reliabilities for the P1 and P2 years were 0.94 and 0.91, respectively. The overall internal consistency reliabilities for the P1 and P2 years were 0.86 and 0.80, respectively. Conclusions. Performance-based assessments produce reliable data that can be used to evaluate an abilities-based curriculum.

UR - http://www.scopus.com/inward/record.url?scp=27644594171&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=27644594171&partnerID=8YFLogxK

M3 - Article

VL - 69

SP - 118

EP - 125

JO - American Journal of Pharmaceutical Education

JF - American Journal of Pharmaceutical Education

SN - 0002-9459

IS - 2

M1 - 19

ER -