Writing across the curriculum

Reliability testing of a standardized rubric

Margo Minnich, Amanda Kirkpatrick, Joely T. Goodman, Ali Whittaker, Helen Stanton Chapple, Anne M. Schoening, Maya M. Khanna

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Background: Rubrics positively affect student academic performance; however, accuracy and consistency of the rubric and its use is imperative. The researchers in this study developed a standardized rubric for use across an undergraduate nursing curriculum, then evaluated the interrater reliability and general usability of the tool. Method: Faculty raters graded papers using the standardized rubric, submitted their independent scoring for interrater reliability analyses, then participated in a focus group discussion regarding rubric use experience. Results: Quantitative analysis of the data showed a high interrater reliability (a =.998). Content analysis of transcription revealed several positive themes: Consistency, Emphasis on Writing Ability, and Ability to Use the Rubric as a Teaching Tool. Areas for improvement included use of value words and difficulty with point allocation. Conclusion: Investigators recommend effective faculty orientation for rubric use and future work in developing a rubric to assess reflective writing.

Original languageEnglish (US)
Pages (from-to)366-370
Number of pages5
JournalJournal of Nursing Education
Volume57
Issue number6
DOIs
StatePublished - Jun 1 2018

Fingerprint

Curriculum
Research Personnel
curriculum
Focus Groups
Teaching
Nursing
ability
Students
group discussion
content analysis
nursing
performance
Values
experience
student

All Science Journal Classification (ASJC) codes

  • Nursing(all)
  • Education

Cite this

Writing across the curriculum : Reliability testing of a standardized rubric. / Minnich, Margo; Kirkpatrick, Amanda; Goodman, Joely T.; Whittaker, Ali; Stanton Chapple, Helen; Schoening, Anne M.; Khanna, Maya M.

In: Journal of Nursing Education, Vol. 57, No. 6, 01.06.2018, p. 366-370.

Research output: Contribution to journalArticle

Minnich, Margo ; Kirkpatrick, Amanda ; Goodman, Joely T. ; Whittaker, Ali ; Stanton Chapple, Helen ; Schoening, Anne M. ; Khanna, Maya M. / Writing across the curriculum : Reliability testing of a standardized rubric. In: Journal of Nursing Education. 2018 ; Vol. 57, No. 6. pp. 366-370.
@article{9e9a6fac73154afbad44abf1a2d8b887,
title = "Writing across the curriculum: Reliability testing of a standardized rubric",
abstract = "Background: Rubrics positively affect student academic performance; however, accuracy and consistency of the rubric and its use is imperative. The researchers in this study developed a standardized rubric for use across an undergraduate nursing curriculum, then evaluated the interrater reliability and general usability of the tool. Method: Faculty raters graded papers using the standardized rubric, submitted their independent scoring for interrater reliability analyses, then participated in a focus group discussion regarding rubric use experience. Results: Quantitative analysis of the data showed a high interrater reliability (a =.998). Content analysis of transcription revealed several positive themes: Consistency, Emphasis on Writing Ability, and Ability to Use the Rubric as a Teaching Tool. Areas for improvement included use of value words and difficulty with point allocation. Conclusion: Investigators recommend effective faculty orientation for rubric use and future work in developing a rubric to assess reflective writing.",
author = "Margo Minnich and Amanda Kirkpatrick and Goodman, {Joely T.} and Ali Whittaker and {Stanton Chapple}, Helen and Schoening, {Anne M.} and Khanna, {Maya M.}",
year = "2018",
month = "6",
day = "1",
doi = "10.3928/01484834-20180522-08",
language = "English (US)",
volume = "57",
pages = "366--370",
journal = "Journal of Nursing Education",
issn = "0148-4834",
publisher = "Slack Incorporated",
number = "6",

}

TY - JOUR

T1 - Writing across the curriculum

T2 - Reliability testing of a standardized rubric

AU - Minnich, Margo

AU - Kirkpatrick, Amanda

AU - Goodman, Joely T.

AU - Whittaker, Ali

AU - Stanton Chapple, Helen

AU - Schoening, Anne M.

AU - Khanna, Maya M.

PY - 2018/6/1

Y1 - 2018/6/1

N2 - Background: Rubrics positively affect student academic performance; however, accuracy and consistency of the rubric and its use is imperative. The researchers in this study developed a standardized rubric for use across an undergraduate nursing curriculum, then evaluated the interrater reliability and general usability of the tool. Method: Faculty raters graded papers using the standardized rubric, submitted their independent scoring for interrater reliability analyses, then participated in a focus group discussion regarding rubric use experience. Results: Quantitative analysis of the data showed a high interrater reliability (a =.998). Content analysis of transcription revealed several positive themes: Consistency, Emphasis on Writing Ability, and Ability to Use the Rubric as a Teaching Tool. Areas for improvement included use of value words and difficulty with point allocation. Conclusion: Investigators recommend effective faculty orientation for rubric use and future work in developing a rubric to assess reflective writing.

AB - Background: Rubrics positively affect student academic performance; however, accuracy and consistency of the rubric and its use is imperative. The researchers in this study developed a standardized rubric for use across an undergraduate nursing curriculum, then evaluated the interrater reliability and general usability of the tool. Method: Faculty raters graded papers using the standardized rubric, submitted their independent scoring for interrater reliability analyses, then participated in a focus group discussion regarding rubric use experience. Results: Quantitative analysis of the data showed a high interrater reliability (a =.998). Content analysis of transcription revealed several positive themes: Consistency, Emphasis on Writing Ability, and Ability to Use the Rubric as a Teaching Tool. Areas for improvement included use of value words and difficulty with point allocation. Conclusion: Investigators recommend effective faculty orientation for rubric use and future work in developing a rubric to assess reflective writing.

UR - http://www.scopus.com/inward/record.url?scp=85049129820&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85049129820&partnerID=8YFLogxK

U2 - 10.3928/01484834-20180522-08

DO - 10.3928/01484834-20180522-08

M3 - Article

VL - 57

SP - 366

EP - 370

JO - Journal of Nursing Education

JF - Journal of Nursing Education

SN - 0148-4834

IS - 6

ER -