Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

CiteULike is a free service for managing and discovering scholarly references - click here to get started.

Sign In to gain access to subscriptions and/or personal tools.
Evaluation & the Health Professions
This Article
Right arrow Full Text (PDF)
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Web of Science (2)
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Iramaneerat, C.
Right arrow Articles by Yudkowsky, R.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Iramaneerat, C.
Right arrow Articles by Yudkowsky, R.
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

Rater Errors in a Clinical Skills Assessment of Medical Students

Cherdsak Iramaneerat

University of Illinois at Chicago

Rachel Yudkowsky

University of Illinois at Chicago

The authors used a many-faceted Rasch measurement model to analyze rating data from a clinical skills assessment of 173 fourth-year medical students to investigate four types of rater errors: leniency, inconsistency, the halo effect, and restriction of range. Students performed six clinical tasks with 6 standardized patients (SPs) selected from a pool of 17 SPs. SPs rated the performance of each student in six skills: history taking, physical examination, interpersonal skills, communication technique, counseling skills, and physical examination etiquette. SPs showed statistically significant differences in their rating severity, indicating rater leniency error. Four SPs exhibited rating inconsistency. Four SPs restricted their ratings in high categories. Only 1 SP exhibited a halo effect. Administrators of objective structured clinical examinations should be vigilant for various types of rater errors and attempt to reduce or eliminate those errors to improve the validity of inferences based on objective structured clinical examination scores.

Key Words: rater errors • many-faceted Rasch measurement • OSCE • standardized patients • medical students • clinical skills

Evaluation & the Health Professions, Vol. 30, No. 3, 266-283 (2007)
DOI: 10.1177/0163278707304040
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
 Acad. PsychiatryHome page
P. Whelan, L. Church, and K. Kadry
Using Standardized Patients' Marks in Scoring Postgraduate Psychiatry OSCEs
Acad Psychiatry, July 1, 2009; 33(4): 319 - 322.
[Abstract] [Full Text] [PDF]

Home page
 jvmeHome page
K. Bateman, P. Menzies, D. Sandals, T. Duffield, S. LeBlanc, K. Leslie, K. Lissemore, and R. Swackhammer
Objective Structured Clinical Examinations (OSCEs) as a Summative Evaluation Tool in a Ruminant Health Management Rotation for Final-Year DVM Students
J Vet Med Educ, September 1, 2008; 35(3): 382 - 388.
[Abstract] [Full Text] [PDF]

Home page
 BMJHome page
C. Ricketts and J. Archer
Are national qualifying examinations a fair way to rank medical students? Yes
BMJ, August 22, 2008; 337(aug22_2): a1282 - a1282.
[Full Text]