Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

The Diabetes Educator

CiteULike is a free service for managing and discovering scholarly references - click here to get started.

Sign In to gain access to subscriptions and/or personal tools.
Evaluation & the Health Professions
This Article
Right arrow Full Text (PDF)
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Violato, C.
Right arrow Articles by Lee, C.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Violato, C.
Right arrow Articles by Lee, C.
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

A Validity Study Of Expert Judgment Procedures For Setting Cutoff Scores On High-Stakes Credentialing Examinations Using Cluster Analysis

Claudio Violato

University of Calgary and Edumetrics Ltd.

Anthony Marini

University of Calgary and Martek

Curtis Lee

Royal College of Physicians and Surgeons of Canada

This study compares an expert judgment process—minimal performance levels (MPL) using the Nedelsky and Ebel procedures—for setting cutoff scores for pass/fail on licensure examinations with an empirical approach—cluster analysis. Data from all three components of the Canadian Standard Assessment in Optometry (CSAO) examinations (knowledge, clinical judgment, and clinical skills) from 243 candidates were obtained. Results indicate that for the written components of the exams employing the Nedelsky method of MPL setting, there was a mean agreement of pass/fail of 81% with the cluster analysis approach on pass/fail categorization. For the performance exams using the Ebel method, the mean agreement of pass/fail with the cluster analysis was 93%. Thus the subjective approaches to setting cutoff scores (i.e., expert judgment methods) converge with the objective method (i.e., cluster analysis) of classifying test takers in the same categories.

Key Words: high-stakes examinations • criterion-referenced testing • minimum performance levels • cluster analysis

Evaluation & the Health Professions, Vol. 26, No. 1, 59-72 (2003)
DOI: 10.1177/0163278702250082
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
 Eval Health ProfHome page
B. Hess, R. G. Subhiyah, and C. Giordano
Convergence Between Cluster Analysis and the Angoff Method for Setting Minimum Passing Scores on Credentialing Examinations
Eval Health Prof, December 1, 2007; 30(4): 362 - 375.
[Abstract] [PDF]