Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

The Diabetes Educator

Click here to sign up for SAGE Journal Email Alerts today!

Sign In to gain access to subscriptions and/or personal tools.
Evaluation & the Health Professions
This Article
Right arrow Full Text (PDF)
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Risucci, D. A.
Right arrow Articles by Tortolani, A. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Risucci, D. A.
Right arrow Articles by Tortolani, A. J.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

Reliability and Accuracy of Resident Evaluations of Surgical Faculty

Donald A. Risucci

Larry Lutsky

Robert J. Rosati

Anthony J. Tortolani

North Shore University Hospital and Cornell University Medical College

This study examines the reliability and accuracy of ratings by general surgery residents of surgical faculty. Twenty-three of 33 residents anonymously and voluntarily evaluated 62 surgeons in June, 1988; 24 of 28 residents evaluated 64 surgeons in June, 1989. Each resident rated each surgeon on a 5-point scale for each of 10 areas ofperformance: technical ability, basic science knowledge, clinical knowledge, judgment, peer relations, patient relations, reliability, industry, personal appearance, and reaction to pressure. Reliability analyses evaluated internal consistency and interrater correlation. Accuracy analyses evaluated halo error, leniency/severity, central tendency, and range restriction. Ratings had high internal consistency (coefficient alpha = 0. 97). Interrater correlations were moderately high (average Pearson correlation = 0.63 among raters). Ratings were generally accurate, with halo error most prevalent and some evidence of leniency. Ratings by chief residents had the least halo. Results were generally replicable across the two academic years. We conclude that anonymous ratings of surgical faculty by groups of residents can provide a reliable and accurate evaluation method, ratings by chief residents are most accurate, and halo error may pose the greatest threat to accuracy, pointing to the needfor greater definition of evaluation items and scale points.

Evaluation & the Health Professions, Vol. 15, No. 3, 313-324 (1992)
DOI: 10.1177/016327879201500304


Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
Anesth. Analg.Home page
G. R. de Oliveira Filho, A. J. Dal Mago, J. H. S. Garcia, and R. Goldschmidt
An Instrument Designed for Faculty Supervision Evaluation by Anesthesia Residents and Its Psychometric Properties
Anesth. Analg., October 1, 2008; 107(4): 1316 - 1322.
[Abstract] [Full Text] [PDF]


Home page
Eval RevHome page
L. A. Lutsky, D. A. Risucci, and A. J. Tortolani
Reliability and Accuracy of Surgical Resident Peer Ratings
Eval Rev, August 1, 1993; 17(4): 444 - 456.
[Abstract] [PDF]