This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Rippey, R. M. Articles by Voytovich, A. E. Search for Related Content PubMed Articles by Rippey, R. M. Articles by Voytovich, A. E. Social Bookmarking                         What's this?

Anomalous Responses on Confidence-Scored Tests

Anthony E. Voytovich

University of Connecticut Health Center

Confidence testing allows subjects to respond to each option of a multiple-choice question with their perceived likelihood that it is the correct one. Scoring procedures subsequently provide measures not only of knowledge, but of the individual's "confidence" or realism in the assessment of whether the response is correct. There is an underlying assumption, however, of a significant correlation between assigned probabilities and actual likelihood for choosing a correct response, for we would naturally assume that subjects would, in general, be more certain when correct and less certain when wrong. Significant negative correlation or correlation not different from zero suggests bizarre responses in which the subject becomes more certain of the answer as mastery declines. Such anomalous responses were isolated from 530 tests of clinical knowledge administered to highly motivated medical students. These were rare (less than 3%0). Thus a crucial assumption underlying the theory of confidence testing is validated and a useful method of identifying outliers is devised.

Evaluation & the Health Professions, Vol. 8, No. 1, 109-119 (1985)
DOI: 10.1177/016327878500800109


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?