Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

Click here to sign up for SAGE Journal Email Alerts today!

Sign In to gain access to subscriptions and/or personal tools.
Evaluation & the Health Professions
This Article
Right arrow Full Text (PDF)
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by O’Malley, K. J.
Right arrow Articles by Richards, B.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by O’Malley, K. J.
Right arrow Articles by Richards, B.
Right arrowPubmed/NCBI databases
Medline Plus Health Information
*Health Occupations
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

Validation Of An Observation Instrument For Measuring Student Engagement In Health Professions Settings

Kimberly J. O’Malley

VA Medical Center

Betty Jeanne Moran

Baylor College of Medicine

Paul Haidet

VA Medical Center

Charles L. Seidel

Virginia Schneider

Baylor College of Medicine

Robert O. Morgan

P. Adam Kelly

VA Medical Center

Boyd Richards

Baylor College of Medicine

Documenting student engagement has received increased emphasis in medical schools, as teaching strategies are changing to include more student-to-student interactions. The purpose of this study was to develop and evaluate a measure of student engagement completed by independent observers that would not interfere with student learning time. Data from 3,182 observations completed by nine observers in 32 educational classroom settings with 23 different instructors were used to evaluate the interobserver reliability and gather validity evidence for our observational instrument, named the STROBE. Results indicated that interobserver agreement was good to excellent when observations were conducted simultaneously on randomly selected students in the same classroom (84% average agreement and 0.79 average kappa coefficient) and when observations were conducted on different randomly selected students (79% average agreement). Results also provided strong evidence for validity. Overall, findings indicate that the STROBE demonstrates promise for educational research and evaluation by documenting student engagement in medical education settings.

Key Words: student engagement • outcome measures • reliability

Evaluation & the Health Professions, Vol. 26, No. 1, 86-103 (2003)
DOI: 10.1177/0163278702250093
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?