Journal of Manipulative and Physiological Therapeutics
Volume 29, Issue 6 , Pages 463-467 , July 2006

Applying Generalizability Theory to High-Stakes Objective Structured Clinical Examinations in a Naturalistic Environment

  • Douglas M. Lawson, DC, MSc

      Affiliations

    • Graduate Student, University of Calgary, Faculty of Medicine, Medical Education Research Centre, Calgary, Alberta, Canada
    • Corresponding Author InformationSubmit requests for reprints to: Douglas M. Lawson, DC, MSc, 4832 26 Ave NE, Calgary, Alberta, Canada T1Y1C9.

Received 18 August 2005 ,Revised 29 November 2005

References 

  1. Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. BMJ. 1975;1:447–451
  2. Harden RM. What is an OSCE?. Med Teach. 1988;10:19–22
  3. Harden RM. Twelve tips for organizing an objective structured clinical examination (OSCE). Med Teach. 1990;12:259–264
  4. Harasym PH, Crutcher R, Lawson D. Interviewer's leniency/stringency effects on candidate scores. In: Association of American Medical Colleges, Research in Medical Education Conference; 2004 Nov 5-10; Boston. Washington (DC): Association of American Medical Colleges; 2004;p. 36
  5. Lawson DM, Harasym P. Adjusting for examiners who are hawks and doves on a “high stake” OSCE. In: 22nd Annual Conference for Generalists in Medical Education; 2002 Nov 9-10; San Francisco, CA. Washington (DC): Generalists in Medical Education; 2002;p. 17
  6. Lawson DM. Use of the multifacet Rasch model to adjust for the error variance due to the examiner stringency/leniency effects in OSCEs. Calgary: University of Calgary, Faculty of Graduate Studies; 2003;
  7. Lawson D, Harasym P. The contribution of standardized patients to error variance in candidate scores on a high stakes objective structured clinical examination. Educ Méd. 2004;7:166
  8. Brennan RL. Introduction. In: Generalizability theory. New York: Springer-Verlag, Inc; 2001;p. 4
  9. VanLeeuwen DM, Barnes MD, Pase M. Generalizability theory: a unified approach to assessing the dependability (reliability) of measurements in the health sciences. J Outcome Meas. 1998;2:302–325
  10. Newble DI, Swanson DB. Psychometric characteristics of the objective structured clinical examination. Med Educ. 1988;22:325–334
  11. Lawson D, Harasym P. Using standardized candidates to identify stringent/lenient examiners and to correct for examiner and standardized patient performance. J Chiropr Educ. 2003;17:19
  12. Wass V, Jones R, Van der V. Standardized or real patients to test clinical competence? The long case revisited. Med Educ. 2001;35:321–325

PII: S0161-4754(06)00157-6

doi: 10.1016/j.jmpt.2006.06.009

Journal of Manipulative and Physiological Therapeutics
Volume 29, Issue 6 , Pages 463-467 , July 2006

Article Tools