+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Using standardized video cases for assessment of medical communication skills: reliability of an objective structured video examination by computer

Using standardized video cases for assessment of medical communication skills: reliability of an objective structured video examination by computer

Patient Education and Counseling 60(1): 24-31

Using standardized video cases in a computerized objective structured video examination (OSVE) aims to measure cognitive scripts underlying overt communication behavior by questions on knowledge, understanding and performance. In this study the reliability of the OSVE assessment is analyzed using the generalizability theory. Third year undergraduate medical students from the Academic Medical Center of the University of Amsterdam answered short-essay questions on three video cases, respectively about history taking, breaking bad news, and decision making. Of 200 participants, 116 completed all three video cases. Students were assessed in three shifts, each using a set of parallel case editions. About half of all available exams were scored independently by two raters using a detailed rating manual derived from the other half. Analyzed were the reliability of the assessment, the inter-rater reliability, and interrelatedness of the three types of video cases and their parallel editions, by computing a generalizability coefficient G. The test score showed a normal distribution. The students performed relatively well on the history taking type of video cases, and relatively poor on decision making and did relatively poor on the understanding ('knows why/when') type of questions. The reliability of the assessment was acceptable (G = 0.66). It can be improved by including up to seven cases in the OSVE. The inter-rater reliability was very good (G = 0.93). The parallel editions of the video cases appeared to be more alike (G = 0.60) than the three case types (G = 0.47). The additional value of an OSVE is the differential picture that is obtained about covert cognitive scripts underlying overt communication behavior in different types of consultations, indicated by the differing levels of knowledge, understanding and performance. The validation of the OSVE score requires more research. A computerized OSVE has been successfully applied with third year undergraduate medical students. The test score meets psychometric criteria, enabling a proper discrimination between adequately and poorly performing students. The high inter-rater reliability indicates that a single rater is permitted.

Please choose payment method:

(PDF emailed within 0-6 h: $19.90)

Accession: 050918786

Download citation: RISBibTeXText

PMID: 16332467

DOI: 10.1016/j.pec.2004.11.010

Related references

The Objective Structured Video Exam for assessment of communication skills. Medical Education 34(11): 939-945, 2000

A randomized comparison of video demonstration versus hands-on training of medical students for vacuum delivery using Objective Structured Assessment of Technical Skills (OSATS). Medicine 96(11): E6355-E6355, 2017

Using an objective structured video exam to identify differential understanding of aspects of communication skills. Medical Teacher 34(4): E242-E250, 2012

The objective structured video examination of medical students. Medical Education 38(11): 1199-1200, 2004

Neurology assessment by objective structured video examination. Clinical Teacher 13(5): 348-351, 2016

Assessment in orthopedic training-an analysis of rating consistency by using an objective structured examination video. Journal of Surgical Education 70(2): 189-192, 2013

Objective structured video examination in psychiatric and mental health nursing: a learning and assessment method. Journal of Nursing Education 54(2): 87-95, 2015

Exploring the use of videotaped objective structured clinical examination in the assessment of joint examination skills of medical students. Arthritis and Rheumatism 57(5): 869-876, 2007

Validity and reliability of the Standardized Orthopedic Assessment Tool (SOAT): a variation of the traditional objective structured clinical examination. Journal of Athletic Training 49(3): 373-380, 2015

Direct Observation versus Endoscopic Video Recording-Based Rating with the Objective Structured Assessment of Technical Skills for Training of Laparoscopic Cholecystectomy. European Surgical Research. Europaische Chirurgische Forschung. Recherches Chirurgicales Europeennes 57(1-2): 1-9, 2016

Assessment of first-year veterinary students' communication skills using an objective structured clinical examination: the importance of context. Journal of Veterinary Medical Education 39(3): 304-310, 2012

Use of Video-Projected Structured Clinical Examination (ViPSCE) instead of the traditional oral (Viva) examination in the assessment of final year medical students. Education for Health 17(1): 17-26, 2004

Use of video-projected structured clinical examination (ViPSCE) instead of the traditional oral (viva) examination in the assessment of final year medical students. Medical Education 37(11): 1048, 2003

Objective structured assessment of technical skills in elliptical excision repair of senior dermatology residents: a multirater, blinded study of operating room video recordings. JAMA Dermatology 150(6): 608-612, 2014

Assessment of communication, professionalism, and surgical skills in an objective structured performance-related examination (OSPRE): a psychometric study. American Journal of Surgery 202(4): 433-440, 2011