+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Direct Observation versus Endoscopic Video Recording-Based Rating with the Objective Structured Assessment of Technical Skills for Training of Laparoscopic Cholecystectomy



Direct Observation versus Endoscopic Video Recording-Based Rating with the Objective Structured Assessment of Technical Skills for Training of Laparoscopic Cholecystectomy



European Surgical Research. Europaische Chirurgische Forschung. Recherches Chirurgicales Europeennes 57(1-2): 1-9



The validated Objective Structured Assessment of Technical Skills (OSATS) score is used for evaluating laparoscopic surgical performance. It consists of two subscores, a Global Rating Scale (GRS) and a Specific Technical Skills (STS) scale. The OSATS has accepted construct validity for direct observation ratings by experts to discriminate between trainees' levels of experience. Expert time is scarce. Endoscopic video recordings would facilitate assessment with the OSATS. We aimed to compare video OSATS with direct OSATS. We included 79 participants with different levels of experience [58 medical students, 15 junior residents (novices), and 6 experts]. Performance of a cadaveric porcine laparoscopic cholecystectomy (LC) was evaluated with OSATS by blinded expert raters by direct observation and then as an endoscopic video recording. Operative time was recorded. Direct OSATS rating and video OSATS rating correlated significantly (x03C1; = 0.33, p = 0.005). Significant construct validity was found for direct OSATS in distinguishing between students or novices and experts. Students and novices were not different in direct OSATS or video OSATS. Mean operative times varied for students (73.4 ± 9.0 min), novices (65.2 ± 22.3 min), and experts (46.8 ± 19.9 min). Internal consistency was high between the GRS and STS subscores for both direct and video OSATS with Cronbach's α of 0.76 and 0.86, respectively. Video OSATS and operative time in combination was a better predictor of direct OSATS than each single parameter. Direct OSATS rating was better than endoscopic video rating for differentiating between students or novices and experts for LC and should remain the standard approach for the discrimination of experience levels. However, in the absence of experts for direct rating, video OSATS supplemented with operative time should be used instead of single parameters for predicting direct OSATS scores.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 057629411

Download citation: RISBibTeXText

PMID: 27058392

DOI: 10.1159/000444449


Related references

A randomized comparison of video demonstration versus hands-on training of medical students for vacuum delivery using Objective Structured Assessment of Technical Skills (OSATS). Medicine 96(11): E6355-E6355, 2017

Using the Objective Structured Assessment of Technical Skills (OSATS) global rating scale to evaluate the skills of surgical trainees in the operating room. Surgery Today 43(3): 271-275, 2013

Objective Structured Assessment of Technical Skills (OSATS) evaluation of theoretical versus hands-on training of vaginal breech delivery management: a randomized trial. European Journal of Obstetrics, Gynecology, and Reproductive Biology 171(2): 252-256, 2014

Assessment in orthopedic training-an analysis of rating consistency by using an objective structured examination video. Journal of Surgical Education 70(2): 189-192, 2013

Objective structured assessment of nontechnical skills: Reliability of a global rating scale for the in-training assessment in the operating room. Surgery 157(6): 1002-1013, 2015

Value and face validity of objective structured assessment of technical skills (OSATS) for work based assessment of surgical skills in obstetrics and gynaecology. Medical Teacher 30(2): 212-216, 2008

The use of the "Objective Structured Assessment of Technical Skills" as an Assessment Tool Among Danish Vascular Surgeons in Training. Journal of Surgical Education 72(5): 1052-1056, 2016

Developing an Objective Structured Assessment of Technical Skills for Laparoscopic Suturing and Intracorporeal Knot Tying. Journal of Surgical Education 73(2): 258-263, 2016

A new curriculum for hysteroscopy training as demonstrated by an objective structured assessment of technical skills (OSATS). American Journal of Obstetrics and Gynecology 193(5): 1856-1865, 2005

Resident self-assessment versus faculty assessment of laparoscopic technical skills using a global rating scale. International Journal of Medical Education 1: 37-41, 2010

Objective Structured Assessment of Technical Skills (OSATS) evaluation of hysteroscopy training: a prospective study. European Journal of Obstetrics, Gynecology, and Reproductive Biology 178(): 1-5, 2015

Construct Validity of a Simple Laparoscopic Ovarian Cystectomy Model Using a Validated Objective Structured Assessment of Technical Skills. Journal of Minimally Invasive Gynecology 24(5): 850-854, 2017

Robotic objective structured assessment of technical skills: a randomized multicenter dry laboratory training pilot study. Female Pelvic Medicine and Reconstructive Surgery 20(4): 228-236, 2015

Development of a Competency Level Technical Skills Assessment: the General Surgery Objective Structured Assessment of Technical Skills. Journal of the American College of Surgeons 225(4): S173-S174, 2017

Novel hybrid objective structured assessment of technical skills/objective structured clinical examinations in comprehensive perioperative breast care: a three-year analysis of outcomes. Journal of Surgical Education 66(6): 344-351, 2010