+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Using objective structured assessment of technical skills to evaluate a basic skills simulation curriculum for first-year surgical residents



Using objective structured assessment of technical skills to evaluate a basic skills simulation curriculum for first-year surgical residents



Journal of the American College of Surgeons 209(3): 364-370.E2



In response to new Accreditation Council for Graduate Medical Education requirements about simulation skill laboratories, programs are incorporating simulation into residents' training. Despite substantial research on simulators, few data exist to support the effectiveness of simulation skills curricula. We report on an Objective Structured Assessment of Technical Skills (OSATS) used to assess residents' needs and evaluate a curriculum designed to increase proficiency. The five-session (10-week) curriculum covered asepsis, skin preparation, gowning, gloving, knot-tying, suturing, and excision. Performance on a 20-minute OSATS station was measured by unblinded raters using a task-specific checklist and seven global rating scales. Interns' pre-post improvement was assessed using paired t-tests. PGY2 and PGY3 residents were used as nonequivalent controls; their scores set a benchmark for PGY1 residents postcurriculum. Percentage of possible points earned was compared with a 75% "needs" criterion; ANOVA was used to assess group differences at the p < 0.05 level. Seven PGY2 and 6 PGY3 residents took the OSATS; 24 of 25 PGY1s completed both the baseline and postcurriculum OSATS. At baseline, PGY1 mean percent correct total score was 49%; they performed considerably below PGY2 (68%) and PGY3 (74%) residents. PGY1 scores improved significantly after 10 weeks (p < or = 0.001). When their postcurriculum scores were compared with PGY2 and PGY3 resident benchmarks, there were no significant differences in checklist (p = 0.38), global item (p = 0.29), or total scores (p = 0.45). Our results suggest that the simulation curriculum helped PGY1 residents attain basic surgical skills at levels consistent with PGY2 and PGY3 residents as measured by an OSATS. Only PGY3 residents performed at the 75% criterion.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 056816524

Download citation: RISBibTeXText

PMID: 19717041

DOI: 10.1016/j.jamcollsurg.2009.05.005


Related references

Using the Objective Structured Assessment of Technical Skills (OSATS) global rating scale to evaluate the skills of surgical trainees in the operating room. Surgery Today 43(3): 271-275, 2013

Value and face validity of objective structured assessment of technical skills (OSATS) for work based assessment of surgical skills in obstetrics and gynaecology. Medical Teacher 30(2): 212-216, 2008

Early, intermediate, and late effects of a surgical skills "boot camp" on an objective structured assessment of technical skills: a randomized controlled study. Journal of the American College of Surgeons 210(6): 984-989, 2010

Impact of a structured skills laboratory curriculum on surgery residents' intraoperative decision-making and technical skills. Academic Medicine 83(10 Suppl.): S68-S71, 2008

Novel hybrid objective structured assessment of technical skills/objective structured clinical examinations in comprehensive perioperative breast care: a three-year analysis of outcomes. Journal of Surgical Education 66(6): 344-351, 2010

Development of an objective structured assessment of technical skills for obstetric and gynecology residents. Obstetrics and Gynecology 96(1): 146-150, 2000

Development of a Competency Level Technical Skills Assessment: the General Surgery Objective Structured Assessment of Technical Skills. Journal of the American College of Surgeons 225(4): S173-S174, 2017

A new curriculum for hysteroscopy training as demonstrated by an objective structured assessment of technical skills (OSATS). American Journal of Obstetrics and Gynecology 193(5): 1856-1865, 2005

A curriculum for Burch colposuspension and diagnostic cystoscopy evaluated by an objective structured assessment of technical skills. American Journal of Obstetrics and Gynecology 197(5): 544.E1-6, 2007

Objective Structured Assessment of Technical Skills to Teach and Study Retention of Fourth-Degree Laceration Repair Skills. Journal of Graduate Medical Education 7(1): 32-35, 2015

Passing the Objective Structured Assessment of Technical Skill Exam Predicts Future Technical Skills Performance in Surgical Trainees. Journal of the American College of Surgeons 221(4): S53-S54, 2015

Development of a surgical skills curriculum for the training and assessment of manual skills in orthopedic surgical residents. Journal of Surgical Education 72(1): 47-52, 2015

Relationship between objective assessment of technical skills and subjective in-training evaluations in surgical residents. Journal of the American College of Surgeons 198(1): 105-110, 2003

Evaluation of clinical skills for first-year surgical residents using orientation programme and objective structured clinical evaluation as a tool of assessment. Journal of Postgraduate Medicine 56(4): 297-300, 2010

Test of integrated professional skills: objective structured clinical examination/simulation hybrid assessment of obstetrics-gynecology residents' skill integration. Journal of Graduate Medical Education 6(1): 117-122, 2014