+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Measuring non-technical skills of anaesthesiologists in the operating room: a systematic review of assessment tools and their measurement properties



Measuring non-technical skills of anaesthesiologists in the operating room: a systematic review of assessment tools and their measurement properties



British Journal of Anaesthesia 121(6): 1218-1226



Non-technical skills, such as communication or leadership, are integral to clinical competence in anaesthesia. There is a need for valid and reliable tools to measure anaesthetists' non-technical performance for both initial and continuing professional development. This systematic review aims to summarise the measurement properties of existing assessment tools to determine which tool is most robust. Embase (via OVID), Medline and Medline in Process (via OVID), and reference lists of included studies and previously published relevant systematic reviews were searched (through August 2017). Quantitative studies investigating the measurement properties of tools used to assess anaesthetists' intraoperative non-technical skills, either in a clinical or simulated environment, were included. Pairs of independent reviewers determined eligibility and extracted data. Risk of bias was assessed using the COSMIN checklist. The search yielded 978 studies, of which 14 studies describing seven tools met the inclusion criteria. Of these, 12 involved simulated crisis settings only. The measurement properties of the Anaesthetists' Non-Technical Skills (ANTS) tool were most commonly assessed (n=9 studies), with studies of two types of validity (content, concurrent) and two types of reliability (internal consistency, interrater). Most of these studies, however, were at serious risk of bias. Though there are seven tools for assessing the non-technical skills of anaesthetists, only ANTS has been extensively investigated with regard to its measurement properties. ANTS appears to have acceptable validity and reliability for assessing non-technical skills of anaesthetists in both simulated and clinical settings. Future research should consider additional clinical contexts and types of measurement properties.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 065840487

Download citation: RISBibTeXText

PMID: 30442248

DOI: 10.1016/j.bja.2018.07.028


Related references

Assessment of Technical Skills Competence in the Operating Room: A Systematic and Scoping Review. Academic Medicine 93(5): 794-808, 2018

Measuring the teamwork performance of teams in crisis situations: a systematic review of assessment tools and their measurement properties. Bmj Quality and Safety 28(4): 327-337, 2019

Toolbox of assessment tools of technical skills in otolaryngology-head and neck surgery: A systematic review. Laryngoscope 128(7): 1571-1575, 2018

Using the Objective Structured Assessment of Technical Skills (OSATS) global rating scale to evaluate the skills of surgical trainees in the operating room. Surgery Today 43(3): 271-275, 2013

Assessment of non-technical skills in the operating room--one assessment tool per specialty?. Acta Anaesthesiologica Scandinavica 58(7): 773-774, 2014

Non-technical skills for surgeons in the operating room: a review of the literature. Surgery 139(2): 140-149, 2006

Measurement properties of tools measuring mental health knowledge: a systematic review. Bmc Psychiatry 16: 297, 2016

Measurement properties of mental health literacy tools measuring help-seeking: a systematic review. Journal of Mental Health 26(6): 543-555, 2017

Anaesthesiologists' views on the need for point-of-care information system in the operating room: a survey of the European Society of Anaesthesiologists. European Journal of Anaesthesiology 21(11): 898-901, 2005

Evaluating structured assessment of anaesthesiologists' non-technical skills. Acta Anaesthesiologica Scandinavica 60(6): 756-766, 2016

The identification and appraisal of assessment tools used to evaluate metatarsus adductus: a systematic review of their measurement properties. Journal of Foot and Ankle Research 11: 25, 2018

Measurement properties of self-report physical activity assessment tools for patients with stroke: a systematic review. Brazilian Journal of Physical Therapy 23(6): 476-490, 2019

Measurement properties of self-report physical activity assessment tools in stroke: a protocol for a systematic review. Bmj Open 7(2): E012655, 2017

Objective structured assessment of technical skills in elliptical excision repair of senior dermatology residents: a multirater, blinded study of operating room video recordings. JAMA Dermatology 150(6): 608-612, 2014

A systematic review to assess the methodological quality of studies on measurement properties for caries risk assessment tools for young children. International Journal of Paediatric Dentistry 2018:, 2018