+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Investigating the disagreement between clinicians' ratings of patients in ICUs



Investigating the disagreement between clinicians' ratings of patients in ICUs



IEEE Journal of Biomedical and Health Informatics 17(4): 843-852



We present a Bayesian analysis of ordinal annotations made by clinicians of patients in intensive care. In particular, we investigate the different ways in which clinicians can disagree and how their disagreement is reduced once they take part in a recently proposed procedure (INSIGHT) that aims at improving consistency. The model combines a nonparametric function (loosely interpretable as the health of the patient) with clinician-specific generative procedures for producing the observed ordinal values. Our analysis provides valuable details of the rating behavior of the individual clinicians and shows that the INSIGHT procedure is particularly effective at removing (some) clinician-specific inconsistencies and biases.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 053964767

Download citation: RISBibTeXText

PMID: 25055313

DOI: 10.1109/jbhi.2013.2252182


Related references

Investigating conflict in ICUs-is the clinicians' perspective enough?. Critical Care Medicine 42(2): 328-335, 2014

Prevalence of Disagreement About Appropriateness of Treatment Between ICU Patients/Surrogates and Clinicians. Chest 155(6): 1140-1147, 2019

Reasons for clinician patient disagreement in ratings of the patient's health status. Clinical Research 35(3): 351A, 1987

Disagreement Between Clinicians and Score in Decision-Making Capacity of Critically Ill Patients. Critical Care Medicine 47(3): 337-344, 2019

Ratings of seriousness of behavior problems of elementary school boys by teachers, school psychologists and clinicians in Nassau Country: Correlations of teachers', school psychologists' and clinicians' ratings. Correlations of teachers' and school psychologists' ratings in elementary schools where quantity and functions of school psychological services vary. DISSERT ABSTS 22(12 Pt I): 4273-4274, 1962

Ecological validity in assessment of discourse in traumatic brain injury: ratings by clinicians and non-clinicians. Brain Injury 12(11): 963-976, 1998

A survey of clinicians regarding respiratory physiotherapy intervention for intubated and mechanically ventilated patients with community-acquired pneumonia. What is current practice in Australian ICUs?. Journal of Evaluation in Clinical Practice 23(4): 812-820, 2017

Clinicians' versus caregivers' ratings of burden in patients with schizophrenia and bipolar disorder. International Journal of Social Psychiatry 60(4): 330-336, 2014

Concordance between clinicians' and patients' ratings of anxiety and depression as mediated by private self-consciousness. Journal of Personality Assessment 50(1): 93, 1986

Agreement or Disagreement of a Set of Likert-Type Ratings. Educational and Psychological Measurement 39(2): 291-295, 1979

Patients' experiences and clinicians' ratings of the quality of outpatient teams in psychiatric care units in Norway. Psychiatric Services 58(8): 1102-1107, 2007

Identifying causes of disagreement between self-reports and spouse ratings of personality. Journal of Personality 66(3): 285-313, 1998

Quality of dying and death in two medical ICUs: perceptions of family and clinicians. Chest 127(5): 1775-1783, 2005

Quality of Dying and Death in Two Medical ICUs: Perceptions of Family and Clinicians. Yearbook of Critical Care Medicine 2006: 257-260, 2006

Identifying disagreement in ordinal ratings within a fixed panel of cytotechnologists. Analytical and Quantitative Cytology and Histology 16(6): 381-392, 1994