+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Research Review: Test-retest reliability of standardized diagnostic interviews to assess child and adolescent psychiatric disorders: a systematic review and meta-analysis



Research Review: Test-retest reliability of standardized diagnostic interviews to assess child and adolescent psychiatric disorders: a systematic review and meta-analysis



Journal of Child Psychology and Psychiatry and Allied Disciplines 60(1): 16-29



Label="BACKGROUND">A better understanding of factors contributing to the observed variability in estimates of test-retest reliability in published studies on standardized diagnostic interviews (SDI) is needed. The objectives of this systematic review and meta-analysis were to estimate the pooled test-retest reliability for parent and youth assessments of seven common disorders, and to examine sources of between-study heterogeneity in reliability.Label="METHODS">Following a systematic review of the literature, multilevel random effects meta-analyses were used to analyse 202 reliability estimates (Cohen's kappa = ҡ) from 31 eligible studies and 5,369 assessments of 3,344 children and youth.Label="RESULTS">Pooled reliability was moderate at ҡ = .58 (CI 95% 0.53-0.63) and between-study heterogeneity was substantial (Q = 2,063 (df = 201), p < .001 and I2  = 79%). In subgroup analysis, reliability varied across informants for specific types of psychiatric disorder (ҡ = .53-.69 for parent vs. ҡ = .39-.68 for youth) with estimates significantly higher for parents on attention deficit hyperactivity disorder, oppositional defiant disorder and the broad groupings of externalizing and any disorder. Reliability was also significantly higher in studies with indicators of poor or fair study methodology quality (sample size <50, retest interval <7 days).Label="CONCLUSIONS">Our findings raise important questions about the meaningfulness of published evidence on the test-retest reliability of SDIs and the usefulness of these tools in both clinical and research contexts. Potential remedies include the introduction of standardized study and reporting requirements for reliability studies, and exploration of other approaches to assessing and classifying child and adolescent psychiatric disorder.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 065478209

Download citation: RISBibTeXText

PMID: 29457645

DOI: 10.1111/jcpp.12876


Related references

Prevalence of child and adolescent psychiatric disorders in India: a systematic review and meta-analysis. Child and Adolescent Psychiatry and Mental Health 8: 22, 2014

Test-retest reliability of the diagnosis of schizoaffective disorder in childhood and adolescence - A systematic review and meta-analysis. Journal of Affective Disorders 230: 28-33, 2018

A test-retest reliability study of child-reported psychiatric symptoms and diagnoses using the Child and Adolescent Psychiatric Assessment (CAPA-C). Psychological Medicine 25(4): 755-762, 1995

Test-retest reliability of schizoaffective disorder compared with schizophrenia, bipolar disorder, and unipolar depression--a systematic review and meta-analysis. Bipolar Disorders 17(7): 753-768, 2015

Associations of child and adolescent anxiety with later alcohol use and disorders: a systematic review and meta-analysis of prospective cohort studies. Addiction 114(6): 968-982, 2019

A systematic review on olfaction in child and adolescent psychiatric disorders. Journal of Neural Transmission 120(1): 121-130, 2013

Systematic Review and Meta-Analysis of Studies Evaluating Diagnostic Test Accuracy: A Practical Review for Clinical Researchers-Part II. Statistical Methods of Meta-Analysis. Korean Journal of Radiology 16(6): 1188-1196, 2016

Early Response to treatment in Eating Disorders: A Systematic Review and a Diagnostic Test Accuracy Meta-Analysis. European Eating Disorders Review 25(2): 67-79, 2017

Uptake of newer methodological developments and the deployment of meta-analysis in diagnostic test research: a systematic review. Bmc Medical Research Methodology 11: 27, 2011

Test-Retest Reliability of Measurements of Hand-Grip Strength Obtained by Dynamometry from Older Adults: A Systematic Review of Research in the PubMed Database. Journal of Frailty and Aging 6(2): 83-87, 2017

A critical analysis of test-retest reliability in instrument validation studies of cancer patients under palliative care: a systematic review. Bmc Medical Research Methodology 14: 8, 2014

Recall and dating of psychiatric symptoms. Test-retest reliability of time-related symptom questions in a standardized psychiatric interview. Archives of General Psychiatry 46(5): 437-443, 1989

Test-retest reliability of the five-repetition sit-to-stand test: a systematic review of the literature involving adults. Journal of Strength and Conditioning Research 25(11): 3205-3207, 2011

Test-retest reliability of a standardized psychiatric interview (DIS/CIDI). European Archives of Psychiatry and Neurological Sciences 236(4): 214-222, 1987

A Review of Child and Adolescent Diagnostic Interviews for Clinical Practitioners. Assessment 22(6): 690-703, 2015