+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Statistical inferences under the Null hypothesis: common mistakes and pitfalls in neuroimaging studies



Statistical inferences under the Null hypothesis: common mistakes and pitfalls in neuroimaging studies



Frontiers in Neuroscience 9: 18



Published studies using functional and structural MRI include many errors in the way data are analyzed and conclusions reported. This was observed when working on a comprehensive review of the neural bases of synesthesia, but these errors are probably endemic to neuroimaging studies. All studies reviewed had based their conclusions using Null Hypothesis Significance Tests (NHST). NHST have yet been criticized since their inception because they are more appropriate for taking decisions related to a Null hypothesis (like in manufacturing) than for making inferences about behavioral and neuronal processes. Here I focus on a few key problems of NHST related to brain imaging techniques, and explain why or when we should not rely on "significance" tests. I also observed that, often, the ill-posed logic of NHST was even not correctly applied, and describe what I identified as common mistakes or at least problematic practices in published papers, in light of what could be considered as the very basics of statistical inference. MRI statistics also involve much more complex issues than standard statistical inference. Analysis pipelines vary a lot between studies, even for those using the same software, and there is no consensus which pipeline is the best. I propose a synthetic view of the logic behind the possible methodological choices, and warn against the usage and interpretation of two statistical methods popular in brain imaging studies, the false discovery rate (FDR) procedure and permutation tests. I suggest that current models for the analysis of brain imaging data suffer from serious limitations and call for a revision taking into account the "new statistics" (confidence intervals) logic.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 058901284

Download citation: RISBibTeXText

PMID: 25745383

DOI: 10.3389/fnins.2015.00018


Related references

Null hypothesis in studies on plant communities i. null model research procedure statistical analysis of results. Ekologia polska 36(3-4): 471-484, 1988

Perspectives on the Use of Null Hypothesis Statistical Testing. Part II: Is Null Hypothesis Statistical Testing an Irregular Bulk of Masonry?. Educational and Psychological Measurement 77(4): 613-615, 2017

A common misapplication of statistical inference: Nuisance control with null-hypothesis significance tests. Brain and Language 162: 42-45, 2016

Perspectives on the Use of Null Hypothesis Statistical Testing. Part III: The Various Nuts and Bolts of Statistical and Hypothesis Testing. Educational and Psychological Measurement 77(5): 816-818, 2017

What role should null-hypothesis significance tests have in statistical education and hypothesis falsification?. Trends in Ecology and Evolution 22(9): 445-6; Author Reply 446, 2007

Adjusting the neuroimaging statistical inferences for nonstationarity. Medical Image Computing and Computer-Assisted Intervention 12(Pt 1): 992-999, 2009

Inguinal hernioplasty. Common mistakes and pitfalls. Surgical Clinics of North America 46(5): 1089-1100, 1966

Neuroimaging Research: From Null-Hypothesis Falsification to Out-of-Sample Generalization. Educational and Psychological Measurement 77(5): 868-880, 2017

Perspectives on the Use of Null Hypothesis Statistical Testing. Part I: The Mighty Frames of Scientific and Statistical Inference. Educational and Psychological Measurement 77(3): 471-474, 2017

Project pitfalls. Nine common hospital planning mistakes. Health Facilities Management 19(7): 39-42 44, 2006

Design and statistical analysis of oral medicine studies: common pitfalls. Oral Diseases 16(3): 233-241, 2010

Common Mistakes and Pitfalls in Magnetic Resonance Imaging of the Knee. Journal of the Belgian Society of Radiology 100(1): 99, 2016

Immunohistochemical Pitfalls: Common Mistakes in the Evaluation of Lynch Syndrome. Surgical Pathology Clinics 10(4): 977, 2017

Medical language directed to the rheumatologist: pitfalls and common mistakes. Revista Brasileira de Reumatologia 54(1): 79-82, 2015

History of the sleeper effect: Some logical pitfalls in accepting the null hypothesis. Psychological Bulletin 86(4): 662-679, 1979