+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Replicability or reproducibility? On the replication crisis in computational neuroscience and sharing only relevant detail

Replicability or reproducibility? On the replication crisis in computational neuroscience and sharing only relevant detail

Journal of Computational Neuroscience 45(3): 163-172

Replicability and reproducibility of computational models has been somewhat understudied by "the replication movement." In this paper, we draw on methodological studies into the replicability of psychological experiments and on the mechanistic account of explanation to analyze the functions of model replications and model reproductions in computational neuroscience. We contend that model replicability, or independent researchers' ability to obtain the same output using original code and data, and model reproducibility, or independent researchers' ability to recreate a model without original code, serve different functions and fail for different reasons. This means that measures designed to improve model replicability may not enhance (and, in some cases, may actually damage) model reproducibility. We claim that although both are undesirable, low model reproducibility poses more of a threat to long-term scientific progress than low model replicability. In our opinion, low model reproducibility stems mostly from authors' omitting to provide crucial information in scientific papers and we stress that sharing all computer code and data is not a solution. Reports of computational studies should remain selective and include all and only relevant bits of code.

Please choose payment method:

(PDF emailed within 0-6 h: $19.90)

Accession: 065903761

Download citation: RISBibTeXText

PMID: 30377880

DOI: 10.1007/s10827-018-0702-z

Related references

Reproducibility and replicability in zebrafish behavioral neuroscience research. Pharmacology Biochemistry and Behavior 178: 30-38, 2019

Credibility, Replicability, and Reproducibility in Simulation for Biomedicine and Clinical Applications in Neuroscience. Frontiers in Neuroinformatics 12: 18, 2018

Challenges in Reproducibility, Replicability, and Comparability of Computational Models and Tools for Neuronal and Glial Networks, Cells, and Subcellular Structures. Frontiers in Neuroinformatics 12: 20, 2018

Data sharing for computational neuroscience. Neuroinformatics 6(1): 47-55, 2008

The reproducibility "crisis": Reaction to replication crisis should not stifle innovation. Embo Reports 18(9): 1493-1496, 2017

Sharing One Biographical Detail Elicits Priming between Famous Names: Empirical and Computational Approaches. Frontiers in Psychology 2: 75, 2011

Reproducibility in Computational Neuroscience Models and Simulations. IEEE Transactions on Bio-Medical Engineering 63(10): 2021-2035, 2016

Barriers and solutions for early career researchers in tackling the reproducibility crisis in cognitive neuroscience. Cortex; a Journal Devoted to the Study of the Nervous System and Behavior 113: 357-359, 2019

Spiking Interest in Computational Modeling: A Unified Approach to Cognitive Neuroscience. Review of Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain, by O'Reilly, R. C., & Munakata, Y. Journal of Mathematical Psychology 46(5): 636-653, 2002

Replicability and Reproducibility in Comparative Psychology. Frontiers in Psychology 8: 862, 2017

The journey to transparency, reproducibility, and replicability. Journal of the American Medical Informatics Association 26(3): 185-187, 2019

Reproducibility and replicability of science and thoracic surgery. Journal of Thoracic and Cardiovascular Surgery 152(6): 1489-1491, 2016

Reproducibility vs. Replicability: A Brief History of a Confused Terminology. Frontiers in Neuroinformatics 11: 76, 2017

The crisis in replicability. Developmental Medicine and Child Neurology 61(5): 504, 2019

Reproducibility and replicability of rodent phenotyping in preclinical studies. Neuroscience and Biobehavioral Reviews 87: 218-232, 2018