Examples
Worked examples
- Is an instance
An independent analyst re-running the published Stan code on the deposited dataset and obtaining the same posterior estimates.
- Is an instance
A continuous-integration pipeline that rebuilds a paper's figures from raw data on every commit.
Counter-examples
Looks similar, but isn't
- Not an instance
A new experiment producing the same effect on new subjects (that is replicability, not reproducibility).
- Not an instance
A meta-analysis finding similar effects across studies (generalisability).
Editorial commentary
The National Academies (2019) define reproducibility narrowly as 'computational reproducibility', distinguishing it from replicability (new data, same methods). Reproducibility is a property of the study record, not of the underlying scientific claim: a study may be reproducible (the numbers come out the same) yet not replicable (the effect does not re-emerge on new data). Reproducibility is necessary but not sufficient for credibility.
References
- National Academies of Sciences, Engineering, and Medicine, 'Reproducibility and Replicability in Science' (2019); Goodman, Fanelli, Ioannidis, 'What does research reproducibility mean?' (Science Translational Medicine, 2016).
Also known as
computational reproducibility (narrow sense) · study reproducibility
Machine-readable encodings
Use in your systems
<role vocab="credit"
vocab-identifier="https://casrai.org/dictionary/"
vocab-term="Reproducibility"
vocab-term-identifier="https://casrai.org/dictionary/term/reproducibility" />{
"@context": "https://schema.org",
"@type": "DefinedTerm",
"name": "Reproducibility",
"identifier": "https://casrai.org/dictionary/term/reproducibility",
"description": "The ability to obtain consistent computational or analytical results when the same data and analysis procedures are applied by an independent investigator using the same code and tools.",
"inDefinedTermSet": "https://casrai.org/dictionary/domain/reproducibility-and-computational-research/",
"url": "https://casrai.org/dictionary/term/reproducibility",
"sameAs": [
"computational reproducibility (narrow sense)",
"study reproducibility"
],
"license": "https://creativecommons.org/licenses/by/4.0/"
}
