Examples
Worked examples
- Is an instance
The American Economic Association's pre-publication reproducibility check on every accepted manuscript.
- Is an instance
A graduate-class reproduction exercise of 30 published psychology papers.
Counter-examples
Looks similar, but isn't
- Not an instance
A peer review of a manuscript before publication.
- Not an instance
A replication study collecting new data.
Editorial commentary
Reproducibility audits range in scale from single-study post-mortems (e.g., reanalysis programmes at journals such as Cogent OA) to field-wide programmes (Hardwicke et al.'s audits in psychology, the AEA Data Editor's pre-publication verification in economics). Outcomes are typically categorical: 'fully reproducible', 'partially reproducible', 'not reproducible'.
References
- Hardwicke et al., 'Data availability, reusability, and analytic reproducibility' (Royal Society Open Science, 2018); AEA Data and Code Availability Policy.
Also known as
reproduction study · reanalysis audit
Machine-readable encodings
Use in your systems
<role vocab="credit"
vocab-identifier="https://casrai.org/dictionary/"
vocab-term="Reproducibility audit"
vocab-term-identifier="https://casrai.org/dictionary/term/reproducibility-audit" />{
"@context": "https://schema.org",
"@type": "DefinedTerm",
"name": "Reproducibility audit",
"identifier": "https://casrai.org/dictionary/term/reproducibility-audit",
"description": "A systematic, post-publication examination of whether a study's published results can be obtained from its deposited data and code, typically performed by an independent analyst.",
"inDefinedTermSet": "https://casrai.org/dictionary/domain/reproducibility-and-computational-research/",
"url": "https://casrai.org/dictionary/term/reproducibility-audit",
"sameAs": [
"reproduction study",
"reanalysis audit"
],
"license": "https://creativecommons.org/licenses/by/4.0/"
}
