Examples
Worked examples
- Is an instance
A reproducibility reviewer at the American Journal of Political Science who re-executed all analysis scripts before publication and certified the result
Counter-examples
Looks similar, but isn't
- Not an instance
A regular peer reviewer who happens to comment on the code is not a reproducibility reviewer in the formal role sense
Editorial commentary
An emerging role at journals operating reproducibility checks (e.g., AJPS, Biostatistics, JASA). The reproducibility reviewer’s findings are typically reported in a verification statement and recognised through ORCID review credit. They may be acknowledged individually or as a journal-employed reviewer team.
References
- TOP Guidelines (Nosek et al. 2015 Science)
- Stodden et al. 2018 ‘An Empirical Analysis of Journal Policy Effectiveness for Computational Reproducibility’ PNAS
Also known as
Code reviewer (publication) · Computational reproducibility reviewer
Machine-readable encodings
Use in your systems
xml
<role vocab="credit"
vocab-identifier="https://casrai.org/dictionary/"
vocab-term="Reproducibility reviewer"
vocab-term-identifier="https://casrai.org/dictionary/term/reproducibility-reviewer" />json
{
"@context": "https://schema.org",
"@type": "DefinedTerm",
"name": "Reproducibility reviewer",
"identifier": "https://casrai.org/dictionary/term/reproducibility-reviewer",
"description": "A reviewer whose specific role is to verify that the computational, analytic, or experimental procedures reported in a manuscript can be re-executed by another party using the provided code, data, and instructions, distinct from a content peer reviewer.",
"inDefinedTermSet": "https://casrai.org/dictionary/domain/credit-extensions-and-adjacent-contribution-vocabularies/",
"url": "https://casrai.org/dictionary/term/reproducibility-reviewer",
"sameAs": [
"Code reviewer (publication)",
"Computational reproducibility reviewer"
],
"license": "https://creativecommons.org/licenses/by/4.0/"
}
