A reviewer whose specific role is to verify that the computational, analytic, or experimental procedures reported in a manuscript can be re-executed by another party using the provided code, data, and instructions, distinct from a content peer reviewer.

ByCASRAI Editorial Board

· Last updated 21 May 2026

Examples

Worked examples

Is an instance
A reproducibility reviewer at the American Journal of Political Science who re-executed all analysis scripts before publication and certified the result

Counter-examples

Looks similar, but isn't

Not an instance
A regular peer reviewer who happens to comment on the code is not a reproducibility reviewer in the formal role sense

Editorial commentary

An emerging role at journals operating reproducibility checks (e.g., AJPS, Biostatistics, JASA). The reproducibility reviewer’s findings are typically reported in a verification statement and recognised through ORCID review credit. They may be acknowledged individually or as a journal-employed reviewer team.

References

TOP Guidelines (Nosek et al. 2015 Science)
Stodden et al. 2018 ‘An Empirical Analysis of Journal Policy Effectiveness for Computational Reproducibility’ PNAS

Also known as

Code reviewer (publication) · Computational reproducibility reviewer

Machine-readable encodings

Use in your systems

JATS XML <role> element

xml

<role vocab="credit"
      vocab-identifier="https://casrai.org/dictionary/"
      vocab-term="Reproducibility reviewer"
      vocab-term-identifier="https://casrai.org/dictionary/term/reproducibility-reviewer" />

Schema.org DefinedTerm (JSON-LD)

json

{
  "@context": "https://schema.org",
  "@type": "DefinedTerm",
  "@id": "https://casrai.org/dictionary/term/reproducibility-reviewer",
  "name": "Reproducibility reviewer",
  "identifier": "https://casrai.org/dictionary/term/reproducibility-reviewer",
  "description": "A reviewer whose specific role is to verify that the computational, analytic, or experimental procedures reported in a manuscript can be re-executed by another party using the provided code, data, and instructions, distinct from a content peer reviewer.",
  "inDefinedTermSet": "https://casrai.org/dictionary/domain/credit-extensions#set",
  "url": "https://casrai.org/dictionary/term/reproducibility-reviewer",
  "sameAs": [
    "Code reviewer (publication)",
    "Computational reproducibility reviewer"
  ],
  "license": "https://creativecommons.org/licenses/by/4.0/",
  "publisher": {
    "@id": "https://casrai.org/#organization"
  },
  "dateModified": "2026-05-21T01:59:50",
  "inLanguage": "en"
}

Referenced across the research world

View CASRAI adoption →