Skip to main content
v2026.11,610 entries · CC-BY 4.0
Dictionary termTrack CStablev2026.2

Crowdsourced replication

A coordinated effort in which many independent laboratories or teams attempt to replicate the same set of studies under pre-specified protocols, in order to estimate field-wide replicability.

ByCASRAI Editorial Board
· Last updated 21 May 2026

Ask about Crowdsourced replication

Answers are drawn from this dictionary entry and the rest of the CASRAI corpus, with a link to every source.

Answers are AI-generated from CASRAI’s own published pages and can be wrong, so check the linked sources before relying on one; your question is logged without personal data — never sold, never used to train a third-party model — to show us what CASRAI is missing, so please do not type personal or confidential details. How we use this

Examples

Worked examples

  • Is an instance

    Many Labs 2 testing 28 effects across 125 samples and 36 countries.

  • Is an instance

    ManyBabies coordinated infant-research replications across dozens of labs.

Counter-examples

Looks similar, but isn't

  • Not an instance

    A single direct replication by one team.

  • Not an instance

    A many-analysts study (different design).

Editorial commentary

The Many Labs projects, the Reproducibility Project: Psychology, and the Reproducibility Project: Cancer Biology are the best-known examples. Crowdsourced replication provides estimates of replicability that are robust to single-lab idiosyncrasies, and creates open datasets useful for downstream meta-research.

References

  • Klein et al., 'Many Labs 2' (Advances in Methods and Practices in Psychological Science, 2018); Open Science Collaboration (Science, 2015).

Also known as

Many Labs (concept) · multi-site replication

Machine-readable encodings

Use in your systems

JATS XML <role> element
xml
<role vocab="credit"
      vocab-identifier="https://casrai.org/dictionary/"
      vocab-term="Crowdsourced replication"
      vocab-term-identifier="https://casrai.org/dictionary/term/crowdsourced-replication" />
Schema.org DefinedTerm (JSON-LD)
json
{
  "@context": "https://schema.org",
  "@type": "DefinedTerm",
  "@id": "https://casrai.org/dictionary/term/crowdsourced-replication",
  "name": "Crowdsourced replication",
  "identifier": "https://casrai.org/dictionary/term/crowdsourced-replication",
  "description": "A coordinated effort in which many independent laboratories or teams attempt to replicate the same set of studies under pre-specified protocols, in order to estimate field-wide replicability.",
  "inDefinedTermSet": "https://casrai.org/dictionary/domain/reproducibility#set",
  "url": "https://casrai.org/dictionary/term/crowdsourced-replication",
  "sameAs": [
    "Many Labs (concept)",
    "multi-site replication"
  ],
  "license": "https://creativecommons.org/licenses/by/4.0/",
  "publisher": {
    "@id": "https://casrai.org/#organization"
  },
  "dateModified": "2026-05-21T02:22:50",
  "inLanguage": "en"
}

Referenced across the research world

University of Cambridge logoColumbia University logoCrossref logoUniversity of Edinburgh logoHarvard University logoUniversity of Oxford logoPrinceton University logoStanford School of Medicine logoUniversity College London logoORCID logoUniversity of Cambridge logoColumbia University logoCrossref logoUniversity of Edinburgh logoHarvard University logoUniversity of Oxford logoPrinceton University logoStanford School of Medicine logoUniversity College London logoORCID logo
  • University of Cambridge logo
  • Columbia University logo
  • Crossref logo
  • University of Edinburgh logo
  • Harvard University logo
  • University of Oxford logo
  • Princeton University logo
  • Stanford School of Medicine logo
  • University College London logo
  • ORCID logo

View CASRAI adoption →