Examples
Worked examples
- Is an instance
Many Labs 2 testing 28 effects across 125 samples and 36 countries.
- Is an instance
ManyBabies coordinated infant-research replications across dozens of labs.
Counter-examples
Looks similar, but isn't
- Not an instance
A single direct replication by one team.
- Not an instance
A many-analysts study (different design).
Editorial commentary
The Many Labs projects, the Reproducibility Project: Psychology, and the Reproducibility Project: Cancer Biology are the best-known examples. Crowdsourced replication provides estimates of replicability that are robust to single-lab idiosyncrasies, and creates open datasets useful for downstream meta-research.
References
- Klein et al., 'Many Labs 2' (Advances in Methods and Practices in Psychological Science, 2018); Open Science Collaboration (Science, 2015).
Also known as
Many Labs (concept) · multi-site replication
Machine-readable encodings
Use in your systems
xml
<role vocab="credit"
vocab-identifier="https://casrai.org/dictionary/"
vocab-term="Crowdsourced replication"
vocab-term-identifier="https://casrai.org/dictionary/term/crowdsourced-replication" />json
{
"@context": "https://schema.org",
"@type": "DefinedTerm",
"name": "Crowdsourced replication",
"identifier": "https://casrai.org/dictionary/term/crowdsourced-replication",
"description": "A coordinated effort in which many independent laboratories or teams attempt to replicate the same set of studies under pre-specified protocols, in order to estimate field-wide replicability.",
"inDefinedTermSet": "https://casrai.org/dictionary/domain/reproducibility-and-computational-research/",
"url": "https://casrai.org/dictionary/term/crowdsourced-replication",
"sameAs": [
"Many Labs (concept)",
"multi-site replication"
],
"license": "https://creativecommons.org/licenses/by/4.0/"
}
