Examples
Worked examples
- Is an instance
A 4,096-cell multiverse over 12 binary processing decisions in a developmental cohort study.
- Is an instance
A multiverse showing the headline effect is positive in 92% of specifications and significant in 71%.
Counter-examples
Looks similar, but isn't
- Not an instance
A single robustness check.
- Not an instance
A meta-analysis across multiple studies (different concept).
Editorial commentary
Multiverse analyses (Steegen et al., 2016) generalise specification curves and robustness checks by varying multiple choices simultaneously. Outputs include not only the curve of estimates but also tabulations of the proportion of specifications yielding effects in each direction or crossing conventional significance thresholds.
References
- Steegen, Tuerlinckx, Gelman, Vanpaemel, 'Increasing transparency through a multiverse analysis' (Perspectives on Psychological Science, 2016).
Also known as
multiverse
Machine-readable encodings
Use in your systems
xml
<role vocab="credit"
vocab-identifier="https://casrai.org/dictionary/"
vocab-term="Multiverse analysis"
vocab-term-identifier="https://casrai.org/dictionary/term/multiverse-analysis" />json
{
"@context": "https://schema.org",
"@type": "DefinedTerm",
"name": "Multiverse analysis",
"identifier": "https://casrai.org/dictionary/term/multiverse-analysis",
"description": "An analytical approach in which all reasonable combinations of data-processing and modelling choices are executed, producing a distribution of results that displays the impact of researcher degrees of freedom on the conclusion.",
"inDefinedTermSet": "https://casrai.org/dictionary/domain/reproducibility-and-computational-research/",
"url": "https://casrai.org/dictionary/term/multiverse-analysis",
"sameAs": [
"multiverse"
],
"license": "https://creativecommons.org/licenses/by/4.0/"
}
