Examples
Worked examples
- Is an instance
Two analysts independently concluding 'the effect is positive and meaningful' from the same dataset.
- Is an instance
A field-wide consensus that emerges across multiple model specifications.
Counter-examples
Looks similar, but isn't
- Not an instance
Bit-identical numerical re-runs.
- Not an instance
Methods reproducibility (reporting completeness).
Editorial commentary
Inferential reproducibility is the highest bar of the four reproducibility types proposed by Goodman et al. (2016). Many-analysts studies (e.g., Silberzahn et al. 2018) demonstrate that even with identical data and the same question, qualified analysts may reach different conclusions, undermining naive assumptions of inferential reproducibility.
References
- Goodman, Fanelli, Ioannidis (Science Translational Medicine, 2016); Silberzahn et al., 'Many analysts, one data set' (Advances in Methods and Practices in Psychological Science, 2018).
Also known as
conclusion reproducibility
Machine-readable encodings
Use in your systems
xml
<role vocab="credit"
vocab-identifier="https://casrai.org/dictionary/"
vocab-term="Inferential reproducibility"
vocab-term-identifier="https://casrai.org/dictionary/term/inferential-reproducibility" />json
{
"@context": "https://schema.org",
"@type": "DefinedTerm",
"name": "Inferential reproducibility",
"identifier": "https://casrai.org/dictionary/term/inferential-reproducibility",
"description": "The degree to which independent analysts reach the same qualitative scientific conclusion from the same data, even where their analytical choices differ.",
"inDefinedTermSet": "https://casrai.org/dictionary/domain/reproducibility-and-computational-research/",
"url": "https://casrai.org/dictionary/term/inferential-reproducibility",
"sameAs": [
"conclusion reproducibility"
],
"license": "https://creativecommons.org/licenses/by/4.0/"
}
