Examples
Worked examples
- Is an instance
A regression result that holds whether outliers are winsorised, trimmed, or kept.
- Is an instance
A model conclusion that survives swapping the random-effects structure.
Counter-examples
Looks similar, but isn't
- Not an instance
A new experiment on new data (replicability).
- Not an instance
Running the same code twice (reproducibility).
Editorial commentary
Robustness checks alter one degree of freedom at a time (e.g., re-running with covariate X removed, using a different estimator, excluding outliers) to test whether the headline conclusion is artefactual. The multiverse-analysis literature generalises this by running all plausible analytic paths simultaneously rather than only one.
References
- Steegen, Tuerlinckx, Gelman, Vanpaemel, 'Increasing transparency through a multiverse analysis' (Perspectives on Psychological Science, 2016).
Also known as
analytic robustness · specification robustness
Machine-readable encodings
Use in your systems
xml
<role vocab="credit"
vocab-identifier="https://casrai.org/dictionary/"
vocab-term="Robustness"
vocab-term-identifier="https://casrai.org/dictionary/term/robustness" />json
{
"@context": "https://schema.org",
"@type": "DefinedTerm",
"name": "Robustness",
"identifier": "https://casrai.org/dictionary/term/robustness",
"description": "The stability of a study's conclusions under reasonable variations in analytical choices, model specification, sample inclusion, or measurement, on the same data.",
"inDefinedTermSet": "https://casrai.org/dictionary/domain/reproducibility-and-computational-research/",
"url": "https://casrai.org/dictionary/term/robustness",
"sameAs": [
"analytic robustness",
"specification robustness"
],
"license": "https://creativecommons.org/licenses/by/4.0/"
}
