Examples
Worked examples
- Is an instance
An institution publishes an annual responsible-metrics statement and revises criteria every three years.
- Is an instance
A funder audits assessment outcomes for demographic disparities each year and reports findings publicly.
Counter-examples
Looks similar, but isn't
- Not an instance
Using the same hiring rubric for a decade without review despite changes in field norms.
- Not an instance
Treating reviewer demographics, gameability and disparate impact as unmeasurable.
Editorial commentary
The Leiden Manifesto's tenth principle ('scrutinise indicators regularly and update them') and the Metric Tide's reflexivity principle both call for re-evaluation cycles. In practice this means an assessment regime documents how it will audit its own performance: do candidates and reviewers experience the criteria as advertised? Are there disparate impacts by gender, geography, discipline or career stage? Are indicators being gamed? CoARA membership requires periodic progress reports for the same reason. Re-evaluation cycles are concretely operationalised by annual responsible-metrics statements, biennial assessment-process reviews, and major redesigns every 5-7 years.
References
- Hicks et al. 2015. CoARA progress-reporting framework.
Also known as
Assessment review cycle · Indicator audit cycle
Machine-readable encodings
Use in your systems
<role vocab="credit"
vocab-identifier="https://casrai.org/dictionary/"
vocab-term="Re-evaluation cycle"
vocab-term-identifier="https://casrai.org/dictionary/term/re-evaluation-cycle" />{
"@context": "https://schema.org",
"@type": "DefinedTerm",
"name": "Re-evaluation cycle",
"identifier": "https://casrai.org/dictionary/term/re-evaluation-cycle",
"description": "A scheduled, periodic review by a research-assessment system of its own indicators, criteria and processes to identify drift, unintended consequences and opportunities for reform.",
"inDefinedTermSet": "https://casrai.org/dictionary/domain/responsible-research-assessment/",
"url": "https://casrai.org/dictionary/term/re-evaluation-cycle",
"sameAs": [
"Assessment review cycle",
"Indicator audit cycle"
],
"license": "https://creativecommons.org/licenses/by/4.0/"
}
