The Leiden Manifesto's tenth principle ('scrutinise indicators regularly and update them') and the Metric Tide's reflexivity principle both call for re-evaluation cycles. In practice this means an assessment regime documents how it will audit its own performance: do candidates and reviewers experience the criteria as advertised? Are there disparate impacts by gender, geography, discipline or career stage? Are indicators being gamed? CoARA membership requires periodic progress reports for the same reason. Re-evaluation cycles are concretely operationalised by annual responsible-metrics statements, biennial assessment-process reviews, and major redesigns every 5-7 years.
References
- Hicks et al. 2015. CoARA progress-reporting framework.