Research Assessment & Bibliometrics
This cluster covers the quantitative and evaluative tools used to assess research output: citation counts, journal-level indices, author-level metrics, and the indexing databases that compute them. It also covers the growing reform movement pushing back against over-reliance on these metrics, particularly journal-level proxies like impact factor being applied to individual articles or researchers. Two reform frameworks are central here. The San Francisco Declaration on Research Assessment (DORA) is a widely signed commitment by institutions, funders, and publishers to avoid using journal-based metrics as a proxy for the quality of individual research articles or researchers, particularly in hiring, tenure, and funding decisions. The Coalition for Advancing Research Assessment (CoARA) is a more recent, broader coalition of research organizations working toward reformed, multidimensional assessment practices across Europe and beyond. On the indexing side, this space covers the major bibliographic databases — Scopus, Web of Science, and the open, algorithmically-built OpenAlex — which differ in coverage, methodology, and the metrics they surface. For a research administrator, this cluster addresses practical questions: how a given metric is calculated, what its known limitations are, and how institutional or funder assessment criteria have shifted (or are shifting) in response to DORA and CoARA commitments. This is relevant to tenure and promotion processes, funder reporting requirements, and institutional strategy around research evaluation. It connects to open-access content, since OA status increasingly factors into some assessment and indexing criteria, and to publishing-fundamentals content for readers who need grounding in what a citation or index actually measures before engaging with reform debates.
Guides
CoARA National Chapter Ireland: Coordinators, Signatories, and DORA Advocacy
Ireland’s CoARA National Chapter is coordinated by UCC and Trinity College Dublin, not by a funding agency — and Research Ireland’s DORA-related role traces back to the 2024 SFI/IRC merger, not a chapter takeover. Coordinators, signatories, and objectives explained.
Snowball Metrics: How Research Universities Standardize Cross-Institution Benchmarking
Snowball Metrics is a free, community-owned methodology — not a product or ranking — that lets research universities calculate metrics like collaboration rate and research income the same way, so cross-institution benchmarking is actually comparable.
AGORRA: RoRI’s Global Observatory Comparing National Research-Assessment Systems
AGORRA is RoRI’s ongoing observatory comparing national research-assessment systems worldwide, complementing DORA and CoARA rather than duplicating them.
FOLEC-CLACSO: Latin America’s Regional Forum for Research-Assessment Reform
FOLEC-CLACSO is CLACSO’s regional forum for research-assessment reform in Latin America — distinct from CoARA’s national chapters, with a direct governance link to DORA and a social-relevance-driven framing rooted in the region’s diamond open-access tradition.
CoARA National Chapter Spain: From Launch to the 3rd National Chapters Exchange Forum
CoARA National Chapter Spain launched in February 2024 with 84 institutions under joint CRUE/CSIC/ISCIII/ANECA coordination, and hosted CoARA’s 3rd National Chapters Exchange Forum in Madrid in March 2026. Here is what the chapter does and how it fits CoARA’s structure.
CoARA National Chapter Italy: The 2025-27 Programme and 59-Institution Coalition
CoARA National Chapter Italy now spans 59 institutions and, in February 2026, launched a 2025-27 work programme co-chaired by the University of Milan and INGV. Here is what the chapter does, who belongs, and what the programme commits members to.
CoARA National Chapter France: Progress and Priorities
How CoARA’s France national chapter formed, who leads it, which universities and agencies (including HCERES) are involved, and its 2026 activity.
CoARA National Chapter United Kingdom: Leaders, Signatories, and Recent Activity
The UK CoARA National Chapter, co-led by Strathclyde, Swansea, Loughborough, and Bristol since February 2024, coordinates a growing list of UK signatories and Cascade Funding activity around responsible research assessment.
CoARA Implementation in Norway: The Research Council of Norway and NOR-CAM
How the Research Council of Norway’s DORA/CoARA commitments and Universities Norway’s NOR-CAM framework fit together — what’s verified, what’s still rolling out, and how Norway’s sector-led model differs from a funder-led approach.
DFG and CoARA: Germany’s Position on Responsible Research Metrics
DFG is a CoARA signatory and leads CoARA’s National Chapter for Germany. This guide sets out DFG’s specific commitments on reducing reliance on the JIF and h-index, its position paper on academic publishing and research assessment, and what is and isn’t yet verifiable about concrete change at German institutions.
HELIOS Open: The US Coalition Tying Open Scholarship to Tenure Reform
HELIOS Open is a US-only coalition of colleges and universities committing senior leadership to reforming tenure and promotion criteria around open-scholarship practice, distinct from the global DORA and CoARA frameworks.
Overton: The Policy-Document Citation Database for Evidencing Research Impact
Overton indexes policy documents worldwide and tracks where they cite academic research. This guide covers what it tracks, how it differs from traditional citation databases, and how it’s used for REF impact case studies and funder reporting.
China’s “Five Onlys” Reform and the End of the CAS Journal Classification Table
China’s “breaking the five onlys” reform (2018-2020) and the CAS National Science Library’s March 2026 decision to discontinue its Journal Classification Table, explained together: what each policy actually changed, why a widely used journal-ranking tool outlasted a national ban on journal-centric evaluation by six years, and what it means for institutions collaborating with Chinese researchers.
Netherlands Recognition & Rewards Programme Explained
How the Netherlands’ national Recognition & Rewards programme is reshaping academic career evaluation beyond journal metrics.
HCERES: France’s National Research and Higher Education Evaluation Authority
HCERES is France’s independent authority for evaluating universities, public research organizations, research units, and degree programs. Its legal basis, what it evaluates, and why it matters for international partners.
DORA and CoARA in Practice: How Institutions Are Actually Rewriting P&T Criteria
DORA and CoARA membership is a commitment, not a rewritten rubric. This guide covers documented institutional examples — Utrecht, Ghent, Imperial College London, and the US MA3 Challenge cohort — of promotion and tenure criteria actually being rewritten, plus how uneven that implementation still is.
REF Rankings by Subject and Institution: How REF 2021 Results Are Actually Structured
REF doesn’t publish a ranking — it publishes quality profiles by Unit of Assessment. Here’s how those profiles are structured, and how GPA, research power, and market-share methods turn them into the league tables you actually see.
REF 2029 Output Portability Rules: Decoupling and the Substantive Link
REF 2029 decouples outputs from individual staff: institutions submit outputs, not staff-output pairs, and each output needs a confirmed ‘substantive link’ to the submitting institution. Here’s what’s confirmed about the portability rules, the employment-relationship test, and the long-form/extended-process exception.
REF 2029 Output Eligibility Period: What’s Confirmed So Far
The REF 2029 output eligibility period runs 1 January 2021 to 31 December 2028 per published guidance — what’s confirmed, what’s still provisional, and how it compares to REF 2021.
Why and How Scopus Delists Journals: The Discontinuation Process Explained
How Elsevier decides to discontinue a journal from Scopus, what triggers a CSAB re-evaluation, what happens to already-indexed articles, and how to check a title’s current status.
Getting a Journal Indexed in Scopus: The CSAB Process
How Scopus evaluates journals for indexing: the CSAB technical prerequisites and five evaluation categories, the application process, re-evaluation and discontinuation, and how it differs from Web of Science inclusion.
Web of Science Master Journal List: What It Is and How to Use It
How Clarivate’s free Master Journal List works: searching by title or ISSN, what a journal profile page shows, and how it differs from being indexed in Web of Science generally.
Does ScienceDirect Have an Impact Factor?
ScienceDirect is Elsevier’s article-hosting platform, not a journal, so it has no Impact Factor of its own — only the individual journals it hosts do. Here’s the distinction and how to look up the real number.
What Is Research Excellence? How Institutions and Funders Define and Assess It
How REF, ERA, and other national exercises define research excellence, plus why DORA, CoARA, and the Leiden Manifesto push back on metric-only versions of it.
Research Evaluation Framework: What It Is and How the Major Models Compare
A research evaluation framework is any structured system for assessing research quality or impact — spanning national funding exercises like the UK’s REF and reform commitments like DORA and CoARA.
DORA and CoARA: Comparing Research Assessment Reform Commitments
DORA (2012) and CoARA (2022) both push back on journal-metric misuse in research assessment, but differ in origin, scope, and mechanism — and how CASRAI’s contribution-based CRediT approach complements both.
Journal Impact Factor and Quartile Rankings: What They Are and How to Find Them
What the Journal Impact Factor measures and how it is calculated, its documented limitations per DORA and CoARA, and how Q1-Q4 quartile rankings from JCR, Scopus, and SCImago are calculated and used.
How to Look Up a Journal’s Impact Factor (and What It Actually Tells You)
How to find a journal’s current, Clarivate-sourced Impact Factor via JCR and the Web of Science Master Journal List, plus what DORA and CoARA say it can and can’t be used for.
