CASRAI Dictionary

Author: MCP Service

  • Types of Material Transfer Agreement Guide: One-Way, Two-Way and Commercial-Use MTAs

    Types of material transfer agreement fall into two overlapping categories: direction of transfer (one-way versus two-way) and nature of the parties (academic/non-profit versus commercial-use). Choosing the wrong category adds weeks of unnecessary negotiation to a simple exchange, or leaves an institution exposed on intellectual property and liability in a complex one. A material transfer agreement (MTA) is a contract that governs the transfer of tangible research materials — cell lines, plasmids, reagents, antibodies, animal models, or genetic constructs — between a provider and a recipient, setting terms for permitted use, publication, and downstream rights.

    What is a material transfer agreement, and why does type matter?

    A material transfer agreement is the legal instrument accompanying the physical movement of a research material between organisations. It records who owns the original material, what the recipient may do with it, who owns derivatives the recipient creates, and what happens if the material leads to a publication or invention.

    Institutions do not use one template for every transfer. The right MTA type depends on two independent variables: direction of the exchange, and the nature of the parties — non-profit or commercial. Mismatching the template to either variable is a common cause of avoidable negotiation delay.

    One-way vs two-way MTAs: what is the difference?

    A one-way MTA covers a single direction of transfer: one provider sends material to one recipient, who accepts the provider’s terms. Most institutional MTAs are one-way and are further split into two sub-types depending on which side of the transaction the institution sits on.

    • Incoming MTA — the institution is the recipient. The priority is understanding and accepting the provider’s restrictions: permitted research use, any prohibition on commercial use, and publication or embargo terms.
    • Outgoing MTA — the institution is the provider. The priority shifts to protecting the institution’s own intellectual property, limiting liability for the material’s performance, and controlling further distribution by the recipient.

    A two-way (or reciprocal) MTA is used when both parties send materials to each other, typically in an active collaboration where each lab holds a resource the other needs. Rather than negotiate two separate one-way agreements, the parties combine both transfers into a single reciprocal agreement with symmetric obligations. This is administratively efficient but requires both sides to specify their respective materials and restrictions with equal precision — asymmetric two-way MTAs are a frequent source of later disputes over derivative rights.

    MTA type Direction Typical parties Primary administrative focus
    Incoming (one-way) Provider → institution Academic-to-academic or vendor-to-academic Compliance with provider’s use and publication restrictions
    Outgoing (one-way) Institution → external recipient Academic-to-academic or academic-to-industry IP retention, liability limitation, distribution control
    Two-way / reciprocal Bidirectional Collaborating academic labs Symmetric terms for both transferred materials
    Academic/non-profit Either direction Non-profit-to-non-profit Non-commercial research use only; minimal negotiation
    Commercial-use Either direction At least one for-profit party IP ownership, licensing options, publication delay, indemnification

    Academic/non-profit vs commercial-use MTAs: how do the terms differ?

    The second axis of classification is the nature of the parties, and it changes negotiation complexity more than direction does. A biological material transfer agreement between two non-profit universities is usually a light-touch document; the same transfer involving a commercial partner routinely takes months longer to close.

    Academic and non-profit MTAs exist to facilitate open scientific exchange. The US National Institutes of Health (NIH) has stated that unique research resources arising from NIH-funded work should be shared on terms no more restrictive than its own model agreements, because repeated case-by-case negotiation between non-profits delays the point at which a research tool reaches the laboratory bench. These agreements typically restrict use to non-commercial research, require no royalty, and rarely need individual negotiation once a standard template is adopted.

    Commercial-use MTAs — where a for-profit company is provider, recipient, or both — carry additional, negotiated terms that a non-profit template does not anticipate:

    • Intellectual property rights over inventions made using the transferred material, including whether the provider retains an option to license.
    • Publication rights, including any pre-publication review period the commercial party can invoke to protect confidential information.
    • Scope of permitted use, distinguishing internal research from development toward a commercial product, which may trigger the need for a separate licence agreement.
    • Indemnification and liability allocation, which non-profit-to-non-profit templates typically waive or cap at a nominal level.

    A material transfer agreement policy should specify, in advance, which of these terms are non-negotiable defaults and which require case-by-case legal review — allowing routine academic MTAs to clear in days, reserving negotiation capacity for the commercial-use cases where it is genuinely needed.

    Which standard templates exist, and how do you choose the right one?

    Four template families cover the great majority of transfers, and matching a transfer to the correct family is the fastest route to a signed agreement.

    • NIH Simple Letter Agreement (SLA), published in 1995 by the NIH, is a one-page model for low-risk, non-commercial transfers of routine research materials between non-profit institutions.
    • Uniform Biological Material Transfer Agreement (UBMTA), also introduced in 1995, is the master agreement signed once by an institution; individual transfers under it use a short “Implementing Letter” rather than a fresh negotiation, and it is the standard route for a two-way material transfer agreement between two UBMTA-signatory non-profits.
    • AUTM Model MTAs extend the UBMTA framework to materials — and non-US institutions — outside the UBMTA’s original definition of biological material; a 2011 AUTM member survey found low adoption of standard templates was itself a major cause of unnecessary delay, which the toolkit’s decision tree was built to address.
    • FAO Standard Material Transfer Agreement (SMTA), adopted by the Governing Body of the International Treaty on Plant Genetic Resources for Food and Agriculture in 2006, is a distinct global instrument governing plant genetic resources held in the Treaty’s Multilateral System, with mandatory benefit-sharing terms that have no equivalent in the UBMTA or NIH templates.

    To choose: start by identifying direction (one-way or two-way) and party type (non-profit or commercial). If both parties are non-profit and the material is biological, default to the UBMTA or SLA. If a commercial party is involved, route the transfer to legal review rather than a standard template. If the material is a plant genetic resource in the Multilateral System, the FAO SMTA applies regardless of the parties’ institutional type — a distinction general MTA guidance frequently omits.

    Frequently asked questions

    What is a material transfer agreement?

    A material transfer agreement is a contract governing the transfer of tangible research materials — such as cell lines, plasmids, reagents, or animal models — between a provider and a recipient. It sets terms for permitted use, ownership of derivatives, publication rights, and liability, and is negotiated before the physical material is shipped.

    What is the difference between an MTA and an NDA?

    An NDA (non-disclosure agreement) protects confidential information exchanged between parties, while an MTA governs the physical transfer and permitted use of a tangible material. The two are often signed together — an NDA may protect data about the material, while the MTA governs the material itself — but neither substitutes for the other.

    What is the standard material transfer agreement?

    The Standard Material Transfer Agreement (SMTA) is the FAO instrument used specifically for plant genetic resources held under the International Treaty on Plant Genetic Resources for Food and Agriculture’s Multilateral System. It is distinct from the UBMTA used for general biological materials and includes mandatory benefit-sharing obligations tied to the Treaty.

    Implications and outlook for research administrators

    Institutions that map every incoming request against this taxonomy before drafting — direction first, party type second, then template — process the majority of routine biological material transfer agreement requests without individual legal review. That triage is what standard templates like the UBMTA and NIH SLA were designed to enable, and what a written material transfer agreement policy should formalise as institutional default practice.

    The remaining minority — commercial-use transfers, cross-border plant genetic material, and asymmetric two-way exchanges — is where administrative time should concentrate, since these are the categories where the wrong template creates the greatest downstream IP and compliance risk. As collaborations increasingly span academic, industry, and international-treaty jurisdictions at once, classifying a transfer correctly at intake, rather than after a dispute arises, remains the most effective control a research administration office can apply.

  • Cost Sharing in Grants: Mandatory vs Voluntary

    Cost sharing on a grant is the portion of a project’s true cost that the sponsor does not pay, covered instead by the recipient institution, a third party, or in-kind contributions. It can be mandatory (a condition of the award, set out in the funding announcement) or voluntary (offered by the applicant and not required). A growing number of funders — most notably the US National Science Foundation — have moved away from requiring or even rewarding voluntary cost sharing, on the grounds that it disadvantages under-resourced institutions and adds compliance burden without improving research quality.

    What is cost sharing in a grant budget?

    Cost sharing (also called matching) is the share of a sponsored project’s total cost that is not reimbursed by the funding agency. It is contributed instead by the recipient institution, a subrecipient, or a third-party collaborator, either as cash or as an in-kind resource such as donated staff time, waived facilities-and-administration (F&A) costs, equipment, or space.

    Under the US federal Uniform Guidance (2 CFR Part 200, §200.306), cost sharing and matching are defined as the portion of project costs “not borne by the Federal Government.” Any contribution counted this way must be verifiable from the recipient’s own records, not double-counted against another federally funded project, and necessary and reasonable for the project. This is the baseline definition US sponsored programs offices apply when reviewing a proposal’s grant budget justification.

    Mandatory vs voluntary cost sharing: what’s the difference?

    The distinction between mandatory and voluntary cost sharing determines whether a commitment is legally enforceable. Mandatory cost sharing is imposed by the sponsor and stated explicitly in the funding opportunity; without it, the proposal is ineligible. Voluntary cost sharing is offered by the applicant even though the sponsor did not require it — and once quantified in a funded federal proposal, it becomes just as binding and auditable as a mandatory commitment.

    Type Who requires it Reporting obligation once awarded
    Mandatory cost sharing Sponsor, stated in the solicitation Documented, tracked and reported to the sponsor for the life of the award
    Voluntary committed cost sharing Applicant, quantified in the proposal budget or narrative Treated as binding and auditable once the award is made, on federal awards
    Voluntary uncommitted cost sharing Applicant, contributed after award but never quantified in the proposal Not tracked or reported to the sponsor

    The trap is the second row. A PI who writes “the PI will devote 20% effort at no cost to the sponsor” creates a quantified, reportable commitment — even though the sponsor never asked for one. This is why sponsored programs offices train investigators to use non-quantified language (“will provide expert consultation, as needed”) whenever cost sharing is not actually required.

    Why are funders moving away from mandatory cost sharing?

    The clearest example is the National Science Foundation. Following its own Cost Sharing Task Force review, NSF’s Proposal & Award Policies and Procedures Guide (PAPPG) states that cost sharing is not required except where a specific program solicitation invokes a statutory requirement, and that reviewers may not factor voluntary committed cost sharing into merit review. NSF’s rationale was that cost sharing had become a competitive filter favouring wealthier institutions rather than an indicator of project quality.

    Three arguments recur across funder policy statements and research-administration literature on this reform:

    • Equity between institutions. A fixed percentage match is far harder for a community college or small non-profit to absorb than for a well-endowed research university — skewing award patterns by wealth rather than merit.
    • Administrative burden. Cost sharing must be certified through effort reporting and reconciled at closeout; auditors treat under-delivered cost share as a disallowed cost, risking clawback.
    • Review integrity. A visible voluntary contribution can bias scoring toward applicants who over-promise resources they may struggle to deliver.

    Cost sharing has not disappeared. It remains common — and often mandatory — on infrastructure and construction grants, public-private partnership schemes, and Department of Justice (DOJ) Office of Justice Programs awards, where the required match varies by programme and is set out in each solicitation’s guide sheet.

    How do UK and EU funders structure cost sharing?

    US-centric discussions of cost sharing rarely mention that the UK and EU systems build an equivalent principle directly into their core funding formulas, rather than treating it as a discretionary add-on.

    UK Research and Innovation (UKRI) funds most Research Council grants at up to 80% of a project’s Full Economic Cost (fEC), calculated via the sector’s Transparent Approach to Costing (TRAC) methodology. The host university funds the remaining 20% itself — a structural, near-universal form of mandatory cost sharing built into the grant terms, not a clause institutions can negotiate away project by project.

    Under Horizon Europe, reimbursement rates differ by action type rather than a flat match: Research and Innovation Actions (RIA) are typically funded at 100% of eligible direct costs, while Innovation Actions (IA) are reimbursed at 100% for non-profit entities but only 70% for profit-making organisations — meaning commercial participants effectively cost-share 30% of their own costs as a condition of taking part.

    This is a genuinely different model from the US project-by-project mandatory/voluntary framework. A US-style “voluntary cost sharing is discouraged” mindset does not transfer cleanly to a UKRI fEC or Horizon Europe budget, where the shortfall is baked into the reimbursement rate itself, not offered or declined proposal by proposal.

    Common questions about cost sharing

    What is cost share on a grant?

    Cost share on a grant is the share of a sponsored project’s total cost that the funding agency does not pay, covered instead by the recipient institution, a subrecipient, or a third party. It can be cash (salary, direct funding) or in-kind (donated time, waived facilities-and-administration costs, equipment) and must be verifiable, allowable, and incurred within the project period.

    What are the three types of cost sharing?

    The three recognised categories are mandatory, voluntary committed, and voluntary uncommitted cost sharing. Mandatory is required by the sponsor as a condition of funding; voluntary committed is offered by the applicant and becomes binding once awarded; voluntary uncommitted is contributed after the award but never quantified in the proposal, so it carries no reporting obligation.

    What is a cost sharing requirement?

    A cost sharing requirement is a condition, stated explicitly in a funding announcement, that obliges applicants to contribute a defined percentage or dollar amount of project costs from non-sponsor sources. Requirements vary widely by programme — from a flat percentage match to a formula tied to Modified Total Direct Costs — and must be documented and reported to the sponsor if the proposal is funded.

    How does cost sharing work?

    Cost sharing works by allocating a defined portion of a project’s budget to the recipient rather than the sponsor, expressed either as a percentage of total cost or as a match ratio (for example, 1:1). Once quantified in a funded proposal’s grant budget justification, the commitment must be tracked through effort reporting or financial records and reconciled at the project’s grant closeout report.

    Implications for institutional budget commitments

    For sponsored programs offices, the decline of mandatory cost sharing at agencies like NSF does not reduce the compliance workload — it relocates it. Institutions must train investigators to recognise when descriptive language in a proposal narrative inadvertently creates a quantified, auditable commitment, distinct from genuinely required match on programmes (DOJ, construction grants, many state and foundation awards) where cost sharing is still mandatory and enforced at closeout.

    Under-delivered cost sharing is treated by auditors as a disallowed cost, triggering a proportional reduction in drawable funds regardless of whether the shortfall was mandatory or voluntary. A “decline all voluntary cost share” policy calibrated to NSF norms misfires against a UKRI fEC award, where the 20% institutional contribution is structural, not optional. A no-cost extension can buy time to complete an outstanding commitment, but it does not waive the obligation — the shortfall must still be resolved before the award can close.

    The direction of travel across US federal science funders is towards evaluating proposals on merit rather than an applicant’s ability to co-invest. Institutions that update proposal-review checklists and budget-justification templates accordingly — while keeping separate, funder-specific guidance for programmes where cost sharing remains mandatory or structural — will reduce both audit exposure and the administrative overhead cost sharing has historically imposed.

  • Office of Grants Management vs Program Offices

    The Office of Grants Management is the part of a federal department — at the Department of Health and Human Services (HHS), the Office of Grants (OG), under the Assistant Secretary for Financial Resources (ASFR) — that sets department-wide policy, issues the Notice of Award, and enforces financial and compliance rules across every award. Individual program offices, by contrast, judge scientific and programmatic merit within their own subject area. Grantee institutions deal with both, for different reasons, throughout the life of an award.

    In one sentence: the Office of Grants Management is the administrative and financial authority that governs how federal grant funds are awarded, monitored, and closed out, while program offices decide what gets funded and why. HHS is the largest federal grant-making agency in the United States, and the distinction between its central grants office and its dozens of program offices is one of the most consistently misunderstood parts of the federal award lifecycle for institutional research administrators.

    What Does the Office of Grants Oversee?

    The HHS Office of Grants formulates department-wide grants policy and oversees its implementation across every HHS operating division. It does not decide which research or service proposals get funded; it decides how the resulting awards are administered, financed, and audited.

    According to a December 2023 U.S. Government Accountability Office review (GAO-24-106008), the Office of Grants “provides department-wide leadership on grants” and serves several government-wide roles beyond HHS itself. In January 2021, the Office of Management and Budget designated HHS to house the government-wide Grants Quality Services Management Office (Grants QSMO), which supports other federal agencies in adopting shared, standardised grants-management systems.

    • Developing and issuing department-wide grants policy, including the HHS Grants Policy Statement (GPS), last revised October 2024
    • Applying the Uniform Administrative Requirements, Cost Principles, and Audit Requirements codified at 45 CFR Part 75
    • Issuing the official Notice of Award (NoA) that legally obligates federal funds
    • Overseeing financial reporting, audit resolution, and closeout across all HHS awards
    • Running the Grants QSMO Marketplace, launched September 2022, which offers other agencies shared grants-management and payment platforms

    The scale is substantial: GAO reports the federal government distributed approximately $1.2 trillion in grants in fiscal year 2022 — roughly 19 percent of total federal spending, and over $400 billion more than FY 2019. HHS accounts for the largest share of any single federal grant-making agency.

    How Does the Office of Grants Differ From Program Offices?

    The core distinction is “how” versus “what.” The Office of Grants governs the administrative, financial, and regulatory mechanics of an award — eligibility of costs, reporting deadlines, audit requirements, closeout. Program offices — the National Institutes of Health institutes, the Health Resources and Services Administration bureaus, the Administration for Children and Families divisions, and similar bodies — set programmatic priorities, write the Funding Opportunity Announcement’s scientific or service requirements, and judge whether a grantee is meeting technical objectives.

    Function Office of Grants (Grants Management) Program Office
    Primary question answered Is this cost allowable and compliant? Is this science/service meeting its goals?
    Issues Notice of Award Yes No
    Sets scientific/programmatic scope No Yes
    Reviews financial/progress reports Financial reports, audit findings Technical/programmatic progress reports
    Governs closeout mechanics Yes Provides final technical sign-off
    Typical grantee contact Grants Management Specialist Project Officer / Program Officer

    Grantee institutions need two working relationships per award: a technical relationship with the program office’s project officer, and an administrative relationship with the grants management specialist. Sending a budget modification to a project officer instead of the specialist is a routine, avoidable source of delay.

    Where Does OASH’s Own Grants Function Fit In?

    A frequent source of confusion is the phrase “OASH Office of Grants Management.” The Office of the Assistant Secretary for Health (OASH) operates its own grants and cooperative agreements function, published at health.gov/grants, covering programmes such as Title X family planning and adolescent health initiatives that OASH itself administers.

    This is not a separate, competing authority to the department-wide Office of Grants under ASFR. OASH’s grants activity operates within the HHS-wide policy framework — the same Grants Policy Statement and 45 CFR Part 75 requirements apply — but OASH runs its own competitions, issues its own Funding Opportunity Announcements, and assigns its own grants management staff for the awards it makes. A grantee dealing with OASH therefore interacts with an OASH-specific contact who still answers to department-wide policy. This layered structure — one policy authority, multiple operating-division grants functions beneath it — is largely absent from generic explainer pages, which describe either the federal picture or a single state office, not HHS’s two-tier structure.

    Every accredited research institution maintains an institutional counterpart to the federal grants office: the sponsored programs office (sometimes called Office of Research Administration or Grants and Contracts). Its function mirrors the Office of Grants Management’s role, but from the recipient side.

    The sponsored programs office is the institution’s authorised signatory for award acceptance, its central point for compliance with 45 CFR Part 75 and OMB Uniform Guidance (2 CFR Part 200), and its liaison to the HHS grants management specialist rather than the program office’s project officer. Bodies such as the National Council of University Research Administrators (NCURA) and INORMS document this division of labour consistently: principal investigators own the science; the sponsored programs office owns the compliance interface. For a broader view of this interface within institutional research administration practice, see CASRAI’s research administration resources.

    What Happens at Closeout and With Cost Sharing?

    Two compliance touchpoints sit squarely with the Office of Grants Management rather than the program office: closeout and cost sharing.

    A grant closeout report is the set of final documents — the Federal Financial Report, the final progress report, and any property disposition report — that a recipient must submit once the period of performance ends. Under the Uniform Guidance framework that 45 CFR Part 75 incorporates for HHS awards, these reports are due within a fixed post-performance window, after which unspent funds are deobligated and the award is formally closed by the grants management office, not the program office.

    Cost sharing (sometimes called matching) is the portion of total project cost that the recipient institution — not the federal award — commits to fund, whether required by statute or offered voluntarily in the proposal. The Office of Grants Management verifies documented cost-sharing commitments were actually met before an award can close; a shortfall found at closeout is a grants-management finding, even when the project was scientifically successful.

    Frequently Asked Questions

    What does a grants manager do?

    A grants manager at a federal Office of Grants administers the financial and compliance lifecycle of an award: reviewing budgets, issuing the Notice of Award, monitoring reporting compliance, and processing closeout. This role is distinct from a project officer, who judges technical or scientific performance.

    What is the grant management function?

    The grant management function is the administrative infrastructure — policy, systems, and staff — that a funding agency uses to award, monitor, and close federal financial assistance. At HHS this sits with the Office of Grants under ASFR, applying the Grants Policy Statement and 45 CFR Part 75 across every operating division.

    What are common mistakes in grant management?

    The most common mistakes are routing compliance questions to a project officer instead of the grants management specialist, missing the fixed closeout deadline, and failing to document cost-sharing commitments contemporaneously rather than reconstructing them at award end.

    What are grant management services?

    Grant management services cover pre-award risk assessment, Notice of Award issuance, ongoing compliance monitoring, and closeout processing. HHS centralises much of this through its Recipient Data Insights tool, which automates pre-award risk scoring department-wide.

    Implications and Outlook

    For institutions holding HHS awards, the practical takeaway is structural, not procedural: two distinct offices govern every award, and each has authority the other cannot override. A program office cannot waive a 45 CFR Part 75 cost-allowability rule, and the Office of Grants Management cannot override a program office’s technical judgement on scientific merit.

    HHS’s modernisation record shows this split hardening rather than dissolving. The ReInvent Grants Management initiative (2017–2020) and the September 2022 Grants QSMO Marketplace launch both centralised administrative infrastructure further, while leaving programmatic decisions with the operating divisions. Institutions that route compliance questions to their sponsored programs office, and technical questions to the program office, will keep seeing faster processing than those that conflate the two.

  • Dimensions Altmetrics, Scopus & Web of Science: A DORA-Aligned Comparison

    Dimensions altmetrics, Scopus CiteScore, and Web of Science’s Impact Factor answer different questions about the same paper: how much online attention it attracted, how its journal’s four-year citation average compares, and how its two-year citation count compares against a curated index. No single number from any one database satisfies the San Francisco Declaration on Research Assessment (DORA)’s call for multi-indicator, qualitative-plus-quantitative evaluation — which is why research offices increasingly triangulate across all three.

    A citation database is a structured index of scholarly publications and their citation links, used to measure research coverage, impact, and attention across disciplines. Dimensions, Scopus, and Web of Science each build that index differently, and the differences matter directly for institutions trying to run dimensions altmetrics-aware, DORA-compliant assessment rather than single-metric ranking.

    How does coverage differ across Dimensions, Scopus and Web of Science?

    Coverage breadth is the single biggest structural difference between the three databases, and it is measurable rather than a matter of opinion. A 2021 Scientometrics study by Singh, Singh, Karmakar, Leta and Mayr found that Dimensions indexes 82.22% more journals than Web of Science and 48.17% more journals than Scopus, largely because Dimensions ingests preprints, grants, patents, clinical trials, and policy documents alongside conventional journal articles.

    A separate large-scale comparison published in Quantitative Science Studies (Visser, van Eck and Waltman, 2021, MIT Press) benchmarked Scopus, Web of Science, Dimensions, Crossref and Microsoft Academic together and found that Dimensions and Crossref offer the broadest raw coverage, while Scopus and Web of Science retain more curated, higher-quality affiliation and subject metadata. Web of Science’s Core Collection remains the most selective of the three, with editorial evaluation criteria dating to Eugene Garfield’s 1960 Science Citation Index; Scopus, launched by Elsevier in 2004, applies a comparatively more inclusive Content Selection and Advisory Board process.

    The practical implication: a citation count pulled from only one database will systematically undercount or overcount depending on discipline, document type, and region. A 2020 comparison from the German Kompetenznetzwerk Bibliometrie (Stahlschmidt and Hinze) reached the same conclusion — the three sources are not interchangeable, and cross-checking is a foundational bibliometric hygiene step, not an optional extra.

    What metrics does each database produce?

    Each platform has developed its own headline indicator, and none of the three is a like-for-like substitute for the others.

    Database Owner Headline metric Citation window Altmetrics integration
    Dimensions Digital Science Citation counts + linked Altmetric Attention Score No fixed window; article-level Native — shares parent company with Altmetric
    Scopus Elsevier CiteScore; Field-Weighted Citation Impact (FWCI) via SciVal 4-year rolling window PlumX Metrics
    Web of Science Clarivate Journal Impact Factor (JCR) 2-year window (5-year variant available) Article-level usage counts; expanding via Research Intelligence tools

    CiteScore, introduced by Elsevier in 2016, divides all citations a journal receives in a given year by all documents (not only “citable items”) published in the preceding four years, and is published free of charge — a deliberate contrast with the subscription-gated Journal Impact Factor. Field-Weighted Citation Impact normalises a paper’s citations against the world average for its subject, publication year, and document type, where a score of 1.0 represents parity with the global average; this makes FWCI more field-comparable than a raw citation count. The Altmetric Attention Score, meanwhile, is not a citation metric at all — it is a weighted count of online attention (news coverage, policy documents, X/social posts, Wikipedia references, blogs) that Dimensions surfaces natively because Dimensions and Altmetric are both Digital Science products.

    Which database best supports DORA-compliant, multi-indicator assessment?

    DORA, published in 2012 and now signed by thousands of organisations worldwide, asks institutions to stop using journal-based metrics such as the Impact Factor as a proxy for the quality of an individual researcher’s contributions, and instead to consider the value and impact of all research outputs alongside qualitative peer judgement. The 2015 Leiden Manifesto (Hicks, Wouters, de Rijcke and Rafols, published in Nature) added ten operating principles for responsible metrics use, including that quantitative evaluation should support, not replace, qualitative expert assessment.

    All three database vendors now publicly reference these frameworks, but their practical alignment differs. Digital Science, Dimensions’ parent company, is listed on DORA’s public signatory register, and Dimensions’ native pairing with Altmetric gives assessors an attention-based indicator alongside citations without needing a separate subscription. Elsevier has endorsed the Leiden Manifesto and built CiteScore’s open methodology partly in response to its principles. Clarivate likewise cites the Leiden Manifesto in its own responsible-metrics guidance and has begun layering a “Societal Impact Framework” onto Web of Science Research Intelligence to capture impact beyond citation counts.

    None of the three databases is independently DORA-compliant by design — compliance is a property of how an institution uses the data, not of the database itself. A single Impact Factor, CiteScore, or Altmetric Attention Score used alone to rank individuals contradicts DORA regardless of source. Multi-indicator assessment requires combining citation-based indicators from at least one curated database with attention-based indicators and qualitative peer review — which is precisely why UK funders and the Research Excellence Framework have explicitly excluded journal impact factors from submission guidance since 2014, requiring panel-level qualitative judgement instead.

    Where does OpenAlex fit as an open alternative?

    OpenAlex, launched in 2022 by the non-profit OurResearch as a fully open successor to the discontinued Microsoft Academic Graph, has emerged as the fourth reference point in this comparison. Unlike Dimensions, Scopus, and Web of Science, OpenAlex publishes its entire dataset and API without subscription cost, drawing on Crossref, ORCID, and ROR identifiers for disambiguation rather than proprietary matching.

    OpenAlex does not yet match the curated metadata quality or the established institutional trust of Scopus or Web of Science, and it carries no equivalent to the Altmetric Attention Score. But for institutions constrained by licensing budgets, or for bibliometrics tools built on reproducible, auditable pipelines, OpenAlex is increasingly used as a free cross-check against the commercial databases rather than a replacement for them.

    Answer-first questions

    What is Altmetric a measure of?

    Altmetric measures online attention, not citation impact. It tracks mentions of a research output across news media, policy documents, social platforms, blogs, and Wikipedia, then produces a weighted Attention Score. Because it captures engagement that predates or bypasses formal citation, it is treated as complementary to citation-based indicators, not a replacement for them.

    What counts as a good Altmetric score?

    There is no universal threshold, because Attention Scores vary enormously by field, output type, and publication date. As a rough benchmark, Altmetric itself notes that a score above roughly 20 typically outperforms most tracked outputs, but comparisons are only meaningful against similar papers in the same journal and timeframe, never as an absolute cutoff.

    Is Scopus or Web of Science better for research assessment?

    Neither is unconditionally “better” — Scopus offers broader, more geographically diverse journal coverage with a transparent four-year CiteScore, while Web of Science offers deeper historical coverage back to 1900 and the still-widely-recognised Impact Factor. DORA-aligned assessment favours using both alongside non-citation indicators rather than choosing one as authoritative.

    Implications for research offices

    Research administrators selecting or combining these tools should treat the choice as an assessment-design decision, not a procurement afterthought. Three practical consequences follow directly from the coverage and metric differences above:

    • A researcher’s citation count and h-index will differ meaningfully between Dimensions, Scopus and Web of Science — institutions must specify and disclose which source underlies any reported figure.
    • Attention-based data (Altmetric, PlumX) captures policy and public engagement that citation-only databases miss entirely, which matters for funders assessing societal impact pathways.
    • Free, open sources such as OpenAlex are viable supplementary cross-checks, particularly where licensing cost restricts access to all three commercial platforms.

    Conclusion

    The three databases are converging on responsible-metrics language while remaining structurally distinct in coverage, indicator design, and cost. Institutions that want genuinely DORA-compliant, multi-indicator assessment should treat Dimensions, Scopus and Web of Science as complementary evidence sources — pairing at least one citation database with an attention-based indicator and qualitative peer review — rather than defaulting to whichever single number is easiest to pull from a subscription dashboard.

  • Leiden Manifesto Checklist for Research Offices

    The Leiden Manifesto for Research Metrics sets out ten principles, published as a comment in Nature in 2015, for the responsible use of quantitative indicators in research evaluation. Research offices can convert each principle into a direct audit question, testing whether KPI dashboards, promotion criteria and grant-review rubrics rely on a single metric, ignore field norms, or substitute for qualitative judgement.

    The Leiden Manifesto for Research Metrics is a ten-principle framework for the responsible use of bibliometric and other quantitative indicators in evaluating research, published by Diana Hicks, Paul Wouters, Ludo Waltman, Sarah de Rijcke and Ismael Rafols in Nature on 22 April 2015. It was formulated at the 19th International Conference on Science and Technology Indicators, held in Leiden, the Netherlands, in September 2014, and has since been cited more than 4,000 times, according to Google Scholar’s tracking of the original paper.

    What is the Leiden Manifesto for Research Metrics?

    The Leiden Manifesto is a response to what its authors called “impact-factor obsession” — the tendency of universities, funders and promotion committees to substitute a single number for expert judgement. It does not ban metrics. It requires that quantitative indicators support, rather than replace, informed peer assessment of research quality.

    The manifesto’s home institution is the Centre for Science and Technology Studies (CWTS) at Leiden University, where co-author Paul Wouters served as director. CWTS also produces the CWTS Leiden Ranking, a separate bibliometrics-based university ranking — a distinction research offices should not conflate when citing the source.

    What are the ten principles of the Leiden Manifesto?

    Each principle addresses a specific failure mode observed in metric-driven research assessment. The table below states each principle exactly as published, alongside the practical audit question a research office should ask of its own KPI or promotion framework.

    # Principle (Hicks et al., 2015) Audit question for your office
    1 Quantitative evaluation should support qualitative, expert assessment Does any committee decision rest on a metric alone, with no narrative peer input?
    2 Measure performance against the research missions of the institution, group or researcher Are KPIs generic, or tailored to the unit’s stated mission (teaching-intensive, applied, translational)?
    3 Protect excellence in locally relevant research Does the framework penalise work published in non-English or regionally focused outlets?
    4 Keep data collection and analytical processes open, transparent and simple Can an academic reproduce their own score from publicly documented methodology?
    5 Allow those evaluated to verify data and analysis Is there a formal, timely route to challenge or correct metric data before a decision is made?
    6 Account for variation by field in publication and citation practices Are raw citation counts compared across disciplines without field normalisation?
    7 Base assessment of individual researchers on a qualitative judgement of their portfolio Does promotion criteria require a portfolio narrative, or just an h-index threshold?
    8 Avoid misplaced concreteness and false precision Are decimal-point differences in impact factor or citation rate treated as meaningful?
    9 Recognise the systemic effects of assessment and indicators Has the office assessed whether its KPIs create incentives to game submission counts or venues?
    10 Scrutinise indicators regularly and update them Is there a scheduled review cycle for the KPI framework itself, not just for scores against it?

    How can a research office audit its KPI and promotion framework against it?

    Running the manifesto as a live audit tool means working through each principle against real artefacts: the appraisal form, the promotion rubric, and the departmental dashboard.

    1. Mark every clause in the promotion/tenure criteria naming a specific metric (impact factor, h-index, citation count).
    2. Check each marked clause has a qualitative narrative requirement alongside it (Principles 1 and 7).
    3. Confirm KPI targets are set per unit mission, not copied institution-wide (Principle 2).
    4. Check non-English-language or applied outputs score on the same scale as high-impact-journal outputs (Principle 3).
    5. Verify each dashboard metric’s data source and calculation method is documented and accessible (Principles 4 and 5).
    6. Confirm citation indicators are field-normalised, not raw counts compared across disciplines (Principle 6).
    7. Look for false precision — ranking staff by two-decimal citation averages (Principle 8).
    8. Ask whether the KPI framework has driven any unintended behaviour, such as salami-slicing publications or discouraging risky research (Principle 9).
    9. Set a fixed review date for the framework itself, independent of individual appraisal cycles (Principle 10).

    A framework that fails more than two or three of these checks is not aligned with the manifesto, regardless of how sophisticated its dashboard software looks. The most common failure in practice is Principle 6: comparing raw citation counts across a mathematics department and a cell biology department, where top-ranked mathematics journals carry impact factors around 3 while top-ranked cell biology journals carry impact factors around 30 — a field-scale gap the manifesto’s authors cite directly as evidence that uncorrected cross-field comparison is meaningless.

    How does the Leiden Manifesto compare with DORA and CoARA?

    The Leiden Manifesto did not appear in isolation. The 2013 San Francisco Declaration on Research Assessment (DORA) preceded it, while the Coalition for Advancing Research Assessment (CoARA) has since built a sector-wide agreement on reforming assessment practice. Research offices are frequently asked which one to adopt.

    Framework Published Format Primary focus
    Leiden Manifesto 22 April 2015 (Nature comment) 10 principles Correct use of quantitative indicators across disciplines and settings
    DORA 2013 (San Francisco Declaration) General recommendations + signatory pledge Eliminating journal impact factor as a proxy for article or researcher quality
    CoARA 2022 (Agreement on Reforming Research Assessment) Institutional commitment agreement Sector-wide reform of hiring, promotion and funding assessment criteria

    DORA has been signed by more than 27,000 individuals and organisations, according to DORA’s own published tally as of March 2026, making it the higher-profile pledge. But when Loughborough University’s LIS-Bibliometrics committee chose a framework for its own policy in 2018, policy manager Elizabeth Gadd selected the Leiden Manifesto because it takes a “broader approach to the responsible use of all bibliometrics across a range of disciplines and settings” — not only journal-level metrics. Elsevier separately announced on 14 July 2020 that it would use the manifesto’s principles to guide its CiteScore methodology.

    In the UK, the independently commissioned Metric Tide review (2015), led by James Wilsdon for the then Higher Education Funding Council for England, reached compatible conclusions and recommended metrics support, not replace, peer review within the research administration processes underpinning the Research Excellence Framework. A research office building a REF-adjacent KPI policy should treat the two as aligned, not competing, references.

    Common questions and what comes next for research offices

    Who wrote the Leiden Manifesto for Research Metrics?

    The manifesto was written by Diana Hicks, professor of public policy at Georgia Institute of Technology, and Paul Wouters, then director of CWTS at Leiden University, together with co-authors Ludo Waltman, Sarah de Rijcke and Ismael Rafols. It was published as a comment in Nature, volume 520, on 22 April 2015.

    Does the Leiden Manifesto ban the use of bibliometrics tools?

    No. The manifesto does not prohibit bibliometrics tools such as Web of Science, Scopus or Dimensions. It requires that any output from these tools — citation counts, h-indices, journal metrics — be interpreted alongside qualitative expert review and adjusted for field-specific citation norms before it informs a decision.

    Why does the importance of bibliometrics remain contested?

    Bibliometrics matter because they scale evaluation across thousands of researchers where individual peer review is impractical. The contested part is misuse: treating a single indicator as an objective proxy for quality, rather than one input alongside portfolio review, mission fit and field context, as the manifesto’s ten principles specify.

    How often should a research office review its KPI framework under the manifesto?

    Principle 10 requires indicators to be “scrutinised regularly and updated,” but sets no fixed interval. Good institutional practice, reflected in library and research-office guidance built on the manifesto, is an annual technical review of data sources plus a full policy review on the same three-to-five-year cycle as promotion-criteria revisions.

    The Leiden Manifesto’s ten principles were written as durable evaluation ethics, not a one-time compliance exercise. As institutions layer AI-assisted analytics, altmetrics and funder-mandated open-data reporting onto existing KPI frameworks, the manifesto’s core requirement — that quantitative evaluation support, not replace, expert judgement — becomes harder to satisfy by default and more important to audit deliberately. Research offices that build the checklist above into their annual promotion-criteria review cycle, rather than treating the manifesto as background reading, are the ones actually applying it.

  • Limitations of Bibliometrics: DORA and CoARA

    Bibliometrics — the statistical analysis of publication and citation data — cannot reliably stand in for research quality on its own: field-specific citation practices, author self-citation, and outright metric gaming all distort single-number scores such as the h-index or Journal Impact Factor. This is the documented evidentiary basis for DORA and CoARA’s push to replace single-score evaluation with qualitative, multi-indicator assessment.

    Bibliometrics is the quantitative study of academic literature — citation counts, publication volume, and derived indices — used as a proxy for scholarly influence. The proxy breaks down whenever a single number is asked to carry the full weight of a quality judgement, which is precisely what large-scale hiring, promotion, tenure, and funding panels have done for decades.

    What is bibliometrics, and why does one score fall short?

    Bibliometric indicators — citation counts, the h-index, the Journal Impact Factor (JIF), and derived composite scores — were built for large-scale, aggregate comparisons, not for judging an individual scholar’s contribution. Bergstrom, West and Wiseman’s 2008 analysis in the Journal of Neuroscience put it plainly: quantitative metrics are poor choices for assessing an individual’s research output compared with the “gold standard” of reading the work and consulting domain experts.

    A single score compresses conflicting dimensions of scholarly value — novelty, rigour, reproducibility, societal reach — into one figure. That compression, not citation data itself, is the structural weakness reform movements target.

    How does field bias distort bibliometric comparisons?

    Citation practices vary sharply by discipline, so raw citation counts cannot be compared across fields. Mathematics and the humanities publish and cite far less frequently than biomedicine, and books and conference proceedings — the dominant outputs in many humanities and computing sub-fields — are tracked inconsistently, or not at all, by Web of Science and Scopus.

    Coverage gaps compound the bias. Indexing databases differ in subject breadth, subject depth, geographic coverage, language coverage, and how far back citation histories extend, so researchers publishing outside the Anglophone, journal-dominant core of a database are systematically under-counted. Belter’s 2015 review in PMC also notes that citation-based indicators require roughly two to three years after publication before they stabilise enough to be considered reliable — a lag that penalises early-career researchers and recent work by design.

    Why does self-citation inflate bibliometric scores?

    Self-citation — an author citing their own prior work — is a normal and often legitimate part of building on a research programme. It becomes a distortion when it is used strategically to inflate an individual’s citation count or a journal’s Impact Factor beyond what independent uptake of the work would justify.

    Clarivate’s Journal Citation Reports has, in past cycles, suppressed the calculated Impact Factor of titles found to display anomalous citation behaviour, including excessive journal self-citation and coordinated “citation stacking” arrangements between journals — a documented, database-level enforcement action against exactly this failure mode. At author level, unusually concentrated self-citation rates are one of the diagnostic flags bibliometricians use when auditing whether a headline citation figure reflects genuine external uptake or engineered inflation.

    Does field-weighted citation impact solve the problem?

    Field-weighted citation impact (FWCI) is a normalised metric — used in tools such as Scopus/SciVal — that adjusts a publication’s citation count against the average for its subject field, publication year, and document type, so that a score of 1.0 represents “as expected” performance for that context. It is a genuine improvement on raw citation counts because it corrects for the field-bias problem described above.

    FWCI does not, however, correct for self-citation gaming or database coverage gaps, and it remains a single number: it shows how a paper performed against a benchmark, not whether the research was rigorous or original. Reform frameworks treat field normalisation as a refinement of bibliometrics, not a licence to keep using any single indicator as a proxy for quality.

    What evidence underlies DORA and CoARA’s reform case?

    The San Francisco Declaration on Research Assessment (DORA), launched in 2012, explicitly recommends against using the Journal Impact Factor as a surrogate measure of the quality of individual research articles, and calls on institutions to assess research on its own merits using a range of qualitative and quantitative indicators. The Coalition for Advancing Research Assessment (CoARA), formed in 2022, builds on DORA’s diagnosis: its signatories commit to basing assessment primarily on qualitative, peer-reviewed judgement, supported by responsible — not exclusive — use of quantitative indicators, and to abandoning inappropriate use of journal- and publication-based metrics such as the JIF and h-index.

    Both build directly on the failure modes above: field bias, self-citation gaming, database coverage gaps, and the two-to-three-year reliability lag are the documented evidence, not abstract principle, behind the push for reform.

    Initiative Launched Core commitment
    DORA (San Francisco Declaration on Research Assessment) 2012 Stop using the Journal Impact Factor as a proxy for individual article or researcher quality
    Leiden Manifesto 2015 (Hicks et al., Nature 520, 429–431) Ten principles for the responsible, transparent use of quantitative indicators alongside expert judgement
    CoARA (Coalition for Advancing Research Assessment) 2022 Base assessment primarily on qualitative peer review; abandon inappropriate JIF/h-index use in hiring, promotion and funding decisions

    Answer-first questions on bibliometric limitations

    What are the main limitations of bibliometrics in research assessment?

    The main limitations are field bias (citation norms differ by discipline), database coverage gaps (books, non-English and non-journal outputs are under-tracked), self-citation inflation, and a two-to-three-year lag before citation counts stabilise. Together these mean a single score cannot substitute for expert, qualitative judgement of research quality.

    Why is the h-index considered a poor measure of individual research quality?

    The h-index rewards volume and career length over insight, cannot distinguish a highly cited author from a member of a large collaborative team, and does not account for field-specific citation norms. Bergstrom, West and Wiseman (2008) concluded that reading the work and consulting experts remains the more reliable standard for individual evaluation.

    What is the difference between DORA and CoARA?

    DORA (2012) is a signable declaration focused primarily on eliminating Journal Impact Factor misuse. CoARA (2022) is a membership coalition of funders, universities and academies that goes further, committing signatories to a broader, peer-review-centred reform agenda across hiring, promotion, and institutional evaluation, with periodic reporting on progress.

    What is a self-citation rate and why does it matter?

    A self-citation rate is the proportion of an author’s or journal’s total citations that come from their own prior work rather than independent external uptake. Bibliometricians and citation-database auditors (including Clarivate’s Journal Citation Reports process) use unusually high self-citation rates as a flag for possible metric gaming rather than genuine scholarly influence.

    What should research administrators do differently?

    For research administrators and institutional leaders, the practical implication is not to discard citation data but to stop letting any single figure carry a hiring, promotion, or funding decision unsupervised. That means:

    • Pairing field-normalised indicators such as FWCI with narrative, qualitative peer assessment, as CoARA commitments require.
    • Auditing self-citation and journal self-citation patterns before citing a headline figure in a case file.
    • Recognising a fuller range of outputs — datasets, software, policy influence — rather than journal articles alone.
    • Crediting individual contributions on multi-author papers explicitly, rather than inferring credit from author position or aggregate citation share.

    On that last point, standardised contributor-role taxonomies address a related gap directly. CASRAI originated the CRediT contributor role taxonomy in 2014; the standard is now stewarded by NISO as ANSI/NISO Z39.104-2022, and it lets institutions record which named contributor performed which specific role on a paper — conceptualisation, data curation, writing — rather than relying on citation share or author-list position as a proxy for who did what.

    Where bibliometric reform goes next

    The evidentiary case against single-number bibliometric scores is now well established: field bias, database coverage gaps, self-citation gaming, and a multi-year reliability lag are documented, auditable failure modes, not theoretical objections. DORA and CoARA translate that evidence into institutional commitments, and field-normalised metrics such as FWCI narrow — without eliminating — the field-bias problem.

    The direction of travel for funders, universities and academies is toward layered assessment: responsibly used quantitative indicators, transparent contributor-role attribution, and peer judgement at the centre, rather than any one score standing alone.

  • Is Self-Citation Ethical in Responsible Metrics?

    Is self-citation ethical? Self-citation is ethical when an author cites their own prior work because it is genuinely relevant to a new argument, method, or dataset; it becomes unethical only when the primary motive shifts to inflating citation counts, h-index, or a journal’s impact factor. Neither DORA nor CoARA — the two dominant responsible-metrics frameworks — sets a self-citation rule, leaving this judgement almost entirely to editors, reviewers, and individual conscience.

    Self-citation is the practice of an author referencing their own previously published work within a new publication, most commonly to establish methodological continuity, avoid self-plagiarism, or trace the development of a research programme over time.

    What counts as self-citation, and why do researchers do it?

    Self-citation occurs whenever an author lists their own prior publication in a new paper’s reference list. It is neither rare nor inherently suspect: most research is cumulative, and a study that builds on a researcher’s earlier method, dataset, or theoretical framework has good reason to cite that earlier work directly.

    • Establishing methodological continuity with a previously validated technique or instrument
    • Avoiding self-plagiarism by properly attributing earlier text, data, or ideas
    • Tracing the trajectory of a multi-paper research programme for the reader
    • Providing background the author is best placed to cite because they generated the original finding

    The Committee on Publication Ethics (COPE) has noted that failing to cite one’s own directly relevant prior work can itself mislead readers into thinking a study is more novel than it is — so the ethical failure mode runs in both directions, not only toward over-citation.

    How much self-citation is considered excessive?

    There is no single, universally agreed self-citation rate ceiling. A 2023 analysis published in PMC concluded that a self-citation rate around 20 percent is conservatively tolerable for individual researchers, with rates substantially above that treated as inappropriate — but the same paper stresses that discipline size and publication norms shift what counts as normal.

    COPE’s own November 2017 forum discussion, “Self-Citation: Where’s the Line?”, found no consensus figure among editors. Some journals cap the absolute number of self-citations (for example, no more than five), others use a percentage-of-total-references ceiling, and many rely on case-by-case editorial judgement rather than a fixed rule. COPE’s broader position on handling citation manipulation asks journals to set their own thresholds and educate authors, rather than prescribing one number for the whole of scholarly publishing.

    A 2025 analysis in the Journal of Academic Ethics (Springer) reinforces the intent-based test over a rate-based one, concluding that “ethical reviewers should avoid unnecessary self-citation” while allowing that citing one’s own work is acceptable “if directly relevant” — the same relevance-over-frequency logic COPE applies.

    Why don’t DORA and CoARA address self-citation directly?

    The San Francisco Declaration on Research Assessment (DORA, 2012) is aimed squarely at eliminating the use of the journal impact factor as a proxy for individual researcher quality in hiring, funding, and promotion decisions. It says nothing about how many times an author may cite themselves within a paper’s reference list — that is a citation-practice question, not a journal-metric question, and sits outside DORA’s original scope.

    The Coalition for Advancing Research Assessment (CoARA), formed in 2022, commits signatory institutions to move away from inappropriate use of quantitative indicators and toward qualitative, narrative-based evaluation. This is the closest thing academia has to a responsible-metrics consensus position, yet CoARA’s Agreement likewise does not name self-citation as a distinct risk category — it addresses metric misuse at the institutional and assessment level, not individual reference-list behaviour.

    The result is a genuine governance gap. Self-citation sits between two policy domains — publication ethics (COPE’s territory) and research assessment reform (DORA and CoARA’s territory) — without either treating it as a first-class concern. Editors are left applying inconsistent journal-level rules, while institutional assessment reformers focus almost entirely on how metrics are used rather than on what feeds into them.

    Disclosure norms vs blanket caps: the better governance model

    A blanket percentage cap on self-citation is easy to state but poorly matched to how research actually varies. Small or emerging subfields with few active authors, first-in-series methodology papers, and long-running research programmes will all show naturally higher self-citation rates than a large, well-established field — penalising a rate rather than the intent behind it risks punishing legitimate continuity while doing little to stop a determined metric-gamer, who can simply keep self-citations just under whatever line is drawn.

    A more workable precedent already exists in bibliometrics. The standardized citation-metrics database maintained by Ioannidis, Boyack, and Baas — used to identify the world’s most-cited scientists across disciplines — reports each author’s composite citation score both with and without self-citations included, alongside their raw self-citation percentage. It does not impose a cutoff; it makes the number visible and lets the reader judge. That is a disclosure model, not a cap.

    Framework Year Position on self-citation Governance model
    COPE 2017/ongoing Case-by-case editorial judgement; no fixed universal threshold Journal-level policy, editorial discretion
    DORA 2012 Not addressed; targets impact-factor misuse in assessment Institutional assessment reform
    CoARA 2022 Not addressed; targets inappropriate metric use generally Institutional assessment reform
    Ioannidis/Boyack/Baas database 2019, updated annually Reports self-citation rate transparently alongside adjusted score Disclosure, no cap
    Individual journal caps Varies Fixed number or percentage limit on self-citations Blunt rule, inconsistently applied

    Applying that same logic to individual authors and grant applicants is straightforward: require a disclosed self-citation rate alongside any citation-based metric submitted for hiring, promotion, or funding decisions, rather than an arbitrary cap that cannot distinguish a legitimate methods lineage from deliberate metric inflation.

    Answer-first Q&A on self-citation ethics

    Is self-citation unethical?

    Self-citation is not inherently unethical. It becomes ethically problematic only when it is used to inflate citation metrics rather than to serve genuine scholarly continuity — what COPE treats as a form of citation manipulation. Relevance to the argument, not frequency, is the ethical test that matters.

    Is it okay to cite yourself in a research paper?

    Yes. Citing your own prior work is standard practice when it establishes methodological continuity, avoids self-plagiarism, or shows how a study builds on earlier findings. Problems arise only when self-citations serve no argumentative purpose beyond raising an author’s h-index or a journal’s impact factor.

    Is self-citation illegal?

    No. Self-citation is a matter of publication ethics, not law. Excessive or irrelevant self-citation can breach a journal’s editorial policy or COPE’s citation-manipulation guidance, potentially triggering a correction or editorial inquiry, but it carries no legal liability in any jurisdiction.

    Implications for journals, funders, and institutions

    Journals can adopt the disclosure model directly: require authors to report a manuscript’s self-citation percentage at submission, alongside a one-line rationale where the rate is unusually high, rather than enforcing an arbitrary cap during peer review.

    CoARA signatories reforming promotion and funding criteria are well placed to extend their existing move toward narrative CVs by asking applicants to disclose self-citation-adjusted metrics alongside any citation count submitted for assessment — consistent with CoARA’s broader commitment to context over raw indicators.

    DORA signatories evaluating individual researchers already commit to judging research on its own merits rather than by journal-level proxies; adding a self-citation disclosure line to that practice would close a gap the original 2012 declaration was never designed to cover.

    Conclusion: toward transparent, not punitive, norms

    Self-citation is not a solved problem in responsible metrics guidance — it is an unaddressed one. DORA targets journal-level metric misuse; CoARA targets institutional assessment culture; COPE offers editorial case law without a universal rule. None of the three treats individual self-citation disclosure as a named requirement.

    The fix does not need a new blanket percentage cap, which would misfire across disciplines of different sizes and publication norms. It needs a disclosure norm: report the self-citation rate, report the rationale where it is high, and let editors, funders, and hiring committees judge intent with that information in hand — the same logic that already underpins the field’s most credible standardized citation databases.

  • SciVal Bibliometrics vs the Leiden Ranking: Benchmarking Under DORA

    SciVal is Elsevier’s Scopus-based platform for benchmarking research output; the CWTS Leiden Ranking is Leiden University’s field-normalised ranking that deliberately avoids one composite score. Institutions increasingly run both together, but DORA warns that any league-table framing can reduce research quality to a single misleading number.

    SciVal bibliometrics refers to the citation and output metrics — including Field-Weighted Citation Impact (FWCI) — that Elsevier’s SciVal platform generates from Scopus data to support institutional research evaluation. Research offices now routinely pair this proprietary layer with the CWTS Leiden Ranking’s open, transparent indicators, creating a benchmarking workflow that sits in direct tension with the San Francisco Declaration on Research Assessment (DORA).

    What is SciVal and what does it measure?

    SciVal is Elsevier’s research-analytics platform, built on Scopus abstract-and-citation data, that lets subscriber institutions benchmark output, impact, and collaboration against named peer groups. It does not produce publicly indexed rankings; access is by institutional subscription, and outputs are configured per user for internal decision-making rather than public comparison.

    Core SciVal modules include:

    • Overview — publication and citation summaries for an entity over time
    • Benchmarking — side-by-side comparison against selected competitor or aspirational institutions
    • Collaboration — network maps of co-authorship at institutional, national, and international level
    • Trends — topic-level growth signals used for strategic investment decisions

    Its signature indicator is Field-Weighted Citation Impact (FWCI), the ratio of citations a set of publications actually received to the citations expected for publications of the same type, year, and subject field. A FWCI of 1.0 represents the world average for that field; values above 1.0 indicate above-average citation impact.

    How does the CWTS Leiden Ranking differ from SciVal?

    The CWTS Leiden Ranking, produced annually since 2007 by the Centre for Science and Technology Studies at Leiden University, is a free, publicly available ranking that explicitly refuses to combine indicators into one overall score. Instead it publishes separate, field-normalised tables — including MNCS (mean normalised citation score) and PP(top 10%), the proportion of an institution’s output among the world’s most-cited 10% of papers in its field.

    Where SciVal is a private diagnostic tool tuned to whatever comparator group an institution chooses, the Leiden Ranking is a public, methodologically documented instrument built for cross-institutional transparency. The distinction matters for governance: SciVal data informs internal strategy conversations, while Leiden Ranking data is citable externally by journalists, funders, and prospective students.

    Dimension SciVal CWTS Leiden Ranking
    Underlying data source Scopus Web of Science (Classic edition) or OpenAlex (Open Edition)
    Access model Institutional subscription Free and publicly browsable
    Composite score Configurable dashboards, no single mandated score Explicitly none — indicators kept separate by design
    Level of analysis Author, department, institution, custom groups Institution-level only
    Signature indicator Field-Weighted Citation Impact (FWCI) MNCS and PP(top 10%)
    Governing body Elsevier (commercial) CWTS, Leiden University (academic)

    Why does DORA caution against benchmarking with league tables?

    DORA, the San Francisco Declaration on Research Assessment published in 2012, calls on institutions to stop using journal- and rank-based proxies as substitutes for assessing the actual content of research. Its core recommendation is definitive: evaluators must not treat a journal impact factor, or by extension a university’s league-table position, as a surrogate measure of the quality of an individual researcher’s contribution.

    The UK’s Research Excellence Framework reinforces the same principle domestically — REF guidance instructs assessment panels not to rely on journal impact factors or bibliometric rankings when judging individual outputs. A single Leiden Ranking position or SciVal FWCI score, DORA argues, compresses genuinely multidimensional research performance into one figure that is easy to misuse in hiring, promotion, and funding decisions.

    How are research offices combining SciVal and Leiden in practice?

    A DORA-conscious workflow uses SciVal for granular internal diagnostics and the Leiden Ranking for transparent, external context — never letting either stand alone as a judgement on individual quality. In practice this looks like a two-stage process rather than a single dashboard export.

    1. Research offices first use SciVal to identify departmental strengths, emerging topics, and collaboration gaps against a self-selected comparator set.
    2. They then check institutional standing against the Leiden Ranking’s published, field-normalised indicators to see how that internal picture holds up against an independently governed, public dataset.
    3. Neither output is applied directly to an individual researcher’s promotion or tenure case, consistent with DORA’s requirement that assessment be based on the substance of the work.

    This “basket of metrics” approach — pairing a proprietary analytics tool with an open, non-composite ranking — is increasingly the model that DORA-signatory universities describe in their own research-assessment policies.

    What does the OpenAlex-based Leiden Ranking Open Edition change?

    Since 2023, CWTS has published a Leiden Ranking Open Edition built entirely on OpenAlex data, run alongside the long-standing Web of Science-based Classic edition. OpenAlex, launched by OurResearch in 2022 as a free successor to the discontinued Microsoft Academic Graph, indexes a broader and more open set of scholarly outputs than either Scopus or Web of Science.

    Because the Open Edition and Classic edition draw on different underlying databases, the same institution can show a materially different position depending on which edition is consulted — a fact rarely mentioned in library guidance on SciVal or Leiden alone. This is itself a practical argument for DORA’s caution: even among ostensibly objective, field-normalised rankings, the choice of data source alone can shift an institution’s apparent standing, before any interpretive judgement is applied.

    Common questions about SciVal bibliometrics

    Is SciVal the same as Scopus?

    No. Scopus is Elsevier’s underlying abstract-and-citation database; SciVal is a separate analytics layer built on top of Scopus data. Scopus supplies the raw publication and citation records, while SciVal turns them into benchmarking dashboards, Field-Weighted Citation Impact scores, collaboration maps, and trend reports for institutions and funders.

    What is SciVal used for?

    Research offices use SciVal to benchmark departments against named peers, track Field-Weighted Citation Impact and output trends, identify emerging research strengths, map collaboration networks, and build evidence for grant applications — functions distinct from external, public rankings such as the Leiden Ranking.

    What are the limitations of SciVal?

    SciVal’s field-normalisation depends on how Scopus classifies each publication’s subject field, which can misclassify interdisciplinary work. Coverage is limited to Scopus-indexed output, under-representing books and some social-science and humanities journals — a gap DORA cites when warning against treating any single metric as definitive.

    What metrics does SciVal provide?

    Core SciVal indicators include Scholarly Output, Citation Count, Field-Weighted Citation Impact (world average equals 1.0), Outputs in Top Citation Percentiles, and Collaboration metrics. These sit alongside Leiden-style indicators such as MNCS and PP(top 10%) used for external, field-normalised comparison.

    What this means for research administrators

    For research administration teams, the practical guidance is to treat SciVal and the Leiden Ranking as complementary diagnostic inputs, not verdicts. Any institutional report that cites either should disclose the comparator group, data source (Scopus, Web of Science, or OpenAlex), and the field-normalisation method applied, so that governance committees can judge the figures in context rather than as a rank alone.

    Where SciVal or Leiden data feeds into funding, hiring, or strategic planning, DORA-aligned institutions pair the quantitative output with qualitative peer assessment — a practice increasingly documented in the research-assessment policies of DORA-signatory universities.

    Where institutional benchmarking is heading

    As open bibliographic sources such as OpenAlex mature alongside proprietary platforms, expect research offices to triangulate across multiple data sources rather than anchor decisions to one dashboard or one ranking position. The direction of travel — visible in the Leiden Ranking’s own move to publish a parallel OpenAlex edition — is toward more transparent, multi-source benchmarking, precisely the “basket of metrics” model DORA has argued for since 2012.

    Research offices that document their methodology and keep SciVal, Leiden, and open datasets in dialogue with each other will be better placed to withstand scrutiny than those relying on any single proprietary score.

  • OpenAlex: The Case for Open Research Metrics

    OpenAlex is a free, CC0-licensed index of more than 319 million scholarly works, authors and institutions, built by the non-profit OurResearch to replace the discontinued Microsoft Academic Graph. For institutions weighing research-metrics platforms, its open data answers a question closed commercial indices cannot: who can audit the numbers behind an assessment decision.

    OpenAlex is a bibliographic catalogue of scientific papers, authors and institutions accessible in open-access mode, named after the Library of Alexandria. That single design choice — publishing the full dataset under a public-domain licence rather than behind a subscription wall — is what separates it structurally from Elsevier’s Scopus and Clarivate’s Web of Science, and why it has become a reference point in debates about research-assessment transparency.

    What Is OpenAlex?

    OpenAlex launched in January 2022, built by OurResearch (a US non-profit operating as Impactstory, Inc.) as a successor to the Microsoft Academic Graph, which Microsoft stopped updating on 31 December 2021. The project inherited MAG’s dataset and rebuilt it as an open, queryable graph of works, authors, institutions, funders, and topics.

    Two design decisions define the platform. First, the entire dataset is released under a Creative Commons Zero (CC0) licence, meaning any institution, developer, or researcher can download, redistribute, and build on it without permission or cost. Second, OpenAlex has formally adopted the Principles of Open Scholarly Infrastructure (POSI), a governance commitment covering sustainability, community control, and data portability.

    The scale is now substantial. OpenAlex’s own catalogue reports more than 319 million scholarly works, and its API handled roughly 115 million queries a month in 2024, according to figures cited in the platform’s Wikipedia entry. It draws source data from Crossref, ORCID, DOAJ, and Unpaywall rather than from a closed editorial pipeline.

    How Does OpenAlex Compare with Scopus and Web of Science?

    The practical difference is not just price — it is what each platform lets an institution verify. Scopus and Web of Science apply proprietary, selective journal-inclusion criteria and sell access to the resulting index. OpenAlex indexes broadly by default and publishes the inclusion logic as open code, which means an institution can inspect exactly why a work is or is not counted.

    Dimension OpenAlex Scopus (Elsevier) Web of Science (Clarivate)
    Governance Non-profit (OurResearch), POSI-aligned Commercial publisher Commercial data company
    Data licence CC0, fully open, bulk download Proprietary, licensed access only Proprietary, licensed access only
    Core journal metric No proprietary journal metric CiteScore (four-year citation average) Journal Impact Factor
    Coverage approach Broad, automated aggregation, strong Diamond OA and non-English coverage Curated, selective journal list Curated, selective journal list
    Cost to institutions Free API; optional paid support tier Subscription Subscription

    CiteScore, Scopus’s flagship journal metric, averages the citations a journal’s documents receive over a four-year window — a useful signal, but one calculated entirely inside a closed system that institutions cannot independently reproduce. OpenAlex does not publish an equivalent branded journal score; instead it exposes the underlying citation and work-level data so that any bibliometrician can calculate their own indicator and show their working.

    Coverage differences matter for equity as much as accuracy. A 2024 study cited in OpenAlex’s Wikipedia entry found the platform indexes more than 12,500 Diamond Open Access journal titles, including over 60% of Diamond OA journals absent from both Web of Science and Scopus — a direct consequence of not gating inclusion behind a commercial selection committee.

    Why Does Open Metrics Infrastructure Serve DORA’s Transparency Principle?

    The San Francisco Declaration on Research Assessment (DORA), first published in 2012, asks funders, institutions, and publishers to stop substituting journal-based proxies for direct evaluation of research and to be explicit about the criteria used in funding, hiring, and promotion decisions. That explicitness requirement is where the platform choice stops being neutral.

    A closed index can tell an institution that a number was calculated a certain way, but it cannot let that institution independently verify how, because the underlying citation graph is licensed, not published. An open metadata layer removes that opacity: the same dataset an institution cites in a tenure file or a funding report can be downloaded, re-run, and checked by anyone, including the researcher being assessed.

    Adoption evidence has followed the argument. Leiden University announced in September 2023 that it would produce an open-source edition of its CWTS Leiden Ranking using OpenAlex data from 2024 onward. Sorbonne University announced in December 2023 that it was withdrawing its Scopus subscription in favour of OpenAlex. In 2024, France’s Ministry of Higher Education and Research pledged financial support to the project, describing it as “crucial open science infrastructure,” and the Arcadia Fund awarded OurResearch a $7.5 million grant explicitly to build OpenAlex into a sustainable alternative to commercial citation indices.

    • Leiden University: open-source CWTS Leiden Ranking edition built on OpenAlex data (from 2024)
    • Sorbonne University: Scopus subscription withdrawn in favour of OpenAlex (December 2023)
    • French Ministry of Higher Education and Research: financial commitment to OpenAlex as open science infrastructure (2024)
    • Arcadia Fund: $7.5 million grant to OurResearch for OpenAlex sustainability (March 2024)

    None of this means closed indices lack value; their curated selection and mature analytics tooling still suit some high-stakes evaluations. But where the explicit requirement is transparency rather than convenience, an auditable, CC0-licensed data layer meets DORA’s stated principle more directly than a licensed black box.

    Common Questions About OpenAlex

    What is OpenAlex used for?

    Universities, funders, and publishers use OpenAlex to track publication output, measure open-access status, benchmark institutional performance, and feed alternative rankings such as the open-source CWTS Leiden Ranking. Its free API also underpins third-party dashboards, systematic-review tools, and research-information systems that need citation and affiliation data without a subscription fee.

    Is OpenAlex legit?

    Yes. OpenAlex is maintained by OurResearch, a non-profit with a multi-year record of building open scholarly infrastructure, and it has formally adopted the Principles of Open Scholarly Infrastructure (POSI). Its data and methodology are openly licensed and auditable, and the platform is already cited in peer-reviewed scientometrics research, including a 2022 arXiv paper by its founders.

    Is OpenAlex free?

    Yes. The full dataset is released under a Creative Commons Zero (CC0) public-domain licence, and the REST API can be queried without a subscription, unlike Scopus or Web of Science. A polite-pool rate limit applies to unauthenticated use, and OurResearch offers an optional paid support tier for high-volume institutional queries.

    Who owns OpenAlex?

    OpenAlex is created and maintained by OurResearch, a US-based non-profit operating as Impactstory, Inc., not by a commercial publisher. Governance sits with a mission-driven organisation rather than a shareholder-owned company — the structural distinction that underpins its CC0 licensing and its appeal to institutions pursuing publisher-independent, DORA-aligned metrics.

    What Should Institutional Leaders Do Next?

    Platform choice is now a governance decision, not just a procurement one. An institution that cites OpenAlex data in a promotion case, a funding report, or an open-access dashboard is making a transparency claim as well as a metrics claim, and that claim should be tested before it is relied upon.

    • Map which existing assessment workflows (tenure, funding reports, rankings submissions) rely on a metric an evaluator cannot independently reproduce.
    • Pilot OpenAlex alongside — not instead of — existing subscriptions, comparing coverage gaps directly against Scopus or Web of Science outputs for your own institutional corpus.
    • Document data provenance explicitly in assessment criteria, consistent with DORA’s requirement for stated, auditable methodology.
    • Track POSI-aligned infrastructure commitments (OpenAlex, CrossRef, ORCID, ROR) as the durable layer beneath any commercial tool an institution also chooses to license.

    Open, non-proprietary metadata will not replace every function a commercial index performs today. But as funders and assessment reformers keep pressing for auditable evidence over proprietary scores, institutions that already understand — and can reproduce — their own metrics will be the ones best placed to defend them.

  • OpenAlex API: Building a Metrics Dashboard

    The OpenAlex API is a free, fully open REST interface to a catalogue of hundreds of millions of scholarly works, authors, institutions and funders, and it is the most practical data source for building an in-house institutional research metrics dashboard without a subscription. Query the /works endpoint with an institution filter, aggregate with group_by, and you have publication counts, open-access share and citation-percentile data in a single JSON response.

    OpenAlex is an open, CC0-licensed catalogue of the global research system — works, authors, institutions, sources, funders and topics — built and maintained by the non-profit OurResearch as a successor to the discontinued Microsoft Academic Graph. Because every record and the API itself are free to query, research offices can build metrics dashboards without licensing a commercial bibliometrics platform, provided they understand the filter syntax, pagination limits and the metric gaps this guide covers.

    What is the OpenAlex API and what does it cover?

    The OpenAlex API exposes entity endpoints — Works, Authors, Institutions, Sources, Topics, Funders and Awards — each accessed at https://api.openalex.org/{entity}. Every entity supports four operations: list, get (by ID), filter, and group_by (server-side aggregation), which together are the building blocks of a dashboard.

    Each entity carries a persistent OpenAlex ID and, for institutions, a cross-walked ROR identifier — the Research Organization Registry ID also used by ORCID, Crossref and DataCite. Filtering on an institution’s ROR-linked OpenAlex ID, rather than a free-text name match, is what keeps a dashboard’s institutional attribution stable as an organisation’s name or subsidiary structure changes.

    Entity endpoint Dashboard use case Example filter
    /works Publication counts, open-access share, citation percentiles authorships.institutions.id
    /authors Researcher productivity, h-index-style summary stats affiliations.institution.id
    /institutions Peer benchmarking, collaboration networks ror
    /topics Subject-area concentration and trend detection works_count

    How do you query the Works endpoint for institutional metrics?

    Every institution-level query starts with the authorships.institutions.id filter set to the institution’s OpenAlex ID, which you resolve once via /institutions?filter=ror:https://ror.org/{your-ror-id}. From there, combine filters with commas (AND logic) and pipes (OR logic), and add group_by to turn a list query into an aggregation query in one request — no client-side loop required.

    • Publication trend: /works?filter=authorships.institutions.id:I123...,publication_year:2020-2026&group_by=publication_year
    • Open-access share: add &group_by=oa_status to the same filter to split output into gold, green, hybrid, bronze and closed counts.
    • Field distribution: &group_by=primary_topic.field.id reveals subject concentration across an institution’s output.
    • Collaboration mapping: &group_by=authorships.institutions.id returns co-publishing partner institutions ranked by shared-work count.

    Use the select parameter to strip unused fields from large responses, and switch from offset-based page/per_page pagination to cursor pagination once a query’s meta.count exceeds roughly 10,000 results — offset pagination is capped and will silently stop returning new pages beyond that depth.

    How do you approximate field-weighted citation impact with OpenAlex data?

    Field-weighted citation impact (FWCI) is a proprietary metric popularised by Elsevier’s SciVal and Scopus products, calculated by comparing a work’s citations to the average for same-year, same-subject, same-document-type publications; OpenAlex does not expose a field literally called “FWCI”, and no open API replicates the Scopus subject-classification baseline it is normalised against.

    OpenAlex’s nearest open equivalent is the cited_by_percentile_year object returned on every work record, which gives a min/max percentile rank of that work’s citation count against all works of the same publication year and type. Aggregating this field across an institution’s output — for example, the share of works in the top decile (percentile ≥ 90) per year — produces a transparent, reproducible citation-impact proxy that a dashboard can compute without a commercial licence, though it is not interchangeable with SciVal’s FWCI for benchmarking against institutions that report the Scopus figure.

    For most dashboards the honest approach is to present both: raw citation counts (context-dependent, not comparable across fields) and the percentile-year proxy (comparable within OpenAlex’s corpus), clearly labelled as distinct from any vendor-reported FWCI value cited in external reports.

    What are the authentication, rate-limit and pricing rules?

    OpenAlex’s underlying dataset, website and API are free and the data is CC0-licensed, so no purchase is required to query or redistribute results. Every request should still include a contact identifier — either a mailto query parameter with your email address or a registered api_key — to enter the “polite pool”, which OurResearch prioritises over anonymous traffic for faster, more consistent response times.

    Requests without a mailto parameter or API key are routed to a slower, lower-priority pool and are more likely to be throttled during peak load; this single parameter is the most common fix for intermittent 429 or timeout errors reported by developers building batch-harvesting scripts. Dashboard builders scheduling nightly refresh jobs should always set mailto or an API key rather than relying on the anonymous pool.

    Common developer questions

    Is the OpenAlex API free?

    Yes. OpenAlex is free to query, and the underlying data is licensed under CC0, meaning it can be reused and redistributed without royalties. Registering an email via the mailto parameter or an API key gives access to the faster “polite pool” but does not change the underlying no-cost model.

    Does OpenAlex have an API for institutional data?

    Yes. The Institutions endpoint returns disambiguated organisation records cross-walked to ROR identifiers, and the Works endpoint accepts an authorships.institutions.id filter, which is the standard way to scope any query to a single institution’s publication output for a dashboard.

    What is OpenAlex used for in research administration?

    Research offices use OpenAlex to track publication trends, open-access compliance, collaboration networks and topic concentration without paying for a commercial bibliometrics subscription. Its open licence also makes it suitable for public-facing institutional reporting, since results can be republished without redistribution restrictions.

    Implications for institutional research offices

    A dashboard built directly on the OpenAlex API gives research administration teams a free, auditable alternative to proprietary bibliometrics tools for routine reporting — publication counts, open-access compliance tracking and collaboration mapping — while reserving paid platforms for tasks that genuinely require vendor-normalised metrics such as reported FWCI. The trade-off is that teams take on the engineering work themselves: handling pagination beyond 10,000 results, keeping institution ID mappings current as ROR records change, and documenting clearly that a percentile-based proxy is not the same figure a funder or ranking body may expect from Scopus.

    As OpenAlex’s topic classification and percentile fields mature, the gap between what a free, transparent API can deliver and what a paid platform delivers continues to narrow for most day-to-day institutional reporting needs, making a well-built in-house dashboard an increasingly credible default rather than a stopgap.