Skip to main content
v2026.11,858 entries · CC-BY 4.0
Dictionary termTrack EProposedv2026.2

Quantitative-qualitative balance

The deliberate combination of metrics and expert qualitative judgement within a single assessment process, so that neither substitutes entirely for the other.

ByCASRAI Editorial Board
· Last updated 5 Sept 2026
Share this

Ask CASRAI · free to try

Ask about Quantitative-qualitative balance

Ask your first 2 questions free below. Subscribers get 150 a day for $29 a month.

Ask CASRAI answers research-administration questions and cites the passages behind every claim. When our sources don't cover a question, it says so.

Answers draw on CASRAI's guides and dictionary plus the federal and funder documents we index: Federal Register, Grants.gov, Regulations.gov and UKRI.

Works on this site and inside Claude, Cursor and the AI tools you already use.

Everything CASRAI publishes — this page, the dictionary, the guides and the news — stays free to read, with no account and no card.

Examples

Worked examples

  • Is an instance

    A hiring committee reviewing a narrative CV alongside a citation report, weighting both, rather than ranking candidates by h-index alone.

Counter-examples

Looks similar, but isn't

  • Not an instance

    A panel that reads narrative statements but has already ranked candidates by citation count beforehand is not practising quantitative-qualitative balance, even though both types of evidence were technically present.

Editorial commentary

Quantitative-qualitative balance is the deliberate combination of metrics (citation counts, altmetrics, output counts) with expert qualitative judgement (peer review, narrative case studies) in a single assessment process, rather than relying on either exclusively. Responsible-metrics reform does not argue for eliminating metrics — it argues against using metrics as a sole or unexamined proxy for quality, and against using qualitative judgement without any evidentiary grounding.

Where this framing comes from

The UK’s 2015 Metric Tide report (Wilsdon et al.) is the reference point most CASRAI users will recognise for the phrase “responsible metrics”: it argued that metrics should support, not supplant, expert judgement, and set out robustness, humility, transparency, diversity and reflexivity as the five principles a balanced process should satisfy. Its 2022 follow-up review, Harnessing the Metric Tide, assessed how far UK institutions had actually implemented that balance. See Metric Tide Report and Metric Tide Review.

How CoARA and DORA operationalise it

DORA’s core recommendation targets one specific imbalance — journal-level metrics substituting for judgement about an individual article — without rejecting metrics generally. CoARA’s Agreement commits signatories to basing assessment “primarily on qualitative evaluation for which peer review is central, supported by responsible use of quantitative indicators”, which is close to a direct definition of quantitative-qualitative balance as an operating principle rather than an abstract goal.

Practical failure modes

Two failure modes are common in practice: reverting to metrics alone under panel time pressure, since qualitative review is slower; and, less discussed but equally real, qualitative review that is not actually grounded in any consistent evidence base and becomes reviewer-dependent rather than balanced. See peer review in assessment and process diversity in assessment for the mechanisms this balance depends on.

References

  • Wilsdon J et al., The Metric Tide, HEFCE, 2015. Harnessing the Metric Tide, Research England/UKRI, 2022. CoARA Agreement, coara.org.

Also known as

Mixed-methods assessment · Balanced assessment

Machine-readable encodings

Use in your systems

JATS XML <role> element
xml
<role vocab="credit"
      vocab-identifier="https://casrai.org/dictionary/"
      vocab-term="Quantitative-qualitative balance"
      vocab-term-identifier="https://casrai.org/dictionary/term/quantitative-qualitative-balance" />
Schema.org DefinedTerm (JSON-LD)
json
{
  "@context": "https://schema.org",
  "@type": "DefinedTerm",
  "@id": "https://casrai.org/dictionary/term/quantitative-qualitative-balance",
  "name": "Quantitative-qualitative balance",
  "identifier": "https://casrai.org/dictionary/term/quantitative-qualitative-balance",
  "description": "The deliberate combination of metrics and expert qualitative judgement within a single assessment process, so that neither substitutes entirely for the other.",
  "inDefinedTermSet": "https://casrai.org/dictionary/domain/responsible-assessment#set",
  "url": "https://casrai.org/dictionary/term/quantitative-qualitative-balance",
  "alternateName": [
    "Mixed-methods assessment",
    "Balanced assessment"
  ],
  "license": "https://creativecommons.org/licenses/by/4.0/",
  "publisher": {
    "@id": "https://casrai.org/#organization"
  },
  "author": {
    "@id": "https://casrai.org/#editorial-team"
  },
  "datePublished": "2026-05-21T02:22:55",
  "dateModified": "2026-09-05T14:25:55",
  "inLanguage": "en-GB",
  "isAccessibleForFree": true
}

Referenced across the research world

University of Cambridge logoColumbia University logoCrossref logoUniversity of Edinburgh logoHarvard University logoUniversity of Oxford logoPrinceton University logoStanford School of Medicine logoUniversity College London logoORCID logoUniversity of Cambridge logoColumbia University logoCrossref logoUniversity of Edinburgh logoHarvard University logoUniversity of Oxford logoPrinceton University logoStanford School of Medicine logoUniversity College London logoORCID logo
  • University of Cambridge logo
  • Columbia University logo
  • Crossref logo
  • University of Edinburgh logo
  • Harvard University logo
  • University of Oxford logo
  • Princeton University logo
  • Stanford School of Medicine logo
  • University College London logo
  • ORCID logo

View CASRAI adoption →