Tag: citescore vs sjr

  • CiteScore vs Impact Factor Under DORA and CoARA

    In the citescore vs impact factor comparison, neither metric wins under research-assessment reform: CiteScore (Elsevier/Scopus) tracks citations across a four-year window and all document types, while Journal Impact Factor (Clarivate/Web of Science) uses a two-year window limited to “citable items” — and DORA and CoARA both instruct assessors not to use either as a proxy for research quality.

    CiteScore is Elsevier’s Scopus-based journal metric, calculated by dividing the citations a title receives in a calendar year by the number of documents it published across the preceding four years. Journal Impact Factor (JIF) is Clarivate’s older, narrower equivalent, published annually through the Journal Citation Reports (JCR). Both numbers get quoted constantly in tenure files, funding applications and journal marketing — and both are formally out of step with how research-assessment reform now says journals should be judged.

    What Is the Difference Between CiteScore and Impact Factor?

    The core difference is database, window length, and document scope. CiteScore draws on Scopus and counts citations to every document type — articles, reviews, conference papers, book chapters, data papers and editorial material — over a rolling four-year window. Journal Impact Factor draws on Web of Science and restricts its denominator to “citable items” (chiefly research articles and reviews) over a two-year window, even though its numerator counts citations to all document types.

    That asymmetry in JIF’s own formula — a broad numerator over a narrow denominator — is one of the most persistent, well-documented criticisms of the metric, and is a large part of why CiteScore, introduced by Elsevier in December 2016, was built with a wider document scope from the outset.

    Feature CiteScore Journal Impact Factor
    Provider Elsevier Clarivate
    Underlying database Scopus Web of Science (Journal Citation Reports)
    Citation window 4 years 2 years
    Document types counted All document types Primarily “citable items” (articles, reviews)
    Access Free on Scopus journal pages Requires a JCR subscription
    First introduced December 2016 Concept 1955; JCR published annually since 1975

    How Is Each Metric Calculated?

    CiteScore for year Y equals citations received in Y to documents published in Y-3 through Y, divided by the number of documents published across that same four-year span. Elsevier updates a “CiteScore Tracker” monthly, so the figure moves before the annual snapshot is finalised — a transparency feature JIF does not offer.

    Journal Impact Factor for year Y equals citations received in Y to items published in Y-1 and Y-2, divided by the number of “citable items” published in those same two years. Clarivate publishes the finalised figure once a year through the Journal Citation Reports, alongside a JIF quartile ranking within each subject category.

    • Shorter windows (JIF) react faster to hot topics but are more volatile for low-volume or slow-citing fields.
    • Longer windows (CiteScore) smooth out volatility but can undervalue journals in genuinely fast-moving disciplines.
    • Neither window length is “correct” — both were chosen as engineering trade-offs, not as validated proxies for quality.

    What Do DORA and CoARA Say About Journal-Level Metrics?

    The San Francisco Declaration on Research Assessment (DORA), published in 2012 and now signed by tens of thousands of individuals and organisations across more than 160 countries, states that journal-based metrics — explicitly including Impact Factor — should not be used “as a surrogate measure of the quality of individual research articles, to assess an individual scientist’s contributions, or in hiring, promotion, or funding decisions.” Although DORA’s original text names JIF, the same critique applies directly to CiteScore: both are journal-level averages applied to individual outputs and individual people.

    The Coalition for Advancing Research Assessment (CoARA), launched in 2022 and coordinated with the European University Association, commits its signatories — now numbering hundreds of universities, funders and research organisations — to “abandon inappropriate uses in research assessment of journal- and publication-based metrics, in particular any inappropriate uses of Journal Impact Factor.” CoARA’s Agreement treats CiteScore as falling under the same prohibition, since its ten commitments target the practice of journal-metric substitution for quality judgement, not one specific brand of metric.

    Neither declaration asks institutions to abolish CiteScore or JIF outright. Both ask assessors to stop using either figure as a shortcut for reading, or for judging, the individual piece of work in front of them.

    CiteScore vs Impact Factor: Which Survives Assessment Reform?

    Under DORA and CoARA criteria, neither metric “survives” as a legitimate proxy for individual-level quality — but CiteScore scores better on two specific reform tests: transparency and access. Its underlying Scopus data and monthly tracker are freely visible; JIF’s Web of Science data sits behind a JCR subscription, which is one reason CiteScore is often described as the more auditable of the two.

    Jurisdiction-specific policy already reflects this shift. The UK’s Research Excellence Framework (REF) guidance instructs assessment panels not to use journal-level metrics, including Impact Factor, as a proxy for output quality — panel members are required to read and judge the submitted work itself. Frameworks such as the Leiden Manifesto (2015) and the UK’s Metric Tide review (2015) reach the same conclusion from a different angle: any single citation metric, however calculated, is a partial and gameable signal that needs qualitative context, not a standalone score.

    In practice, most responsible-assessment guidance converges on the same answer: use CiteScore or JIF only as one directional data point about a journal’s citation behaviour — never as a stand-in for peer review, narrative CVs, or discipline-aware qualitative judgement of an individual’s work.

    Common Questions on CiteScore vs Impact Factor

    Which is better, Impact Factor or CiteScore?

    Neither is “better” in absolute terms. CiteScore suits fields with slower citation cycles and full Scopus coverage, while Journal Impact Factor suits comparisons within Web of Science’s narrower, more selective index. Under DORA and CoARA criteria, both are inappropriate substitutes for peer review or individual-level research assessment.

    What is a good CiteScore for a journal?

    A “good” CiteScore is field-relative. Elsevier’s own guidance points assessors toward a journal’s CiteScore Percentile rather than the raw number — a title at the 90th percentile outperforms 90% of journals in its Scopus subject category, which is more meaningful than comparing raw scores across disciplines.

    Is 3.5 a good Impact Factor?

    There is no universal threshold. A 3.5 Impact Factor is strong in fields with slow, sparse citation practices but modest in fast-citing fields such as immunology or oncology. Clarivate’s Journal Citation Reports ranks journals by subject-category quartile, not by a fixed numeric cutoff, for exactly this reason.

    What is a decent CiteScore?

    Elsevier measures this through the CiteScore Percentile: a title in the 96th percentile ranks as high as, or higher than, 96% of journals in its category. Institutions applying DORA principles are advised to cite percentile standing within a discipline rather than treat any single CiteScore value as “decent” in isolation.

    Implications for Institutions and Publishers

    For research administrators, the practical takeaway is procedural, not metric-specific: audit promotion, tenure and funding criteria for language that treats CiteScore or JIF as a quality proxy, and replace it with narrative or portfolio-based evaluation where DORA or CoARA commitments apply — a shift increasingly embedded in research administration standards and workflows. For publishers, transparency about which metric — and which window — is being quoted matters more than which number is higher, since CiteScore and JIF are not interchangeable and a journal can carry a strong figure on one while looking average on the other.

    As more funders and universities formalise CoARA commitments, expect journal-level metrics to persist as directional signals in publisher marketing and library collection decisions, while disappearing — by policy, not by accident — from individual hiring, promotion and grant-review criteria.