Rigor and Transparency Index (RTI)

The Rigor and Transparency Index (RTI) is the average SciScore — an automated score of methods-rigor and resource-identification reporting — across a journal's or institution's articles in a given year, published by SciCrunch as a benchmarking metric for reporting quality. It is calculated independently of citation-based metrics such as Journal Impact Factor and is meant to be compared only within the same field or subfield.

ByCASRAI Editorial Board

· Last updated 18 Jul 2026

The Rigor and Transparency Index (RTI) is a journal-level (and, more recently, institution-level) rigor score published by SciCrunch, calculated as the average SciScore across all research articles from a given journal in a given year. SciScore is an automated text-mining tool that scans a manuscript’s methods section against a fixed set of NIH-aligned rigor criteria (randomization, blinding, sample-size/power reporting, sex as a biological variable) and resource-identification criteria (whether antibodies, cell lines, organisms, plasmids, and software are cited with a resolvable RRID). The RTI aggregates those per-article scores into a single number that lets a journal, publisher, or institution track reporting quality over time and compare itself against other journals in the same field.

Origin and evidence base

The RTI was introduced by Joe Menke, Martijn Roelandse, Burak Ozyurt, Maryann Martone, and Anita Bandrowski in “The Rigor and Transparency Index Quality Metric for Assessing Biological and Medical Science Methods,” published in the Cell Press journal iScience in October 2020. A follow-up 2022 study in the Journal of Medical Internet Research, “Establishing Institutional Scores With the Rigor and Transparency Index: Large-scale Analysis of Scientific Reporting Quality,” extended the method to institutions and reported the underlying analysis by then covered more than 1.5 million research articles — described by the authors as the largest methods-reporting analysis performed to that point.

Operational definition

A score is properly called an RTI, rather than a generic “quality score” or a raw SciScore for a single paper, if it meets all of the following:

It is the average SciScore across a defined population of articles — a journal’s output in a calendar year, a publisher’s full catalog, or (in the institutional-score variant) all articles carrying a given institutional affiliation — not the score of one individual manuscript.
The underlying per-article scores come from SciCrunch’s own SciScore text-mining pipeline scoring the NIH rigor criteria and RRID resource-identification criteria, not from a manual audit, a journal’s self-reported checklist compliance rate, or a different rigor tool such as the MDAR framework checklist.
It is reported at the aggregate (journal/publisher/institution/year) level and is intended for benchmarking and trend-tracking, not as a per-article decision gate the way an individual SciScore report is used in a submission workflow.

What it is not

The RTI is not a measure of a journal’s citation impact, prestige, or acceptance rate, and the original 2020 iScience paper reports no meaningful correlation between RTI and Journal Impact Factor — the two capture different things. It is also not a substitute for peer review or a certification that any individual article is free of reporting problems: a high RTI reflects that a journal’s articles, on average, disclose more of the rigor and resource-identification criteria SciScore checks for, not that the underlying research is methodologically sound. SciCrunch’s own guidance is that RTI scores should be compared within the same field or subfield (for example, cell biology journals against other cell biology journals), since reporting norms and applicable criteria vary substantially across disciplines — comparing RTI across unrelated fields is a common misuse of the metric.

Examples

A biomedical publisher tracks the RTI of each of its journals year over year, using a rising or falling trend as one input — alongside editorial and reviewer feedback — into decisions about whether author guidelines or reviewer training need updating.
A university research office reviews an institutional RTI, drawn from SciCrunch’s institution-level analysis, as one line of evidence in a broader conversation with faculty about methods-reporting practices, not as a standalone performance metric for any individual researcher.

Counter-example

A journal with a high citation count or a strong Journal Impact Factor is not thereby assumed to have a high RTI. The two metrics are calculated independently and, per the 2020 iScience paper, show no meaningful correlation with each other — a journal can rank well on one and poorly on the other.

Related terms

SciScore — the underlying per-article scoring tool the RTI aggregates.
RRID (Research Resource Identifier) — one of the resource-identification criteria SciScore checks for.
NIH Rigor and Reproducibility policy — the source of several of the rigor criteria SciScore scores against.

Use in your systems

JATS XML <role> element

xml

<role vocab="credit"
      vocab-identifier="https://casrai.org/dictionary/"
      vocab-term="Rigor and Transparency Index (RTI)"
      vocab-term-identifier="https://casrai.org/dictionary/term/rigor-and-transparency-index-rti" />

Schema.org DefinedTerm (JSON-LD)

json

{
  "@context": "https://schema.org",
  "@type": "DefinedTerm",
  "@id": "https://casrai.org/dictionary/term/rigor-and-transparency-index-rti",
  "name": "Rigor and Transparency Index (RTI)",
  "identifier": "https://casrai.org/dictionary/term/rigor-and-transparency-index-rti",
  "description": "The Rigor and Transparency Index (RTI) is the average SciScore — an automated score of methods-rigor and resource-identification reporting — across a journal's or institution's articles in a given year, published by SciCrunch as a benchmarking metric for reporting quality. It is calculated independently of citation-based metrics such as Journal Impact Factor and is meant to be compared only within the same field or subfield.",
  "inDefinedTermSet": "https://casrai.org/dictionary/domain/reproducibility#set",
  "url": "https://casrai.org/dictionary/term/rigor-and-transparency-index-rti",
  "sameAs": [],
  "license": "https://creativecommons.org/licenses/by/4.0/",
  "publisher": {
    "@id": "https://casrai.org/#organization"
  },
  "dateModified": "2026-07-18T06:30:47",
  "inLanguage": "en"
}