FAIR data assessment frameworks: a buyer’s guide…

The FAIR Principles (Findable, Accessible, Interoperable, Reusable) were published in 2016 and have become the dominant framework for talking about research-data quality. The harder problem – measuring whether a particular dataset, repository, or institutional output is actually FAIR – has produced a small ecosystem of assessment frameworks. In 2026 there are five we recommend institutions consider, and they answer slightly different questions. This post is the practical buyer’s guide.

The five frameworks that matter

The frameworks differ along two axes: what they assess (a single dataset, a repository, an institution’s overall position) and how they assess (automated against metadata, structured self-assessment, third-party audit). A well-equipped institution uses two or three of them for different purposes.

RDA FAIR Data Maturity Model

The RDA FAIR Data Maturity Model, finalised by the RDA working group in 2020, is the canonical indicator framework. It defines 41 indicators across the four FAIR pillars, each at one of four maturity levels (essential, important, useful, neutral). It does not prescribe the assessment method; it provides the rubric.

The Maturity Model is the most-cited framework in funder documents and is the de-facto common reference for FAIR assessment. Its strength is interoperability: a tool that calculates against the RDA indicators produces results comparable across institutions and disciplines. Its weakness is that the indicators are abstract; turning them into operational checks requires a tool.

F-UJI

F-UJI (FAIRsFAIR Research Data Object Assessment Service), developed by FAIRsFAIR and PANGAEA, is the most-used automated assessment tool. F-UJI takes a single dataset identifier (typically a DOI), retrieves its metadata, and runs a battery of automated checks against the RDA Maturity Model indicators. It produces a numeric FAIR score and a detailed report.

F-UJI is genuinely useful for dataset-level assessment because it actually fetches and tests the metadata. It catches real failures (missing licence, missing schema declaration, dead landing-page links) that self-assessment tools miss. Its limits are also real: it can only check what is machine-discoverable, so a dataset can score well on F-UJI and still be unusable in practice if the documentation is poor. As of 2026 F-UJI is available as a hosted service and as a self-deployable container.

FAIR-Aware

FAIR-Aware, developed by DANS, is a structured self-assessment tool aimed at researchers who are about to deposit a dataset. It asks ten questions about the dataset’s intended preparation and produces guidance on which FAIR principles are being met and which need work. FAIR-Aware is pedagogical rather than evaluative: its purpose is to nudge depositors into thinking about FAIR before they deposit, not to score them afterwards.

FAIR-Aware is the right tool when an institution is trying to improve deposit quality and researcher FAIR literacy. It is the wrong tool when the question is “how FAIR are our existing holdings.”

CESSDA self-assessment

The CESSDA FAIR self-assessment, oriented toward social-science data archives, is closer to a structured repository audit. It asks the repository to evidence its compliance against a published framework that maps to the RDA indicators. CESSDA is interesting because it is discipline-specific: it knows that social-science data has particular consent, sensitivity, and harmonisation patterns and asks questions sensitive to those.

ARDC FAIR Framework

The Australian Research Data Commons FAIR framework, developed for the Australian context with funder backing, includes a self-assessment, a checklist for repository operators, and a benchmark for institutional services. The ARDC framework’s strength is that it has been operationalised at scale across Australian universities; its principles translate well but its administrative artefacts are Australia-specific.

The institutional decision tree

A reasonable institutional approach in 2026 looks like this:

For overall institutional position: use the RDA Maturity Model as the reference framework. Cite it in policy documents, training materials, and funder reports. It is the common language.
For deposit-time researcher guidance: deploy FAIR-Aware (or your repository’s built-in equivalent) at the deposit interface. The goal is researcher behaviour change, not measurement.
For periodic dataset-quality auditing: run F-UJI against a representative sample of your repository holdings on a quarterly cycle. Use the results to drive metadata quality improvements at the repository level.
For repository certification: pursue CoreTrustSeal certification for any repository whose data underlies cited research outputs. CoreTrustSeal is more rigorous and more useful externally than the FAIR self-assessments.
For discipline-specific work: layer the relevant disciplinary framework (CESSDA for social sciences, the FAIRsharing community standards for life sciences, etc.) on top of the generic frameworks.

What the frameworks miss

The frameworks all do well at the F (Findable) and A (Accessible) pillars because these map well to machine-checkable metadata. They do less well at I (Interoperable) and R (Reusable) because interoperability and reusability depend on context that automated tools cannot evaluate (is the data dictionary actually meaningful? do the controlled vocabularies match the relevant community standards? would another researcher in this field find the documentation sufficient?).

The mitigation is to pair automated assessment with structured peer review of high-value datasets. F-UJI tells you the metadata is well-formed; a peer review tells you the data is actually useful. The institutional practice we have seen working is to run F-UJI quarterly and to commission peer-data-reviews of the institutionally-flagged “strategically important” datasets annually.

FAIR assessment and CoreTrustSeal

CoreTrustSeal certification is the closest thing to an external audit of a repository’s trustworthiness. It is more rigorous than FAIR self-assessment because it requires a substantive submission and an external review. It covers governance, sustainability, technical infrastructure, data quality, and discoverability. By 2026 most major institutional and disciplinary repositories are CoreTrustSeal-certified; the certification is increasingly required in funder data-management requirements.

CoreTrustSeal and FAIR assessment are complementary. CoreTrustSeal asks “is this repository a trustworthy place to deposit data?”; FAIR assessment asks “are the datasets in this repository FAIR?” An institution should be able to answer yes to both.

Integration with the institutional CRIS

The 2024-2025 development that has changed institutional practice is the integration of FAIR assessment into the institutional CRIS. Pure, Elements, Converis, and DSpace-CRIS now ship modules that show FAIR scores for each dataset record, computed from the underlying repository deposit. The institutional dashboard can then aggregate (overall FAIR score by department, by year, by funder), spot drift, and flag low-scoring records for improvement.

The pattern that works is: institutional repository (DSpace, Figshare, Dataverse) exposes dataset metadata; CRIS pulls the metadata daily; F-UJI runs against new and updated records; FAIR score is written back to the CRIS record; institutional dashboards consume the score. The total effort is moderate (a sprint of integration work) and the resulting visibility is genuinely useful.

The funder-mandate angle

FAIR assessment is increasingly cited explicitly in funder mandates. HORIZON Europe requires FAIR data management; NIH’s 2023 DMS policy uses FAIR language; UKRI references FAIR in its open-research statement. The mandates rarely specify how FAIR is to be assessed, which gives institutions latitude but also creates ambiguity at audit time.

Our recommendation to institutions is to declare in your data policy which framework you use (the RDA Maturity Model is the safe choice as the common reference), which tooling you operate (F-UJI for automation, FAIR-Aware for researcher guidance, CoreTrustSeal for repository certification), and what your service-level commitment is to researchers depositing data. The reporting back to funders then has a documented basis.

What to watch in 2026-2027

The convergence work to watch is the FAIR Implementation Profiles (FIPs) approach, in which a community or institution declares its specific choices for each FAIR principle (which PID system, which metadata schema, which licence, which controlled vocabulary). FIPs are being piloted across EOSC and are likely to become the operational layer between the abstract FAIR principles and the per-dataset assessment. By 2027 we expect FAIR assessment tools to consume FIPs as configuration: “assess this dataset against the GO FAIR Life Sciences FIP” will be a meaningful operation.

References

Wilkinson et al., The FAIR Guiding Principles for scientific data management and stewardship (Scientific Data, 2016). RDA FAIR Data Maturity Model Working Group, final report (2020). Devaraju and Huber, F-UJI: An automated FAIR data assessment tool (FAIRsFAIR / PANGAEA, 2021). CoreTrustSeal Board, Trustworthy Data Repositories Requirements (current version). DANS, FAIR-Aware tool documentation.