Skip to main content
v2026.11,986 entries · CC-BY 4.0

Direct comparison

Reliability vs Validity: Differences & Examples

Reliability is consistency, validity is accuracy. A reliable measure can still be invalid. See a side-by-side table, dartboard examples and how to test each.

Written and maintained by CASRAI Editorial Board

Last updated

How do Reliability and Validity compare side by side?

The table below compares Reliability and Validity across 12 dimensions, from core question to commonly cited benchmark.

Side-by-side comparison

DimensionReliabilityValidity
Core questionDoes this give the same result every time, under the same conditions?Does this actually capture the construct it claims to measure?
What it measuresConsistency / precision of scoresAccuracy / meaningfulness of scores relative to the target construct
Dartboard illustrationHow tightly the darts cluster together, wherever they landWhether the average landing position sits on the bullseye (the true value)
Evidenced statistically byCronbach's alpha, intraclass correlation (ICC), test-retest correlation, Cohen's/Fleiss' kappaContent Validity Index (CVI), CFA factor loadings/fit, convergent & discriminant correlations, criterion correlations
SubtypesInternal consistency, test-retest, inter-rater, parallel-formsFace, content, construct, criterion (measurement); internal, external, statistical-conclusion (design)
Main threatsAmbiguous item wording, rater inconsistency, situational noise, instrument driftConstruct underrepresentation, construct-irrelevant variance, confounding, poor operationalization
Relationship to the otherA precondition for validity — an unreliable measure cannot be highly validBounded above by reliability, but reliability alone never guarantees it
Can be high while the other is lowYes — a consistently biased instrument is reliable but not validNot in any robust sense — classical test theory caps it near the square root of reliability
CASRAI deep-diveReliability in Research: What It Means and How to Assess ItTypes of Validity in Research: Measurement Validity vs Design Validity
Everyday exampleA kitchen scale that shows the same weight on every weighing of the same bag of flourA scale whose readings match a certified reference weight
Failure caseScores swing between sessions even though nothing about the person changedA scale that consistently reads 500 grams too heavy is reliable but not valid
Commonly cited benchmarkPublished guidance on acceptable Cronbach's alpha spans roughly 0.70 to 0.95; very high values can signal redundant items (Tavakol and Dennick, 2011). Alpha is not a validity measureNo single cutoff; judged from the accumulated evidence for the intended interpretation of the scores

Ask CASRAI · free to try

Ask about Reliability vs Validity: Differences & Examples

2 free questions a day, no account.

An AI assistant for research: funder rules, compliance, methods and publishing. It links the sources behind its answers and labels answers that come from a web search.

Answers draw on CASRAI's guides and dictionary plus the federal and funder documents we index: Federal Register, Grants.gov, Regulations.gov and UKRI.

Works on this site and inside Claude, Cursor and the AI tools you already use.

Everything CASRAI publishes — this page, the dictionary, the guides and the news — stays open to read, with no account and no card.

Common questions

Common questions about Reliability vs Validity

Can a measurement be reliable but not valid?

+

Yes, and it is the most common way the two get confused. A blood-pressure cuff that is miscalibrated to read consistently 8 mmHg high gives nearly identical readings every time (high reliability) while every reading is wrong (low validity).

Can a measurement be valid but not reliable?

+

Not in any single administration. Classical test theory bounds a measure's correlation with a true criterion at roughly the square root of its reliability coefficient, so a genuinely unreliable instrument cannot show strong validity. The only approximation is aggregate: if many independent raters' errors are close to random, their averaged rating can approach the true score even though no individual rating in the set is trustworthy on its own.

Which matters more, reliability or validity?

+

Validity is the actual goal — a measurement exists to capture something real. But reliability is a prerequisite for demonstrating validity, and researchers report both because a validity coefficient is uninterpretable without knowing how reliable the underlying instrument is.

How do you report both in a methods section?

+

Report the reliability coefficient(s) used (e.g., Cronbach's alpha, ICC, test-retest r) alongside the type and evidence of validity claimed (e.g., criterion correlation against a validated instrument, CFA fit statistics). Reporting validity evidence without the reliability it depends on leaves the reader unable to judge how trustworthy the validity claim is.

Is reliability a type of validity?

+

No — classical test theory treats them as distinct properties, though some newer measurement-property frameworks (e.g., COSMIN, used for health-outcome instruments) group reliability under a broader validity/quality umbrella. On CASRAI, and in most research-methods teaching, they are kept separate because they answer different questions and use different statistics.

What is the difference between reliability and validity in research?

+

Reliability is consistency: a reliable instrument gives similar results when the measurement is repeated under the same conditions. Validity is accuracy of meaning: a valid instrument measures the construct it claims to measure. A measure can be reliable without being valid, but it cannot be valid if it is not reliable (see the Wikipedia overview of reliability in statistics: https://en.wikipedia.org/wiki/Reliability_(statistics)).

Is accuracy reliability or validity?

+

In the usual dartboard picture, accuracy corresponds to validity (the darts land on the bullseye on average) and consistency corresponds to reliability (the darts cluster tightly, wherever they land). Tight clusters off-target are reliable but not valid.

What is a good Cronbach's alpha for reliability?

+

Published guidance gives an acceptable range of roughly 0.70 to 0.95, with values near the top of that range possibly indicating redundant items (see Tavakol and Dennick, https://pmc.ncbi.nlm.nih.gov/articles/PMC4205511/). Alpha also should not be read uncritically: high values can occur in multidimensional data, so it supports reliability but says nothing about validity (https://en.wikipedia.org/wiki/Cronbach%27s_alpha).

Referenced across the research world

University of Cambridge logoColumbia University logoCrossref logoUniversity of Edinburgh logoHarvard University logoUniversity of Oxford logoPrinceton University logoStanford School of Medicine logoUniversity College London logoORCID logoUniversity of Cambridge logoColumbia University logoCrossref logoUniversity of Edinburgh logoHarvard University logoUniversity of Oxford logoPrinceton University logoStanford School of Medicine logoUniversity College London logoORCID logo
  • University of Cambridge logo
  • Columbia University logo
  • Crossref logo
  • University of Edinburgh logo
  • Harvard University logo
  • University of Oxford logo
  • Princeton University logo
  • Stanford School of Medicine logo
  • University College London logo
  • ORCID logo

View CASRAI adoption →