Normality of Distribution: How to Check the Normal Distribution Assumption in Research Data

A normal distribution is the symmetric, bell-shaped probability distribution in which values cluster around the mean and taper off equally in both directions. It shows up so often in statistical practice — and so often in the wrong place in a methods section — that “checking for normality” has become one of the most common, and most commonly misunderstood, steps in analyzing research data. This guide covers what the normal distribution actually is, what assumption a normality check is really testing (it is usually not what researchers think), how to assess it properly, and what to do when the assumption does not hold.

What the normal distribution is

The normal (Gaussian) distribution is defined by two parameters: its mean (μ), which sets its center, and its standard deviation (σ), which sets its spread. A variable that is normally distributed has three defining properties:

• Symmetry — the left and right halves of the distribution are mirror images around the mean.
• Mean = median = mode — all three measures of central tendency coincide at the same value, the peak of the curve.
• A fixed spread rule — the 68-95-99.7 (empirical) rule — approximately 68% of values fall within 1 standard deviation of the mean, approximately 95% fall within 2 standard deviations, and approximately 99.7% fall within 3 standard deviations. This rule is what makes the normal distribution useful for setting reference ranges and estimating how unusual an observation is.

See descriptive statistics for how central tendency and dispersion are calculated and reported more generally, and histograms for the standard way to visualize a distribution’s shape before doing anything else with it.

Why the normal distribution recurs: the Central Limit Theorem

The normal distribution is not just one distribution among many — it recurs constantly in statistical practice because of the Central Limit Theorem (CLT). Stated precisely, the CLT says that the sampling distribution of the sample mean approaches a normal distribution as sample size increases, regardless of the shape of the distribution the data were drawn from, provided the underlying distribution has finite variance.

Two things follow from that precise statement that are frequently misstated:

• The CLT is a claim about the sampling distribution of a statistic (typically the mean), not about the distribution of the raw, individual data points. Raw data can be heavily skewed and the CLT still applies to the mean of repeated samples drawn from it.
• The CLT does not say raw data “become normal” with a large enough sample. A skewed variable with 10,000 observations is still skewed; what changes with sample size is how closely the distribution of possible sample means behaves like a normal curve.

This distinction is the single most important thing to get right about normality in applied research, and it is exactly where most explainers of the topic go wrong.

What parametric tests actually assume — and why this matters more than most explainers say

Many parametric procedures (the t-test, ANOVA, linear regression, the Pearson correlation coefficient) are commonly described as “assuming normality.” In practice this is imprecise in a way that leads researchers to test the wrong thing:

• For a one-sample or paired t-test, the relevant assumption is that the sampling distribution of the mean (or mean difference) is approximately normal — not that the raw data are normally distributed.
• For linear regression and ANOVA, the assumption is normality of the residuals (the differences between observed and predicted values), not normality of the outcome variable itself, and certainly not normality of the predictor variables.
• With reasonably large sample sizes, the Central Limit Theorem makes the sampling distribution of the mean approximately normal even when the underlying data are not — which is why parametric tests are described as reasonably robust to violations of normality once n is large. Robustness is a matter of degree, not a fixed cutoff, and it degrades faster with strong skew, heavy outliers, or a genuinely small sample.

The practical consequence: a researcher who runs a normality test on a raw outcome variable before an ANOVA, sees a significant result, and abandons the analysis for a non-parametric alternative may be testing — and reacting to — the wrong distribution altogether. Check what the specific test actually assumes before deciding what to test for normality.

How to assess normality

Assessing normality is best done in two stages: look first, test second — and treat the formal test as one input among several, not the deciding vote.

Visual assessment

• Histogram — the fastest first look at shape, but sensitive to bin width and less reliable at small sample sizes. See the dedicated histogram guide for construction guidance.
• Q-Q (quantile-quantile) plot — plots the quantiles of the observed data against the quantiles expected under a normal distribution. Points falling close to the reference diagonal line indicate approximate normality; systematic curvature indicates skew, and S-shaped or heavy-tailed deviation from the line at the ends indicates kurtosis problems. The Q-Q plot is generally the single best tool for assessing normality visually: it is far less sensitive to sample size and bin-width choices than a histogram, and it shows exactly where and how a distribution departs from normal (in the tails, in the center, or throughout) rather than just giving a pass/fail impression.
• Box plot — less informative about overall shape than a histogram or Q-Q plot, but useful for a quick read on skew (an off-center median line, unequal whisker lengths) and for flagging outliers that a formal test may over-react to.

Formal tests

• Shapiro-Wilk test — the most commonly recommended formal test for normality, and generally considered to have good power relative to alternatives, particularly at small-to-moderate sample sizes. Most statistical software reports it as a default option.
• Kolmogorov-Smirnov (K-S) test / Lilliefors correction — compares the empirical cumulative distribution function to a reference normal distribution; the plain K-S test requires the reference mean and standard deviation to be specified in advance, so when they are instead estimated from the sample (the usual case), the Lilliefors-corrected version is the appropriate variant.
• Anderson-Darling test — a modification of the K-S approach that gives more weight to the tails of the distribution, which is useful because departures from normality often matter most in the tails.

All three return a p-value testing the null hypothesis that the data come from a normal distribution; see what a p-value is and is not before interpreting the result as a simple pass/fail.

Why formal normality tests are widely criticized

Despite their common use, formal normality tests have a well-recognized problem that cuts in both directions at once:

• At small sample sizes, these tests are underpowered — they frequently fail to detect real, meaningful departures from normality precisely when the normality assumption matters most for the validity of a downstream parametric test (small samples get the least protection from the Central Limit Theorem’s large-n robustness).
• At large sample sizes, these tests become highly sensitive and will flag trivial, practically irrelevant deviations from perfect normality as statistically significant — precisely when the assumption matters least, because large-n robustness is already doing the protective work described above.

The practical, well-supported recommendation that follows from this is not to abandon formal tests outright, but not to let one govern the decision either: use a Q-Q plot and histogram as the primary evidence, treat a formal test (typically Shapiro-Wilk) as a supporting data point rather than a binary gatekeeper, and weigh the result against sample size, the magnitude of skew/kurtosis, and how sensitive the specific downstream analysis actually is to non-normality. A large-sample “significant” Shapiro-Wilk result next to a Q-Q plot that looks essentially straight is not, on its own, a reason to switch to a non-parametric test.

Skewness and kurtosis

Skewness and kurtosis are numeric descriptors of distribution shape that complement visual and formal assessment:

• Skewness measures asymmetry (see CASRAI’s guide to skewness: left-skewed vs. right-skewed distributions for how this affects the choice of central-tendency statistic). A normal distribution has skewness of 0; positive skewness indicates a longer right tail, negative skewness a longer left tail.
• Kurtosis measures tail weight relative to a normal distribution. Excess kurtosis of 0 corresponds to a normal distribution’s tails (mesokurtic); positive excess kurtosis (leptokurtic) indicates heavier tails and a sharper peak; negative excess kurtosis (platykurtic) indicates lighter tails and a flatter peak.

A commonly cited rule of thumb treats skewness and excess kurtosis roughly within ±1 as “approximately normal” for many practical purposes, with values beyond roughly ±2 flagged as substantial departure — but these thresholds are conventions repeated across textbooks and software documentation, not fixed statistical laws, and different fields and different sample sizes justify different tolerances. Report the actual skewness/kurtosis values and the sample size alongside any judgment call, rather than only reporting whether a threshold was crossed.

What to do when data are not normal

A confirmed, meaningful departure from normality does not mean the analysis is stuck — there are several established routes forward, each with a different cost:

• Transformations — a log transformation compresses right-skewed data (common for variables like cost, duration, or concentration that cannot go below zero); a square-root transformation is a gentler option often used for count data; the Box-Cox transformation estimates the best power transformation for a given dataset rather than assuming log or square-root is correct. The cost: transformed results are on a transformed scale, which complicates interpretation (a mean difference in log-dollars is not a mean difference in dollars) and requires back-transformation or careful framing when reporting effect sizes.
• Non-parametric alternatives — tests that do not assume a normal distribution, at some cost in statistical power relative to their parametric counterparts when the data genuinely are normal: the Mann-Whitney U test in place of an independent-samples t-test, the Wilcoxon signed-rank test in place of a paired t-test, the chi-square test for categorical association, the Kruskal-Wallis test in place of one-way ANOVA, and Spearman’s rank correlation in place of Pearson’s correlation coefficient.
• Robust statistical methods — approaches such as trimmed means, M-estimators, or robust regression that reduce the influence of outliers and heavy tails without fully abandoning the parametric framework.
• Bootstrapping — resampling the observed data (with replacement) to build an empirical sampling distribution and derive confidence intervals or p-values without assuming any particular parametric form. Especially useful when no standard non-parametric test matches the exact statistic of interest.
• Generalized linear models (GLMs) with an appropriate link function — rather than transforming the outcome and analyzing it on an artificial scale, a GLM models the outcome on its natural scale with a distributional family and link function suited to it (e.g., a log link with a Poisson or negative binomial family for count data, a logit link for binary outcomes). This is often the more principled option when the outcome variable’s natural distribution is clearly non-normal by design (counts, proportions, time-to-event data) rather than through an accidental sampling artifact. See regression analysis for how model assumptions are interpreted and reported more generally.

Reporting normality assessment

A methods section should state how normality was assessed, not simply assert that data “were normally distributed” or “violated the normality assumption” without evidence. A defensible report typically includes:

• Which method(s) were used — e.g., “distribution was assessed via histogram and Q-Q plot, supported by Shapiro-Wilk test.”
• The actual result of any formal test, including the statistic, degrees of freedom (where applicable), and p-value — not just “normality was confirmed/violated.”
• What was done as a result — proceeded with the planned parametric test, applied a specific transformation, or switched to a named non-parametric alternative — and why, given the sample size and the magnitude of the departure observed.

This is the same reporting discipline already expected for other statistical tests: state the method and the actual result, not just a conclusion.

Testing normality in R, Python, and SPSS

• R — shapiro.test(x) runs the Shapiro-Wilk test directly; qqnorm(x) followed by qqline(x) produces a Q-Q plot against a normal reference line.
• Python — scipy.stats.shapiro(x) runs the Shapiro-Wilk test; statsmodels.api.qqplot(x, line='s') (from the statsmodels package) produces a Q-Q plot with a fitted reference line. scipy.stats.skew() and scipy.stats.kurtosis() return the numeric descriptors covered above.
• SPSS — the Explore procedure (Analyze → Descriptive Statistics → Explore, with Normality plots with tests requested) reports the Shapiro-Wilk statistic (for n ≤ 50 by default) and the Kolmogorov-Smirnov (Lilliefors-corrected) statistic side by side, along with a Q-Q plot and boxplot.

Frequently asked questions

Does my raw data need to be normally distributed to run a t-test?

Not exactly. The formal assumption concerns the sampling distribution of the mean (or mean difference), not the raw data. With a reasonably large sample, the Central Limit Theorem makes this approximately true even when the raw data are skewed, which is why t-tests are considered fairly robust to non-normal raw data at larger sample sizes.

Which is better: a histogram or a Q-Q plot?

A Q-Q plot is generally the more informative single tool — it is less sensitive to bin-width and sample-size artifacts than a histogram, and it shows precisely where a distribution departs from normal (tails vs. center). A histogram is still useful as a quick, intuitive first look, especially for a non-statistical audience.

Should I trust a non-significant Shapiro-Wilk result and stop checking?

Not on its own, especially at small sample sizes, where the test is underpowered and can miss real departures from normality. Pair it with a visual check (Q-Q plot, histogram) rather than relying on the p-value alone in either direction.

My sample is small and skewed — should I transform it or switch to a non-parametric test?

Both are defensible; the right choice depends on the field’s conventions, whether the transformed scale is interpretable for the audience, and whether a well-established non-parametric equivalent exists for the specific comparison being made. Whichever is chosen, report the decision and the reasoning.

Is skewness of exactly 0 required for data to be treated as “normal enough”?

No. Skewness and kurtosis near 0 are expected under normality, but small departures are normal sampling variation, not evidence of a meaningfully non-normal distribution. Commonly cited tolerance ranges (roughly ±1) are conventions, not fixed cutoffs.