Skip to main content
v2026.11,610 entries · CC-BY 4.0
Topic cluster

Research Methods & Statistics

A working reference for research methodology: choosing a study design, calculating sample size and power, running quantitative and qualitative analysis, and establishing measurement validity.

Ask about Research Methods & Statistics

Answers are drawn from this topic and the rest of the CASRAI corpus, with a link to every source.

Answers are AI-generated from CASRAI’s own published pages and can be wrong, so check the linked sources before relying on one; your question is logged without personal data — never sold, never used to train a third-party model — to show us what CASRAI is missing, so please do not type personal or confidential details. How we use this

Research methodology is the set of decisions that determine what a study can legitimately claim. Those decisions are made in a specific order, and each one constrains the next: the research question shapes the design, the design determines what analysis is appropriate, and the quality of measurement bounds what any analysis can recover. A study with an elegant statistical model built on an unvalidated instrument is not a strong study; it is a precise answer to an unreliable question.

This section is organised around that sequence rather than around statistical techniques in isolation. It is written for researchers designing and defending their own studies, and for the research administrators, reviewers and methodologists who assess them.

How this section is organised

Eight sub-sections follow the arc of a study from design through analysis and reporting:

  • Study design — randomised controlled trials, cohort and case-control studies, cross-sectional and longitudinal designs, and quasi-experimental approaches, with the validity threats specific to each.
  • Sampling and statistical power — power analysis and sample size calculation before data collection, and the sampling strategies that determine what a sample can generalise to.
  • Quantitative analysis — regression, ANOVA, t-tests, confidence intervals, effect sizes, and the assumptions each technique depends on.
  • Qualitative methods — thematic analysis, grounded theory, phenomenology and ethnography, with the rigour criteria qualitative work is judged against.
  • Research paradigms and mixed methods — the ontological and epistemological assumptions underneath any chosen method, and how quantitative and qualitative strands are combined.
  • Measurement, reliability and validity — whether an instrument measures what it claims to, including internal consistency, test–retest reliability and instrument development.
  • Survey research — questionnaire construction, scale design, response rates and sampling frames.
  • Methods fundamentals — the orienting vocabulary that the sub-sections above build on.

Where evidence synthesis lives

Systematic reviews, meta-analysis, scoping reviews and PRISMA reporting are covered under Scholarly Publishing, in its evidence-synthesis section, rather than duplicated here. Evidence synthesis is a form of secondary research with its own reporting standards and publication conventions, and it sits more naturally alongside publication practice than alongside primary study design.

Method choice is a reporting obligation, not just a design one

Most reporting guidelines are organised by study design: CONSORT for randomised trials, STROBE for observational studies, PRISMA for systematic reviews, ARRIVE for animal research. Choosing a design therefore also chooses the checklist a manuscript will be assessed against, and increasingly the checklist a funder or journal requires at submission. Pages in this section note the applicable reporting standard alongside the method itself, because in practice the two are inseparable.

Last reviewed:

Referenced across the research world

University of Cambridge logoColumbia University logoCrossref logoUniversity of Edinburgh logoHarvard University logoUniversity of Oxford logoPrinceton University logoStanford School of Medicine logoUniversity College London logoORCID logoUniversity of Cambridge logoColumbia University logoCrossref logoUniversity of Edinburgh logoHarvard University logoUniversity of Oxford logoPrinceton University logoStanford School of Medicine logoUniversity College London logoORCID logo
  • University of Cambridge logo
  • Columbia University logo
  • Crossref logo
  • University of Edinburgh logo
  • Harvard University logo
  • University of Oxford logo
  • Princeton University logo
  • Stanford School of Medicine logo
  • University College London logo
  • ORCID logo

View CASRAI adoption →