Survey Research & Questionnaire Design
Surveys are simple to distribute and easy to design badly. This sub-cluster covers the mechanics that separate a defensible survey instrument from a flawed one: questionnaire design (question wording, ordering, and response-option construction), Likert-scale construction and analysis, response-rate management, and sampling-frame design — deciding who the survey can reach and what that implies about who it can generalize to. It complements the sampling and measurement sub-clusters above with the specific practicalities of the survey instrument as a data-collection tool.
Guides
Likert Scale: Construction, Examples & Analysis
How to build a Likert item or scale correctly — unipolar vs. bipolar, how many response points, worked example items, and the ordinal-vs-interval analysis debate.
Closed-Ended Questions in Research: Types & Examples
Closed-ended survey questions explained: what they are, closed vs. open-ended, the six main types (dichotomous, multiple choice, Likert, rating, ranking, checklist) with worked examples, when to use each, and how to code the data.
Best-Worst Scaling: Case 1, 2, and 3 Designs
Best-worst scaling has three distinct case designs, each measuring something different. This guide distinguishes object, profile, and multi-profile BWS, works a Case 1 choice task end to end, and covers counting-based versus modeled (logit/HB) analysis.
Non-Response Bias: How to Measure It and What to Report
Response rate is a weak proxy for non-response bias. Three measurement procedures — wave analysis, a non-respondent follow-up sub-sample, and benchmark comparison — plus AAPOR RR1-RR6 reporting and the exact limitations wording reviewers expect.
Semantic Differential Scale: Construction, Scoring & When to Use It
Constructing valid bipolar adjective pairs, Osgood’s evaluation/potency/activity structure, scoring conventions, and when a semantic differential beats a Likert item.
Survey Question Types: A Practical Guide with Examples
A worked-example catalogue of survey question types: multiple choice and multi-select, dichotomous, category, filter/skip-logic, Likert/rating/ranking, matrix, open-ended, demographic, and attention-check items, with a quick-reference table.
American Community Survey Data: Guide to Estimates, Margins of Error, and the Census API
A guide to American Community Survey data for researchers, covering 1-year vs. 5-year estimates, margin of error formulas, Census API access, and PUMS.
Survey Experiment: Definition, Types and How to Analyse One
What a survey experiment is, the main types (list, endorsement, conjoint), a worked list-experiment calculation, and how to analyse and report one.
American Community Survey PUMS: What It Is and How to Use the Microdata
What ACS PUMS microdata contain, which weight to use, and how to compute standard errors and margins of error with replicate weights, with a worked example.
Survey of Professional Forecasters: How It Works and How to Use It
What the Survey of Professional Forecasters is, who answers, when it is released, how to read its mean, median and probabilities, and how to cite it.
World Bank Enterprise Surveys: Design, Weights and Data Access
What the World Bank Enterprise Surveys are, how formal, informal and micro surveys are sampled and weighted, and how to access and cite the data.
Matrix Question Examples: Survey Design & Scoring
Matrix question examples with survey layouts, platform options, composite scoring formulas, and straightline checks with Excel, R, and Python code.
Housing Survey: The American Housing Survey (AHS) Explained
The American Housing Survey: who runs it, how its samples changed since 1973, what it measures, when data are released and how to weight microdata.
Nominal Survey Questions: Definition, Examples and Analysis
What a nominal survey question is, real CDC BRFSS examples, how it differs from ordinal and yes/no items, and how to tabulate and report the answers.
National Crime Victimization Survey (NCVS): Design, Data and Limits for Researchers
How the National Crime Victimization Survey is designed, what it covers, how to read its rates, and where researchers get NCVS data.
Good Survey Questions: Rules, Bad-to-Good Rewrites, Examples
Rules for writing good survey questions, with five annotated examples and a sourced bad-to-good rewrite table for research instruments.
Dichotomous Survey Questions: Design and Analysis
Guide to dichotomous survey questions: when to use binary choices, wording pitfalls, acquiescence bias, coding methods, and practical research examples.
Commodity Flow Survey (CFS): Design, Variables and Data Access
What the U.S. Commodity Flow Survey measures, how it samples establishments, and where researchers get and cite its microdata.
Mutually Exclusive Survey Questions: Definition, Examples and How to Fix Overlaps
Mutually exclusive survey questions let each respondent pick only one option. Learn the test, a computed overlap audit and Excel, R and Python checks.
Quantitative Survey Question Examples: Real Items and How to Code Them
Quantitative survey question examples quoted from the CDC BRFSS, with response codes, a worked mean and SD, and Excel, R and Python code.
Examples of Ordinal Survey Questions (With Real Items From CDC Surveys)
Examples of ordinal survey questions quoted from CDC BRFSS and NHIS: health ratings, education, income bands, plus coding traps and how to analyze them.
Panel Survey: Definition, Attrition and Weighting
A panel survey re-interviews the same people over several waves. See how panels are recruited and weighted, and compute retention with a worked example.
Advantages and Disadvantages of Surveys: What the Evidence Shows
Advantages and disadvantages of surveys, each tied to a named source of error: wording, order, social desirability, coverage and nonresponse.
Survey Fatigue: Definition, Evidence, and How to Measure It
Survey fatigue is lower answer quality or early quitting as a survey goes on. Learn the indicators, a worked example and what the evidence shows.
Detecting Careless Responding: Straightlining, Speeding, and Attention Checks
How to detect careless or insufficient-effort survey responses using straightlining/long-string indices, response-time (speeding) thresholds, and attention checks — and how to turn a flag into a defensible, pre-registered exclusion rule rather than a post-hoc judgment call.
Dillman’s Tailored Design Method: The Contact Sequence Behind Higher Survey Response Rates
How Dillman’s Tailored Design Method uses a coordinated five-contact sequence, social exchange theory, and small prepaid incentives to raise mail and web survey response rates — and how the sequence adapts to email/web administration.
Survey Mode Effects: Selection vs. Measurement Effects in Mixed-Mode Design
Mixed-mode surveys combine mode selection effects (who chooses which mode) with mode measurement effects (how the mode itself changes answers). This guide covers unimode vs. mode-specific instrument design and how to separate the two effects.
Question Order Effects: Priming, Contrast, and How to Test for Them
Priming, assimilation, and contrast are three distinct question-order mechanisms, not one — this guide separates them, walks through the classic part-whole case, and gives the split-ballot design and statistical test for detecting order effects in a real questionnaire.
CHERRIES Checklist: Reporting Results of Internet E-Surveys
CHERRIES is the 8-category checklist for reporting internet e-survey results, covering design, ethics, administration, and the view/participation/completion-rate definitions authors most often get backwards.
Skip Logic and Branching in Questionnaire Design
Designing and documenting survey skip logic and branch conditions: avoiding orphaned items, routing on stable field IDs rather than question position, and how filter questions change the reporting denominator.
Survey Weighting: Design Weights, Post-Stratification, and Raking
Design weights correct for unequal selection probability, post-stratification corrects for a known population-margin mismatch, and raking (iterative proportional fitting) matches several margins at once without a joint population table. This guide separates the three, shows when each is needed, and works a seeded, reproducible simulation through all three plus the resulting design effect and weight trimming.
Thurstone Scaling: Equal-Appearing Intervals and Judge Ratings
Thurstone scaling (equal-appearing intervals) uses a judge panel to rate statement favorability; the median becomes the scale value and the semi-interquartile range (Q) flags ambiguous items. It is Likert scaling’s direct historical predecessor — and the judge-panel labor it requires is exactly why Likert’s simpler respondent-rated method displaced it in practice.
Conjoint Analysis for Research Surveys: Profiles, Utilities, and Relative Importance
How to build attribute-and-level profiles, collect ranking/rating data, estimate part-worth utilities with dummy-variable regression, and calculate relative importance — with every number in the worked example independently computed.
Discrete Choice Experiments: Attributes, Levels, and Experimental Design
How to select attributes and levels, construct choice sets with a fractional factorial or D-efficient design, and analyze the results with conditional logit — including a fully worked, independently computed design and analysis example.
Translation and Back-Translation of Research Instruments
Forward translation, reconciliation, and back-translation catch linguistic errors — but a linguistically perfect back-translation doesn’t prove the instrument still measures the same thing in the new language. That’s what cognitive debriefing with target-population respondents is for.
Guttman Scaling: Cumulative Items, Scalogram Analysis, and the Coefficient of Reproducibility
How Guttman scaling orders cumulative items, scores a scalogram, and uses the coefficient of reproducibility (and scalability) to test whether a scale is genuinely unidimensional, with a fully worked example.
Cognitive Interviewing: Think-Aloud vs. Verbal Probing for Questionnaire Pretesting
Think-aloud and verbal probing are the two core cognitive interviewing techniques for catching a survey item’s comprehension problems before fielding. This guide gives a real probe bank by probe type and the actual decision rule for how many interview rounds are enough.
Leading Questions in Surveys: How to Spot Them and Write Neutral Rewrites
A practical diagnostic for spotting a leading survey question — embedded assumption, loaded framing, or one-sided response options — with before/after neutral rewrites across five question formats and a reviewer checklist.
Acquiescence Bias: Balanced Scales, Reverse-Coding, and Its Real Cost
Acquiescence bias (yea-saying) inflates agree/disagree survey responses. Balanced, reverse-coded scales make it detectable — but reverse-coding brings its own costs: respondent confusion and a spurious wording factor in your factor analysis. This guide covers the mechanism, the fix, how to detect acquiescence in data you already collected, and how to weigh the reverse-coding tradeoff.
Double-Barrelled Questions: How to Spot and Split Them
A double-barrelled survey item asks two things at once but allows only one answer. This guide gives the and/or diagnostic test for spotting one, plus worked before/after rewrites across Likert, yes/no, and frequency question types.
Likert Scale Survey Design & Statistical Analysis Guide
How to design and analyse Likert data: the difference between a Likert item and a Likert scale, how 5-point, 7-point and forced-choice formats behave, and when the ordinal-versus-interval question decides between non-parametric and parametric tests.
Questionnaire Design: Writing Survey Questions That Work
A construction guide to the questionnaire-design decisions that determine data quality: question wording, response-option and Likert scale design, question order, sensitive-question handling, pretesting, and the scale-vs-independent-items distinction.







