Written and maintained by CASRAI Editorial Board
Last updated
A qualitative audit trail is the documentation that lets someone else follow how you got from raw data to reported findings. It is the concrete evidence behind the dependability criterion in Lincoln and Guba’s trustworthiness framework, and it does double duty for confirmability: a reviewer who can trace a specific finding back through your coding decisions to the raw transcript is checking both that your process was sound and that your conclusions are grounded in data rather than invented. This guide is a working checklist for what actually belongs in an audit trail, and — the part most methods texts skip — how to summarize that trail in a manuscript or dissertation without publishing the entire thing.
What an audit trail is, and what it is not
An audit trail is not your raw dataset by itself, and it is not a single document. It is the accumulated record of decisions and process across a study: what you collected, what you noticed while collecting it, what you concluded and why, and how your coding scheme changed as you worked. A reviewer conducting a dependability check — sometimes called an inquiry audit or dependability audit, the term Lincoln and Guba used in Naturalistic Inquiry (Sage Publications, 1985) — is not re-analyzing your data to see if they get the same answer. They are examining whether your process was consistent, deliberate, and defensible given accepted qualitative practice, and whether the trail itself is complete enough to make that judgment at all.
That distinction matters for what you keep. A trail built only to survive your own committee defense looks different from one built to survive an external audit, and the second standard is the one worth building to, because it is the one that actually satisfies the criterion.
The audit-trail checklist: four categories to keep
Most guidance on this gestures at “keep your documentation” without saying what that means concretely. In practice, a defensible qualitative audit trail has four distinct components. Treat this as a running checklist from the start of data collection, not something assembled retroactively after analysis is done — a trail reconstructed from memory after the fact is exactly the kind of gap an external audit is designed to catch.
1. Raw data and its chain of custody
- De-identified transcripts, field notes, and any documents or artifacts used as data, each with a stable, unique identifier (participant/site code, not a name).
- A record of collection dates, locations, and any deviations from the protocol as written (a rescheduled interview, a site substitution, a shortened session) — deviations are normal; an undocumented deviation is what erodes dependability.
- Version history for anything that was transcribed or translated: who transcribed it, when, and what quality-check step (if any) was applied.
- Consent documentation and a note of what was redacted or altered for de-identification, so a later reader understands why a transcript doesn’t match the original recording verbatim.
2. Process notes (the methodological log)
- A running log of methodological decisions as they were made: why a sampling frame was adjusted, why an interview question was reworded partway through data collection, why a site or participant was added or dropped.
- Changes to the interview guide or observation protocol, dated, with the reason for each change — not just the final version.
- Notes on saturation or information-power judgments: when you decided you had enough data and what that decision was based on. See Data Saturation and Information Power for how to justify that judgment on its own terms.
- Reflexivity notes — the researcher’s own positionality and how it may have shaped access, rapport, or interpretation. A dedicated reflexivity and positionality statement can live here and be adapted for the manuscript itself.
3. Analytic memos
- Memos written during coding that capture emerging ideas, tensions between codes, and questions the data raised — not polished prose, but timestamped and attributable to a specific point in the analysis.
- Theoretical memos that trace how a category or theme evolved: its first working definition, what changed it, and what evidence prompted the change.
- Memos documenting negative or deviant cases — instances that didn’t fit an emerging pattern — and how they were handled (folded into a revised category, or reported as a genuine exception). A deviant case that is quietly dropped without a memo is the single most common dependability gap an external reviewer flags.
4. The coding-decision log
- Every version of the codebook, not just the final one, with a date and a one-line reason for each change (a code split, merged, renamed, or redefined).
- The rationale for each code’s operational definition, especially where two codes could plausibly overlap — a reviewer needs to see how you drew that line, not just where it ended up.
- If more than one coder was involved: how disagreements were resolved, and any inter-coder consistency check that was run and what it showed.
- If you used CAQDAS software, most of this is captured automatically — see CAQDAS Workflows for what qualitative analysis software does and doesn’t log for you, and Coding in NVivo for how node history specifically maps onto this log.
What stays out of the manuscript
None of the four categories above belong in the body of a published article or dissertation chapter in full. A journal will not accept, and a reader does not want, forty interview transcripts and every memo you wrote appended to a results section. The trail’s job is to be producible on request, not published — retained in a secure, version-controlled location (an institutional repository, a supervised project folder, or wherever your IRB/ethics approval specifies for the required retention period) and referenced, not reproduced.
What you publish instead is a summary that demonstrates the trail exists, is organized, and would hold up if someone asked to see it.
How to present a summary in a manuscript or dissertation
The presentation problem is real: reviewers increasingly expect explicit evidence of dependability, but there’s no established convention for how much of the underlying trail to show. The working pattern that satisfies both constraints — visible evidence without a document dump — has three parts.
A. One paragraph in the methods section
State plainly that an audit trail was maintained, name the four categories it covers, and say where and how it is retained (e.g., version-controlled in a supervised project archive, retained per your institution’s data management policy). This is the minimum a reviewer applying COREQ or SRQR reporting criteria will look for — both checklists ask whether the analytic process was documented, and a one-sentence assertion with no supporting detail reads as thin.
B. A summary table, in-text or as an appendix
A short table with one row per audit-trail category (raw data, process notes, analytic memos, coding-decision log) and columns for what it contains, how it’s organized, and its retention location communicates completeness without reproducing content. This is the single most effective device for satisfying the checklist above in publishable form — it makes the trail’s existence and structure verifiable at a glance rather than asserted in prose.
C. One or two illustrative excerpts, clearly labeled
Where a memo or a codebook revision meaningfully explains a finding readers will scrutinize (a category that shifted definition mid-analysis, a deviant case that changed a conclusion), quoting a short, dated excerpt from that specific memo — labeled as an excerpt from the audit trail, not presented as new prose — does more to demonstrate dependability than a paragraph of general assurance. Keep this to one or two well-chosen excerpts; more than that starts to blur the line back into a document dump.
If your institution or a specific journal requires more, some accept the full trail as supplementary material rather than as part of the manuscript body — check the target journal’s data-availability policy before assuming an appendix is the only option. This is also where the guidance in writing the methodology section of a qualitative research paper is directly relevant for how this fits alongside the rest of your methods reporting.
The dependability audit: what it is, and who conducts it
A dependability audit (also called an inquiry audit) is a formal review of the audit trail by someone who was not part of the analysis — a committee member, an independent auditor, or in a smaller study, a peer debriefer with no stake in the findings. Lincoln and Guba’s original framing treats this as examining both the process (was it consistent with accepted practice, and could it plausibly produce the findings reported) and the product (do the findings, interpretations, and recommendations trace back through the data). A dependability audit is not the same technique as member checking, which addresses credibility by taking findings back to participants — the two are sometimes confused because both are described as “checks,” but they answer different questions and use different audiences.
You do not need a formal external audit to satisfy the criterion for most manuscripts or dissertations — maintaining a trail that could be audited, and describing it accurately, is usually sufficient. A doctoral committee or a specific journal may require an actual audit; if so, the summary table above becomes the document the auditor starts from, not a substitute for giving them full access to the underlying materials.
Retention, version control, and practical logistics
- Use a consistent file-naming and folder convention from day one (e.g., a fixed structure separating raw-data, process-notes, memos, and codebook-versions folders) — retrofitting this after data collection is where trails most often go incomplete.
- Version-control the codebook specifically. Even a simple convention — a new dated file each time the codebook changes, never overwriting the previous version — is enough to satisfy a reviewer; a single codebook file with no history is not.
- Retention duration and storage requirements are set by your institution’s data management policy and, for funded research, your funder’s requirements — not by this guide. Confirm the applicable period and storage location with your IRB/ethics office or research data management office before finalizing where the trail lives.
- If multiple team members contribute to the trail, agree on a single point of truth for the codebook early — a memo or coding decision that only exists in one person’s private notes is not part of a shared audit trail.
Frequently asked questions
What is an audit trail in qualitative research?
It’s the documented record — raw data, process notes, analytic memos, and a coding-decision log — that lets an independent reviewer follow how you moved from data collection to reported findings. It is the primary technique used to satisfy the dependability criterion in Lincoln and Guba’s trustworthiness framework, and it also supports confirmability.
Do I have to include my full audit trail in my dissertation or manuscript?
No. Journals and most dissertation formats expect a summary — a methods-section paragraph plus, ideally, a short summary table — not the full trail. The full trail is retained separately and produced on request, whether that’s a committee audit, a journal’s data-availability requirement, or an institutional records request.
How is an audit trail different from a codebook?
The codebook is one component of the trail (the coding-decision log), not the whole thing. A complete audit trail also includes the raw data with its chain of custody, the methodological process log, and analytic memos — a codebook alone doesn’t show why sampling or protocol decisions were made, or how emerging themes were reasoned through.
What’s the difference between an audit trail and a reflexivity statement?
They overlap but aren’t identical. A reflexivity statement is a specific, often published document addressing the researcher’s own positionality. The audit trail is broader — it includes reflexivity notes among the process notes, but also covers raw-data custody, memos, and the coding log, which a reflexivity statement does not.
Does satisfying dependability require an external auditor?
Not usually. Maintaining a trail organized well enough that it could be audited, and describing that organization accurately in your methods section, is the standard most manuscripts and dissertations are held to. A formal audit by an outside reviewer is a stronger version of the same technique, used when a committee or journal specifically requires it.
How long should I keep a qualitative audit trail?
That’s set by your institution’s data retention policy and, for funded work, your funder’s requirements — there’s no single universal figure. Confirm the specific period with your IRB or research data management office rather than assuming a default.








