Written and maintained by CASRAI Editorial Board
Published
On this page
A mapping review (also termed a systematic mapping study or evidence map) is an evidence-synthesis methodology designed to chart, categorize, and visually organize the volume, nature, and distribution of published research across a broad academic domain. Unlike a narrow systematic review that synthesizes empirical effect sizes, a mapping review structures an entire research landscape to highlight dense evidence clusters and identify unaddressed knowledge gaps.
Purpose of the section
In academic research, deciding to author a mapping review rather than an in-depth empirical synthesis stems from distinct research objectives. When exploring expansive or fragmented topics, preparing a dedicated mapping manuscript serves several vital functions in scholarly communication:
- Landscape Characterization: It catalogs the breadth and growth trajectory of scholarship across an emerging or cross-disciplinary field, quantifying publication frequency across venues, years, and geographic origins.
- Taxonomic Structuring: By developing a standardized classification framework or coding taxonomy, the review categorizes primary studies according to research methods, theoretical frameworks, intervention types, and study settings.
- Evidence Cluster and Gap Identification: The resulting visual evidence matrices explicitly delineate heavily investigated subtopics (clusters suitable for secondary meta-analyses) and sparse or barren quadrants (unaddressed areas requiring primary research).
- Resource Optimization for Research Agendas: Policymakers, funding bodies, and doctoral researchers utilize systematic maps to establish strategic priorities before committing significant capital to primary clinical trials or experimental fieldwork.
When situating your study within scholarly literature, understanding the boundary between a narrative review vs systematic review and an evidence map is essential. While a scoping review often emphasizes conceptual definitions and operational breadth with descriptive narrative summaries, a systematic mapping study relies primarily on a rigid, two-dimensional or multi-dimensional classification matrix, presenting findings through frequency cross-tabulations, heat maps, and bubble plots.
Methodologically, mapping reviews follow the SALSA (Search, Appraisal, Synthesis, Analysis) analytical typology established by Grant and Booth (2009). The table below contrasts the operational parameters of mapping reviews against systematic reviews, scoping reviews, and narrative overviews:
| Review Typology | Research Question Scope | Search Strategy (SALSA) | Critical Quality Appraisal | Synthesis and Primary Output |
|---|---|---|---|---|
| Mapping Review (Systematic Map) | Broad landscape inquiry (e.g., What subtopics, methods, and application domains characterize field X?) | Comprehensive, reproducible search across multiple multidisciplinary repositories | Typically omitted; focuses on cataloging research existence rather than methodological validity | Descriptive and visual: multi-dimensional classification matrices, bubble plots, and interactive gap databases |
| Systematic Review | Narrow, tightly focused question (e.g., PICOT framework evaluating intervention efficacy) | Exhaustive, protocol-driven search across specialized bibliographic databases and grey literature | Mandatory rigorous risk-of-bias and methodological quality appraisal | Quantitative meta-analysis (pooled effect sizes) or formal narrative synthesis |
| Scoping Review | Exploratory inquiry into concepts, evidence types, and operational definitions | Systematic and transparent search guided by frameworks such as JBI or PRISMA extension for scoping reviews (PRISMA-ScR) | Generally optional; rarely used to exclude studies from conceptual mapping | Descriptive summary charting study characteristics and qualitative narrative thematic frameworks |
| Narrative Review | Broad theoretical or educational overview | Selective, purposive literature gathering without mandatory reproducible search strings | Informal and subjective; dependent on author perspective | Qualitative, commentary-driven narrative synthesis |
Structure (ordered list)
To draft a transparent and reproducible mapping review manuscript, authors must organize their paper into a logical sequence following established evidence-synthesis reporting standards, such as the ROSES guidelines for systematic maps (Haddaway et al., 2018) or adapted PRISMA protocols. The ordered structural sections of a mapping review manuscript are as follows:
- Title and Structured Abstract: The title must explicitly identify the methodology using the term “mapping review,” “systematic mapping study,” or “systematic evidence map.” The structured abstract (typically 200 to 250 words) outlines the background, broad research questions, eligibility criteria, classification categories, primary visual outputs, and key gap findings.
- Introduction and Scope Justification: Establishes why a broad landscape mapping is required. It defines key terminology, specifies the target academic field, explains why a narrow systematic review is premature, and states the explicit mapping questions (e.g., publication trends, thematic clusters, methodological distributions, and evidence gaps).
- A Priori Protocol and Registration: Summarizes the predefined review plan, citing the public repository (such as the Open Science Framework, Figshare, or a disciplinary registry) where the protocol and search strings were archived prior to formal screening.
- Search Strategy and Selection Criteria: In the methods section of a research paper, document the complete search architecture: specific databases queried (e.g., IEEE Xplore, ACM Digital Library, Scopus, PubMed, Web of Science), date ranges, Boolean operators, and grey literature sources. Define explicit inclusion and exclusion criteria applied across two stages: title/abstract screening followed by full-text review.
- Classification Scheme and Keywording Process: Detail the taxonomy used to categorize the corpus. Describe how categories were established—whether top-down (derived from established disciplinary models) or bottom-up (inductively generated from study keywords and abstracts via the Petersen et al. 2008 workflow). Specify the classification facets: research type (e.g., evaluation research, validation research, proposal, case study), topic facet, setting, and study population.
- Data Extraction and Mapping Workflow: Clarify the data points collected on standardized extraction sheets (bibliographic metadata, empirical design, geographic location, focal intervention, and reported outcomes). State the software tools employed for screening and data management (such as EPPI-Reviewer, Rayyan, or CADIMA).
- Mapping Results and Visual Evidence Representations: Present the core findings through descriptive statistics and structured visual formats: a documented flow diagram tracking study attrition (such as a PRISMA flow diagram and systematic review methodology), publication trend graphs, geographical maps, and multi-dimensional cross-tabulation matrices (e.g., bubble plots mapping interventions on the vertical axis against study designs on the horizontal axis, with bubble area proportional to study count).
- Discussion and Evidence Gap Analysis: Interpret the topographical structure of the field without drawing conclusions on intervention efficacy. Highlight dense evidence clusters where secondary systematic reviews or meta-analyses can now be conducted, and detail uninvestigated quadrants where empirical field research is urgently needed.
- Pre-Publication Checklist and Data Availability: Provide explicit links to the underlying systematic map database (often published as an open CSV, Excel spreadsheet, or interactive web repository), confirming adherence to formal reporting items.
A short annotated example
The excerpt below illustrates an annotated model demonstrating how to draft the Methodology and Classification Scheme section in an empirical software engineering or computer science mapping review, following the foundational Petersen et al. (2008) process:
Section 3.3 Classification Scheme and Keywording Process
[Annotation: Explicitly state the classification workflow and reference the authoritative methodology.]
To structure the primary literature on automated test generation for distributed microservices, we executed the systematic keywording procedure formulated by Petersen et al. (2008). Keywording was conducted in two sequential stages: (1) extracting author keywords and abstract text to establish candidate categories, and (2) clustering related terms into a structured, two-dimensional classification matrix.[Annotation: Define the primary orthogonal facets of the taxonomy clearly.]
The classification scheme incorporates two main orthogonal facets:
- Research Type Facet: Adopted directly from Wieringa et al. (2006) and Petersen et al. (2008), classifying articles into Evaluation Research (empirical assessment of an existing tool in industrial practice), Validation Research (novel technique investigated in a lab setting without full industrial deployment), Solution Proposal (novel architecture illustrated via small toy examples), or Experience Papers (practitioner reports).
- Microservice Testing Focus: Derived inductively from our corpus into Contract Testing, Fault Injection/Chaos Engineering, End-to-End API Integration, and Performance/Load Synthesis.
[Annotation: Present the cross-tabulation matrix and bubble plot metrics.]
Two independent reviewers coded each of the 74 included papers into the classification matrix. Inter-coder agreement was quantified using Cohen’s kappa (κ = 0.86), resolving discordant classifications through adjudicated consensus. The resulting cross-tabulation is visualized in Figure 3 as a bubble plot, where coordinates indicate the intersection of testing focus and research type, and bubble circumference scales directly with primary paper frequency.
Common mistakes
Authors drafting their first systematic mapping review frequently encounter pitfalls that undermine the methodological rigor or publication prospects of their manuscript. Below are critical errors to avoid:
- Conflating Scope with Depth (Attempting Unfounded Efficacy Claims): A mapping review charts what research exists; it does not evaluate whether an intervention is statistically effective or clinically superior. Asserting clinical or technical efficacy without conducting formal quality appraisal and quantitative meta-analysis is a major editorial defect.
- Omitting a Transparent A Priori Protocol: Initiating literature searches without an established, publicly timestamped protocol raises concerns regarding retrospective cherry-picking and subjective inclusion bias. Always register the protocol on platforms such as OSF or Figshare before executing final queries.
- Developing an Unstable or Subjective Classification Framework: Constructing ad-hoc coding categories without testing them against an initial sample leads to inconsistent categorization. Authors must pilot test their coding scheme on a subset of at least 10 to 15 papers to establish reproducible definitions for each category.
- Solo Screening Without Reliability Metrics: Having a single investigator screen citations introduces individual reviewer bias. Methodological standards call for dual screening across at least a 10% to 20% random sample of records, accompanied by a calculated inter-rater agreement score (such as Cohen’s kappa or percentage agreement).
- Relying Exclusively on Narrative Text: A mapping review that delivers only textual summaries fails the primary objective of evidence mapping. The core deliverable of a mapping paper is structural visualization: cross-tabulation tables, bubble matrices, geographical heat maps, and a searchable open-access database.
- Failing to Distinguish Between Research Method and Methodology: In scholarly reporting, confusing procedural data collection steps with broader epistemological design frameworks weakens the rigor of the paper. For guidance on maintaining this conceptual boundary, consult our guide on method vs methodology.
Checklist
Prior to submitting a mapping review manuscript for peer review, verify that your draft satisfies every element of this pre-submission quality checklist:
| Manuscript Stage | Verification Item | Compliance Status |
|---|---|---|
| Protocol & Title | Title includes explicit methodology indicator (“mapping review” or “systematic mapping study”); protocol registration DOI or URL cited in Methods. | Required |
| Search Architecture | Full, verbatim search strings provided for all queried databases; query execution dates and platform interfaces recorded. | Required |
| Screening Procedure | Two-stage screening (title/abstract and full text) documented with inclusion/exclusion criteria; attrition recorded in a PRISMA-style flow diagram. | Required |
| Classification Scheme | Taxonomy clearly defined with orthogonal facets; coding pilot procedure described and inter-rater agreement metrics reported. | Required |
| Visual Evidence Matrix | At least one multi-dimensional cross-tabulation matrix, bubble plot, or heat map included to depict evidence clusters and gaps. | Required |
| Gap Analysis | Discussion explicitly identifies empty or sparse matrix cells as priorities for future empirical research, avoiding unsubstantiated intervention recommendations. | Required |
| Data Availability | Searchable systematic map database (CSV, Excel, or open repository) deposited in an open-access repository with persistent identifier. | Required |
Discipline differences (only if sourced)
While the foundational premise of evidence mapping—cataloging research breadth rather than pooling effect sizes—is uniform across academia, specific execution standards and reporting guidelines vary significantly among scholarly fields:
| Academic Discipline | Primary Framework & Standards | Distinctive Methodological Norms | Typical Visual and Database Outputs |
|---|---|---|---|
| Software Engineering & Computer Science | Petersen et al. (2008); Kitchenham et al. (2011); ACM / IEEE conventions | Heavy emphasis on the Wieringa research-type facet (validation vs evaluation vs solution proposals); search strings tailored to technical repositories (IEEE Xplore, ACM Digital Library). | Two-dimensional bubble plots crossing research type against technical topics; frequency bar charts of tool implementations. |
| Environmental Science & Conservation | Collaboration for Environmental Evidence (CEE, 2016); ROSES standards (Haddaway et al., 2018) | Mandatory a priori protocol peer-reviewed in the journal Environmental Evidence; heavy inclusion of grey literature (government agency reports, NGO surveys). | Geographic GIS distribution maps of field sites; interactive web-based systematic map databases with filterable metadata. |
| Health & Social Policy | EPPI-Centre (University College London; Gough et al., 2017); Campbell Collaboration; SALSA framework (Grant & Booth, 2009) | Two-stage “Map-then-Review” architecture; extensive stakeholder engagement to define policy priorities; integration with Evidence and Gap Maps (EGMs). | Interactive online matrices (EPPI-Mapper) crossing policy interventions against population outcomes; sector gap heat maps. |
FAQ
What is the primary difference between a mapping review and a scoping review?
While both methodologies address broad research questions and map existing scholarship, a scoping review focuses primarily on exploring the conceptual boundaries, definitions, and types of evidence available in a domain, often synthesizing findings through descriptive narrative text. In contrast, a mapping review places primary emphasis on a structured, multi-dimensional classification taxonomy (such as the Petersen et al. 2008 framework), cataloging the corpus into discrete categorical buckets and displaying the landscape through visual cross-tabulation matrices, bubble plots, and searchable databases.
Is critical quality appraisal required in a mapping review?
Under standard evidence-mapping methodologies—including the SALSA typology (Grant & Booth, 2009) and the Petersen et al. (2008) guidelines—formal critical quality appraisal or risk-of-bias assessment is typically omitted. The objective of an evidence map is to reflect the entire volume and structural distribution of research that exists, rather than evaluating whether individual findings are sufficiently trustworthy to guide clinical or operational practice. However, studies may still be categorized by broad study design (such as randomized trials versus observational surveys).
Can a mapping review include recommendations for practical intervention?
No. Because mapping reviews do not formally evaluate study quality or synthesize empirical outcome data, authors should refrain from recommending specific clinical treatments, technical interventions, or organizational policies based on mapping counts alone. Instead, recommendations in a mapping review should focus exclusively on research policy: highlighting dense clusters where a full systematic review or meta-analysis is now justified, and identifying barren quadrants where primary empirical studies should be commissioned.
What reporting guidelines should authors follow when writing a mapping review?
Depending on your discipline, you should follow established evidence-synthesis reporting standards. In environmental and biological sciences, researchers follow the ROSES (Reporting Standards for Systematic Evidence Syntheses) checklist for systematic maps (Haddaway et al., 2018). In software engineering, authors follow the updated systematic mapping guidelines established by Petersen et al. (2008, 2015). In health and social sciences, authors adapt the PRISMA-ScR reporting checklist or Campbell Collaboration Evidence and Gap Map standards.
Sources
- Grant, M. J., & Booth, A. (2009). A typology of reviews: an analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26(2), 91–108. https://pubmed.ncbi.nlm.nih.gov/19490148/ (read 2026-11-11)
- Petersen, K., Feldt, R., Mujtaba, S., & Mattsson, M. (2008). Systematic mapping studies in software engineering. In 12th International Conference on Evaluation and Assessment in Software Engineering (EASE), BCS-eWiC. https://doi.org/10.14236/ewic/EASE2008.8 (read 2026-11-11)
- James, K. L., Randall, N. P., & Haddaway, N. R. (2016). A methodology for systematic mapping in environmental sciences. Environmental Evidence, 5, 7. https://doi.org/10.1186/s13750-016-0059-6 (read 2026-11-11)
- Haddaway, N. R., Macura, B., Whaley, P., & Pullin, A. S. (2018). ROSES Reporting Standards for Systematic Evidence Syntheses. Environmental Evidence. https://www.roses-reporting.com/ (read 2026-11-11)
- Gough, D., Oliver, S., & Thomas, J. (2017). An Introduction to Systematic Reviews (2nd ed.). SAGE Publications / EPPI-Centre, University College London. https://eppi.ioe.ac.uk/cms/ (read 2026-11-11)
