Peer Review as a Journal-Choice Factor

Most guidance on choosing where to submit a manuscript focuses on scope, audience, impact factor, and turnaround time. Peer review itself is usually treated as a given — something every legitimate journal simply does. In practice, the rigor and transparency of a journal’s peer review process varies enormously, and that variation is one of the most reliable signals available to an author trying to tell a rigorous venue from a weak or predatory one before a manuscript is committed to it. This guide treats peer review specifically as a submission-decision factor: what a journal’s review practices tell you about its quality, how to check them before you submit, and how to weigh that alongside the other criteria that go into choosing a journal. For a general orientation to what peer review is and how the process itself works once a manuscript is under review, see CASRAI’s companion guide, Peer Review: What It Is, How It Works, and Why It Matters; this page picks up specifically at the point where an author is still deciding where to send a manuscript.

What a Journal’s Peer Review Process Actually Signals

Peer review is not a single uniform practice — it is a bundle of editorial choices a journal makes, and each of those choices is visible (or conspicuously absent) before you submit. Together they signal three things an author should care about when picking a venue:

Quality control. A journal that routes submissions through qualified, independent reviewers who actually evaluate methodology, evidence, and originality is filtering out weak work before publication. A journal that does not do this credibly — regardless of what it claims — is not providing that filter, which affects how the eventual publication will be read and cited by others in the field.
Editorial legitimacy. Real, identifiable reviewers with relevant expertise, an active editorial board, and a documented review workflow are evidence the journal is a going editorial concern, not a shell that exists to collect fees.
Downstream credibility. Indexing databases, funders, and tenure/promotion committees increasingly scrutinize not just whether a venue is “peer reviewed” but how it is peer reviewed. A weak or fraudulent review process can affect a journal’s indexing status and, by extension, the value of publishing there. CASRAI’s guides on why Scopus delists journals and why journals get delisted from Web of Science both cite peer-review integrity failures among the reasons indexers remove a title.

None of this means peer review alone certifies quality — even well-run peer review is fallible, and CASRAI’s peer review guide is explicit about that. But as a submission-decision input, it is one of the few things an author can actually investigate before committing a manuscript, months of review time, and often a fee, to a venue.

How to Evaluate a Journal’s Peer Review Process Before You Submit

Before submitting, it is worth checking the following directly on the journal’s own site, rather than assuming from its name, its ISSN, or a solicitation email that its review process is what it claims to be. An ISSN identifies a serial title, not its scholarly legitimacy — predatory and legitimate journals alike can hold one.

1. Is the review type actually disclosed?

A credible journal states its review model in its author instructions — whether reviewer and author identities are withheld from each other (double-anonymized), the reviewer knows the author’s identity but not vice versa (single-anonymized), or identities and/or reports are disclosed (open review). Terminology here has historically been inconsistent across publishers; ANSI/NISO Z39.106-2023, the Standard Terminology for Peer Review, was developed specifically to give the industry a controlled vocabulary for these models. A journal that cannot state, in plain terms, what its review model is should raise a question.

2. Are reviewer guidelines and editorial policies public?

Legitimate journals publish reviewer guidelines, conflict-of-interest policies, and a description of what the review process actually evaluates. The Committee on Publication Ethics (COPE) publishes its own Ethical Guidelines for Peer Reviewers, which many reputable journals reference or adopt directly — a journal that points to recognizable, external ethical standards is signaling it takes the process seriously.

3. Does the journal publish real timelines and acceptance data?

Average time to first decision, revision rates, and acceptance rates that a journal is willing to disclose are a useful cross-check. An unusually short guaranteed turnaround (a matter of days, for a substantive research article) combined with a near-universal acceptance rate is a common signature of a review process that exists in name only.

4. Is the editorial board real, active, and qualified?

Check that named editors and board members are identifiable researchers in the relevant field, ideally verifiable independently (institutional pages, ORCID records, prior publications) rather than only on the journal’s own site. Editorial boards that are copied from a legitimate journal, populated with fabricated names, or unresponsive when contacted are a documented pattern among predatory venues.

5. Is the journal indexed where it claims to be, and does that indexer have its own quality bar?

Directories and indexes such as the Directory of Open Access Journals (DOAJ) apply their own inclusion criteria covering peer-review practice, licensing transparency, and editorial governance — meeting DOAJ’s bar is not a guarantee of quality on its own, but it is independent corroboration. CASRAI’s guide to how to find peer-reviewed journals covers how to verify indexing claims rather than take a journal’s own badge at face value.

6. Use a structured checklist rather than a single signal

Think.Check.Submit., a cross-industry initiative supported by organizations including COPE, DOAJ, OASPA, the STM Association, and others, publishes a free checklist specifically for this decision point — walking authors through journal/publisher identity, editorial board, indexing, peer review transparency, and related checks before submission. It is a useful structured starting point precisely because no single check above is conclusive on its own.

Red Flags: Rubber-Stamp and Predatory Review

The clearest warning signs that a journal’s peer review is not a genuine quality filter include:

Unsolicited, flattering submission invitations that reference your work only in general terms and promise fast, guaranteed publication.
No substantive revision requests across a journal’s published output — acceptance with only cosmetic changes, regardless of a manuscript’s actual quality.
Fee-first behavior: article processing charges disclosed only after acceptance, or emphasized more prominently than editorial standards.
Implausibly broad scope paired with a small, generic-sounding editorial board covering unrelated disciplines.
Fabricated or misrepresented indexing/impact-factor claims, including invented metrics from unaccredited “impact factor” services.

Cabells’ Predatory Reports is a subscription database institutions use specifically to screen against this pattern; CASRAI’s predatory journal dictionary entry covers the defining characteristics in more depth, and case guides such as Is PLOS ONE a Predatory Journal? and Is Education Sciences a Predatory Journal? work through the evaluation for specific, frequently-asked-about titles. The pattern to internalize is the same one across all of them: a rigorous, disclosed, independently-verifiable review process is the single hardest thing for a predatory operation to fake convincingly, which is exactly why it is worth checking first.

Weighing Peer Review Quality Against Other Submission Factors

Peer review rigor is one input into where to submit, not the only one. In practice, authors are typically weighing it alongside:

Scope and fit — a rigorous journal outside your field or article type is still the wrong choice.
Turnaround time — some legitimate, rigorously-reviewed journals (particularly those using open or streamlined models, such as F1000Research’s open peer review model or eLife’s Reviewed Preprints model) are explicitly designed to be faster than the traditional pre-publication review cycle without weakening the review itself.
Impact factor and indexing status — see CASRAI’s guide to journal impact factor and quartile rankings for what these metrics do and do not measure, and note that a high-profile journal is not automatically better peer-reviewed than a smaller specialist one.
Cost — article processing charges and other fees, covered in CASRAI’s guide to how much it costs to publish a paper, are a legitimate factor but should never substitute for checking review quality directly; predatory journals rely on fee-first behavior specifically because authors under-check the review process.
Discoverability tools — journal-matching tools can help generate a shortlist, but CASRAI’s guide to journal finder tools and their limits is explicit that these tools rank on scope/fit signals, not on review rigor, so their output still needs the checks above applied manually.

A useful working rule: treat peer review evaluation as a pass/fail gate applied first, before comparing shortlisted journals on the softer, more negotiable factors like turnaround time or impact factor. A fast, high-impact-factor placement in a journal whose review process cannot be verified is a worse outcome, not a better one, than a slightly slower placement in a journal whose process holds up to scrutiny.

A Practical Pre-Submission Checklist

Confirm the review model (single-anonymized, double-anonymized, or open) is explicitly stated in the author instructions.
Verify the editorial board independently, not only via the journal’s own listing.
Look for a stated or published average time-to-decision, and treat implausibly fast guarantees as a warning sign.
Check the journal against DOAJ (for open access titles) or your library’s subscription/indexing records, rather than trusting a badge displayed on the journal’s own site.
Run the journal or publisher through the Think.Check.Submit. checklist, or an equivalent institutional screening list, before submitting.
Check whether the journal appears in Cabells’ Predatory Reports or a similar institutionally-maintained screening database, if your institution subscribes.
Only after the above checks clear, compare shortlisted journals on scope, turnaround time, cost, and impact/indexing metrics.

Common Questions

Does peer review guarantee a journal is legitimate?

No. Peer review is a strong signal, not a guarantee — even nominally peer-reviewed journals can run a weak or perfunctory process, and predatory operations often claim to conduct peer review without doing so credibly. Verifying the process directly, rather than trusting the claim, is the point of the checks above.

What is the single fastest check to run before submitting?

Confirm the review model is explicitly disclosed in the author instructions, and cross-check the editorial board independently. A journal that is vague about its review process, or whose named editors are unverifiable, fails the fastest and most decisive check.

Is open peer review always a better choice than anonymized review?

Not automatically — the two serve different goals. Open review (disclosed identities and/or published reports) increases transparency and accountability; anonymized review is designed to reduce bias related to author identity, seniority, or institutional prestige. Neither model is inherently more rigorous; what matters for a submission decision is whether the journal’s stated model is actually followed and documented, not which model it uses.

Should peer review rigor outweigh impact factor when choosing where to submit?

They are not directly comparable, but peer review legitimacy should function as a gate applied first: a journal that cannot be verified as running a genuine review process should be excluded from consideration regardless of its claimed impact factor, since fabricated or manipulated metrics are a documented pattern among low-quality and predatory venues.

Where can I check whether a specific journal has a documented peer review problem?

Cabells’ Predatory Reports (institutional subscription) and DOAJ’s own removal/rejection records are the most structured sources. CASRAI’s guide to searching the Retraction Watch database is also useful for checking whether a journal has a documented history of integrity problems tied to weak review.

Why Peer Review Matters When Choosing Where to Submit