01 · The Question
Can You Make a Systematic Review Question Too Specific?
Systematic-review questions are often encouraged to be focused. Researchers define the population, intervention or exposure, comparator, outcomes, study designs, settings, and other eligibility criteria so that the review answers a recognizable question rather than collecting vaguely related literature.
That advice can be taken too far.
Every additional restriction shrinks the evidence universe. Eventually, you may reach a beautifully precise question for which almost no studies are eligible, whose conclusions apply to an exceptionally limited situation, or whose answer contributes little beyond what is already known.
The problem is not simply that a narrow review might contain few studies. Some important systematic reviews legitimately conclude that evidence is scarce or absent. The harder question is whether the narrowness serves an important research or decision problem strongly enough to justify conducting the review.
03 · What You Need to Know
The Right Scope Balances Precision With Usefulness
Systematic reviews can legitimately be broad or narrow
Cochrane guidance explicitly recognizes that systematic reviews can address broader or more narrowly defined questions and that both approaches have advantages and disadvantages. There is no methodological rule requiring every systematic review to isolate the smallest possible population, intervention, comparator, and outcome combination.
A narrower scope can produce a more focused answer and may reduce heterogeneity. It can also make the review more manageable. A broader scope may capture more of the evidence relevant to real decisions and can permit comparisons across interventions or populations, although it may make synthesis more complex.
The appropriate point between those extremes depends on the purpose of the review.
PICO helps define a question, but it should not become a narrowing machine
For intervention reviews, Population, Intervention, Comparator, and Outcome, or PICO, is widely used to structure the question and eligibility criteria. Cochrane recommends defining the review's relevant PICO elements in advance.
But PICO identifies dimensions of a question. It does not require every dimension to be maximally restrictive.
Suppose your question concerns an educational intervention. You could progressively restrict the population by age, year level, institution type, discipline, country, socioeconomic characteristics, previous achievement, delivery mode, and dozens of other variables. Each restriction can sound reasonable in isolation. Collectively, they may produce a population that is more specific than the underlying decision requires.
Watch Out
Do not confuse a longer eligibility checklist with a better research question. Every restriction should have a substantive or methodological reason connected to what the review is trying to determine.
The strongest test is whether the distinction matters
When considering a restriction, ask what scientific or practical reason requires the excluded evidence to be treated separately.
If you restrict a review to adolescents because intervention effects plausibly differ between adolescents and adults and the decision specifically concerns adolescents, the boundary may be important. If you restrict it to 16- and 17-year-olds merely because those ages make the question appear more focused, the distinction requires stronger justification.
The same reasoning applies to settings, countries, intervention variants, outcomes, time periods, and study characteristics. A narrow boundary is strongest when crossing it would change the meaning of the question or the decision the review is intended to inform.
A small evidence base does not automatically make a systematic review pointless
This distinction is essential. The Agency for Healthcare Research and Quality's Methods Guide notes that a small evidence base does not necessarily mean a topic is not feasibly researchable. Characterizing limited evidence may itself be useful when the question concerns an important decision.
A systematic review can establish that evidence meeting well-justified criteria is sparse, uncertain, or absent. That conclusion can prevent people from assuming that evidence exists, identify a consequential research gap, and clarify what future studies need to address.
Narrow but important
The question concerns a meaningful distinction, and knowing that evidence is limited or absent would itself inform research or decisions.
Narrow without sufficient purpose
The restrictions create a tiny evidence slice without a convincing reason why that slice needs to be synthesized separately.
Too much specificity can make the findings difficult to apply
Highly restrictive eligibility criteria can increase internal conceptual consistency while decreasing the range of situations to which the synthesis is relevant. This trade-off should be considered before the protocol is fixed.
Imagine that a review includes only studies of one teaching strategy, delivered synchronously online, to first-year undergraduate nursing students, in public universities, using one narrowly defined assessment outcome. Even if several eligible studies exist, you should ask who needs an answer at precisely that level of specificity.
If the actual decision concerns undergraduate nursing education more generally, some of those restrictions may unnecessarily discard informative evidence.
An empty review can be informative, but it should not be an accidental surprise
Systematic searches sometimes reveal no eligible studies. That can be a legitimate finding when the eligibility criteria were determined for sound reasons and the absence of evidence is itself important.
It is less convincing when zero studies result from a chain of arbitrary restrictions that preliminary searching could have exposed before the full review began.
Scoping and preliminary searches are therefore valuable during question development. They should not be used to manipulate the question until a desirable number of studies appears. Rather, they help researchers understand whether the proposed boundaries correspond to the actual structure of the evidence base.
Too narrow can also mean too little conceptual variation to answer the real question
Researchers sometimes narrow a review to reduce heterogeneity. Yet heterogeneity is not automatically a methodological defect. Some variation may be essential to understanding whether effects differ across populations, implementations, contexts, or intervention variants.
If a decision maker must choose among several realistic alternatives, reviewing only one extremely specific variant may produce a precise answer to a question nobody actually needs answered.
Cochrane notes that broad and narrow reviews involve trade-offs. Broader reviews may better reflect the range of options encountered in decision making, whereas narrower reviews can provide more focused answers. Neither is intrinsically superior.
The question should fill an important knowledge gap, not merely an available gap
It is relatively easy to manufacture novelty by adding restrictions. If a systematic review already examines an intervention in university students, restricting a new review to university students in one discipline or one country can create a technically different question.
Technical difference does not establish importance.
Before undertaking the work, determine whether the narrower question addresses a meaningful uncertainty left by existing syntheses. This is particularly important when deciding whether a recent existing review already answers enough of the question that another full systematic review would add little.
Feasibility and importance should be considered together
A narrow review may require fewer studies to be screened and extracted, but the systematic-review process still requires protocol development, comprehensive searching, duplicate or independent review processes where appropriate, critical appraisal, synthesis, reporting, and maintenance of an auditable methodology.
That methodological investment makes the value of the question particularly important. A systematic review should not exist merely because the question can be made systematic.
Cochrane guidance emphasizes that review questions should be answerable and address important gaps in knowledge. Intended users and stakeholders can therefore be valuable during question development because they may reveal whether a distinction that seems academically interesting actually matters for policy, practice, research, or other decisions.
04 · A Practical Example
When Additional Precision Stops Improving the Question
Hypothetical Example
Peer feedback in undergraduate education
A research team wants to systematically review whether structured peer feedback improves student writing performance in undergraduate education. During question development, the team considers restricting the review to first-year students taking introductory academic writing courses in fully online programs.
Original question
Does structured peer feedback improve writing performance among undergraduate students?
Proposed restrictions
Include only first-year students, introductory writing courses, and fully online delivery.
Justification test
The researchers ask whether their intended decision specifically concerns that combination and whether there are plausible reasons that evidence from other undergraduate years, writing-intensive courses, or delivery modes should not inform it.
Decision
If those distinctions are central to the intended use, the narrow scope may be justified. If they were introduced mainly to make the review appear more precise, the team can broaden eligibility and plan subgroup or sensitivity analyses where supported by the evidence.
The point is not that the broader question is automatically better. It is that every narrowing decision should earn its place in the protocol.
06 · What This Means for You
Make Every Restriction Defend the Question Rather Than Decorate It
Before finalizing eligibility criteria, take each major restriction and ask why it exists. The answer should connect to the research problem, plausible effect differences, the intended decision, methodological requirements, or another substantive reason.
If the answer is simply “to make the review more specific,” reconsider it.
A simple decision framework
If a restriction corresponds to a genuinely distinct population, intervention, exposure, comparator, outcome, or decision
A narrow scope may be justified even when few studies are expected.
If removing the restriction would answer essentially the same practical question with more relevant evidence
Consider broadening the eligibility criteria.
If the question has few or no studies but addresses an important unresolved decision
Do not broaden it merely to obtain more studies; documenting the evidence gap may itself be valuable.
If narrowness exists mainly to avoid heterogeneity
Determine whether that heterogeneity can instead be anticipated and addressed in the synthesis plan.
If an existing review already addresses the broader question
Establish whether the narrower question represents an important unresolved issue rather than novelty created by additional eligibility restrictions.
If preliminary exploration suggests that the evidence is too immature for the focused synthesis you intended, consider whether a carefully bounded scoping approach would answer a different but more appropriate question about the available evidence. Do not simply relabel a systematic review as a scoping review to accommodate sparse results.
Likewise, if the review is becoming narrow because the full systematic process is beyond the available timeline, changing the question may not be the only option. In appropriate circumstances, you may instead need to consider whether a rapid review is scientifically defensible. Scope and methodological shortcuts solve different problems and should not be confused.
07 · A Quick Checklist
Check Whether Your Systematic Review Has Become Unnecessarily Narrow
Before finalizing a narrow review question, check:
State who is expected to use the review and what research, policy, practice, or other decision the answer could inform.
Justify each important population, intervention or exposure, comparator, outcome, setting, and study-design restriction.
Ask whether excluded evidence is genuinely irrelevant to the question rather than merely less similar.
Search for existing systematic reviews and determine whether your narrower scope addresses an important unresolved issue.
Conduct preliminary searches to understand the likely evidence base before committing substantial resources.
Consider whether meaningful heterogeneity can be analyzed rather than eliminated through restrictive eligibility criteria.
Determine whether a sparse or empty result would still provide useful knowledge about an important evidence gap.
Seek input from relevant users or stakeholders when the practical importance of the proposed scope is uncertain.
