01 · The Question
What If Almost All Your Results Seem to Come From One Search Term?
You create a concept block containing several synonyms, combine them with OR, and discover that one term retrieves vastly more records than everything else. Remove it and the result set collapses. Put it back and thousands of papers return, many apparently unrelated to your intended concept.
This does not automatically mean the term is wrong. A broad term might be responsible for substantial noise while also retrieving relevant papers that none of your more specific terms can find.
The useful question is therefore not simply whether the term retrieves too much. You need to know what it contributes uniquely , why its retrieval is so large, and whether that contribution justifies the screening burden it creates.
02 · The Short Answer
Test the Dominant Term Separately Before Removing It
In Brief
When one search term dominates the results, isolate it, inspect what it retrieves, and determine whether it is broad, ambiguous, incorrectly mapped, searched in overly permissive fields, or simply much more common than the other terms.
Do not remove it merely because its result count is large. Compare the useful records retrieved with and without the term, then decide whether it should remain unchanged, be restricted, replaced, qualified, or removed.
03 · What You Need to Know
Measure What the Dominant Term Is Actually Contributing
OR makes every term an independent route into the result set
Terms representing alternative ways of expressing the same concept are commonly combined with OR. If a concept block is:
("generative AI" OR ChatGPT OR chatbot* OR AI)
a record needs to match only one of those alternatives to satisfy the block. Consequently, a very broad term can determine the behavior of the entire set even when the remaining terms are highly specific.
This is not a flaw in OR. It is exactly what the operator is supposed to do. Cochrane guidance recommends combining alternative terms within a concept using OR to promote sensitivity, then combining separate concepts using AND. The troubleshooting question is whether every term inside that OR block is doing useful work.
Run each term separately
Begin with the simplest diagnostic test: search each term independently and record its result count.
Search term
Hypothetical results
Initial observation
"generative artificial intelligence"
8,400
Relatively specific phrase
"generative AI"
12,600
Common variant
ChatGPT
41,000
Named system used across many disciplines
AI
1,900,000
Potentially broad and ambiguous
These hypothetical counts do not prove that AI should be removed. They tell you which term deserves investigation.
Raw result count is only the beginning
A term can retrieve hundreds of thousands of records and still be valuable if most of those records disappear once the concept block is combined with the other concepts in your strategy.
Suppose the broad AI term retrieves 1.9 million records by itself, but your full strategy also requires higher-education and assessment concepts. Those intersections may reduce its practical contribution dramatically.
For that reason, evaluate the term both independently and within the complete search. A frightening standalone count can be methodologically harmless once the intended conceptual intersections are applied.
Find out what the term retrieves that the other terms do not
The most informative test is often not:
How many records does this term retrieve?
but:
Which records does this term retrieve that my other terms would miss?
Compare the concept block with and without the dominant term. In database systems that permit line-by-line set operations, you can isolate the additional records contributed by that term. Otherwise, comparison can be performed through exported results or smaller diagnostic searches.
Inspect a sample of those unique records. If they are overwhelmingly irrelevant, the term may have poor precision. If they include genuinely relevant studies using terminology absent from the rest of your strategy, removing the term may reduce sensitivity.
The term may be broader than the concept you intended
Sometimes the problem is semantic rather than technical. Researchers select a familiar word that appears to represent their concept, but the word covers a much larger conceptual territory.
For example, technology is not synonymous with educational technology . Learning is not synonymous with online learning . Assessment can refer to educational assessment, clinical assessment, risk assessment, environmental assessment, and numerous other activities.
If the underlying concept itself has been specified too broadly, endlessly editing the query may not solve the problem. You may need to reconsider whether the concept is too broad to search effectively .
The term may have multiple meanings
A short word or abbreviation can dominate retrieval because it means different things in different literatures. This is particularly common with acronyms.
The abbreviation you recognize immediately may have dozens of expansions elsewhere. A database does not know which meaning you intended unless its search processing or surrounding query provides enough information to distinguish them.
If the dominant term is an abbreviation, diagnose whether acronym ambiguity is producing the irrelevant records before making broader changes to the search.
The field being searched may be too permissive
A term may be useful when it appears in a title but nearly meaningless when it occurs anywhere in a record. Depending on the database and interface, an unrestricted search may examine several metadata fields.
Test whether the dominant term becomes more useful when restricted to a field such as title or title and abstract. Field restriction can sometimes improve precision while preserving a valuable term.
Do not assume this will always be appropriate. Relevant papers may discuss a concept in the abstract without placing it in the title, and field syntax differs across database platforms.
A phrase or proximity relationship may better represent the concept
A broad individual word may become meaningful only when it occurs near another term. For example, searching digital independently would be extremely broad if the intended concept were digital literacy. Searching the phrase "digital literacy" is more specific, while a database-specific proximity construction may accommodate intervening words and linguistic variation.
The appropriate choice depends on how the concept appears in the literature. Exact phrase searching can become too restrictive, while unconstrained individual terms may be too permissive.
Automatic term mapping can change what the database is actually searching
Some interfaces process queries rather than searching exactly what the researcher typed. A term may map to a controlled-vocabulary concept, be expanded, or otherwise be interpreted according to platform-specific rules.
If a term's retrieval seems implausibly large, inspect the database's search details or query translation where available. You may discover that the executed search differs materially from the expression you entered.
The dominant term may simply reflect the literature
Not every large retrieval is a search defect. One synonym may genuinely be the overwhelmingly preferred terminology in the field. If so, it should dominate the results.
Removing it merely to make the contribution of other terms look more balanced would be counterproductive. Search terms do not need to retrieve similar numbers of records. Their job is to retrieve relevant literature.
Watch Out
Do not optimize a search for balanced term counts. One term retrieving 100 times more records than another is not inherently a problem. The problem is disproportionate irrelevant retrieval without a corresponding contribution to finding relevant studies.
04 · A Practical Example
Decide Whether a Dominant Term Is Worth Keeping
Hypothetical Example
The word "technology" overwhelms an educational search
A researcher is searching for studies of digital technology use in university teaching. The technology concept includes "educational technology," "digital technology," "learning technology," and the standalone word technology. The final search retrieves far more records than expected.
Isolate the terms The researcher runs each expression separately and finds that the standalone word technology retrieves vastly more records than the three more specific expressions.
Measure its unique contribution The researcher compares the concept block with and without technology. Most additional records arise solely because of the standalone term.
Inspect those additional records A sample contains studies about laboratory technologies, manufacturing, medical devices, engineering systems, and other topics unrelated to technology-supported teaching.
Look for useful exceptions A smaller number of relevant education papers use technology without one of the more specific phrases. The researcher examines how those papers describe the educational context and identifies more discriminating terminology.
Revise and retest Rather than simply deleting technology, the researcher tests more specific combinations and field restrictions, then checks whether known relevant papers remain retrievable.
The important evidence is not that technology produced the largest count. It is that the records uniquely contributed by the unrestricted term were largely outside the intended concept, while the relevant exceptions suggested more precise ways to represent it.
06 · What This Means for You
Keep, Restrict, Replace, or Remove the Term Based on Evidence
A dominant search term is best treated as a component to test, not an offender to delete. Determine what it retrieves independently, what it adds to the complete strategy, and whether its unique contribution includes literature you need.
A simple decision framework
If the term retrieves many records but contributes substantial relevant literature
Keep it unless a more precise formulation preserves that useful retrieval.
If the term is useful only when it appears in particular fields
Test an appropriate field restriction and verify that relevant records remain retrievable.
If the term represents multiple unrelated meanings
Test more specific expressions, contextual combinations, phrase searching, or proximity approaches supported by the database.
If the term uniquely retrieves almost nothing relevant
Consider removing it after checking known relevant records and confirming that other terms adequately represent the concept.
If no stable terminology can represent the concept cleanly
Make one meaningful change at a time and compare the results. If repeated revisions merely move the noise from one term to another, consider whether continued incremental revision is actually improving the strategy .
07 · A Quick Checklist
How to Diagnose a Dominant Search Term
Before deleting the term, check:
Run the term separately and compare its result count with the other terms in the same concept block.
Compare the full concept block with and without the dominant term.
Inspect a sample of records uniquely contributed by the term.
Determine whether the term has meanings outside your intended concept or discipline.
Check whether the database is mapping, expanding, or otherwise transforming the term.
Test whether phrase searching, proximity, or an appropriate field restriction improves precision.
Check whether relevant papers depend uniquely on the term before removing it.
Evaluate the term inside the complete search rather than relying only on its standalone result count.
11 · Cite this Guide
How to Cite This Guide
This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.
Recommended (Field Guide)
APA
MLA
Chicago
Copy Citation