03 · What You Need to Know
Troubleshoot the Missing Paper Systematically
Step 1: Confirm that the paper really should be found
“Key paper” can mean several things. A publication may be influential, highly cited, historically important, theoretically useful, or central to your understanding of the topic. None of those characteristics automatically makes it eligible for the particular search you are conducting.
Suppose you are searching for empirical studies of university students using generative AI for academic writing. A widely cited conceptual article about generative AI in education may be essential background reading while remaining outside that search's intended evidence base.
Before diagnosing the search, therefore, compare the paper against the scope you established when you defined what counts as relevant evidence.
Important to the topic
The paper contributes useful background, theory, context, terminology, or intellectual history.
Expected to be retrieved
The paper falls within the evidence the particular search strategy was designed to identify.
If the paper is important but outside the planned search scope, its absence may be entirely appropriate.
Step 2: Check whether the database actually contains the paper
This should happen before you change a single search term.
Search directly for the paper using its exact title, DOI, author details, or another distinctive bibliographic identifier. If you cannot locate the record even this way, investigate whether the database indexes the journal, document type, publication year, or source in question.
A database cannot retrieve a record it does not contain.
Cochrane notes that relevant reports may be absent from individual databases and recommends searching multiple appropriate sources for systematic reviews. It also distinguishes database searching from supplementary approaches such as trial-register searching, citation searching, and reference checking.
If the paper is absent because of database coverage, rewriting the query will accomplish nothing. The issue instead concerns which databases and other sources need to be searched.
Step 3: If the record exists, run the complete strategy against it
Once you confirm that the database contains the paper, determine whether your complete strategy retrieves it.
If it does not, you now have a genuine retrieval problem to diagnose.
Do not immediately add the paper's title words to the strategy. Instead, break the search apart concept by concept.
Test Concept A Does the paper satisfy the population or problem block?
Test Concept B Does it satisfy the intervention, exposure, phenomenon, or other central concept?
Test Concept C Does it satisfy any additional mandatory concept?
Test filters and limits Does the record disappear because of date, language, study design, document type, population, or another restriction?
This process identifies where the failure occurs. A vague problem such as “the search missed my paper” becomes a specific one such as “the paper fails the third concept block because none of those terms appears in the searchable record.”
Step 4: Inspect the database record rather than assuming the paper uses your terminology
Look at what the database can actually search: title, abstract, author keywords, controlled vocabulary, publication type, and any other fields included in your strategy.
You may discover that the paper describes the concept differently. A study you regard as being about academic writing may use terms such as essay composition, written assignments, or text production. A paper about a particular technology may emphasize the product name rather than the broader technological category.
If that alternative language also occurs in other relevant papers, you may have found a genuine vocabulary gap.
Cochrane recommends combining free-text terms with controlled vocabulary and using a broad range of alternative terms within important concepts. It also describes search development as iterative because terminology can be modified in response to what retrieval reveals.
Step 5: Determine whether a mandatory concept is the real problem
Sometimes the missing paper contains no useful alternative terminology because the problematic concept simply does not appear in its searchable record.
Suppose you require an outcome block such as:
writing performance OR writing quality OR learning outcome
The key study may actually measure writing performance, but its title and abstract discuss only students' use of AI during writing. The outcome appears later in the full text.
No amount of synonym expansion will solve the underlying problem reliably. The question becomes whether that outcome should have been mandatory in the database query at all.
Cochrane cautions against searching every element of a review question because comparators and outcomes, among other concepts, may be absent from titles and abstracts or inadequately indexed.
A missing known paper can therefore expose exactly the kind of problem created when search criteria become too restrictive.
Step 6: Check Boolean logic, fields, phrases, and proximity operators
The terminology may be correct while the syntax is not.
A misplaced parenthesis can change the logic of an entire query. Searching an important synonym only in the title field can exclude papers that mention it only in the abstract. Quotation marks can require an exact phrase where authors use grammatical variants. An overly tight proximity operator can reject records in which the correct words appear slightly farther apart.
Similarly, a NOT operator can remove records unexpectedly. Exclusion searching deserves particular caution because a relevant paper may contain the excluded terminology for reasons unrelated to its eligibility.
The PRESS guideline for peer review of electronic search strategies explicitly includes Boolean and proximity operators, subject headings, text words, spelling and syntax, and limits and filters among the elements that should be checked. Cochrane strongly recommends peer review of search strategies before final execution.
Step 7: Check whether a filter or limit removes the paper
Temporarily remove limits one at a time.
Does the paper return when you remove the date restriction? The language limit? The study-design filter? The document-type restriction?
If so, the issue is no longer mysterious. You can evaluate whether the restriction is justified and whether the database represents that characteristic reliably.
Cochrane requires date and publication-format restrictions in intervention-review searches to be justified and cautions against language restrictions because they can contribute to missed evidence and bias.
The fact that a filter removes one known paper does not automatically mean the filter must go. If the paper genuinely falls outside your eligibility criteria, exclusion may be correct. The test tells you what the filter is doing; your research question determines whether that behavior is appropriate.
Step 8: Decide whether changing the search would improve retrieval beyond this one paper
This is the critical judgment.
Suppose the missing paper uses a synonym you overlooked. Adding that synonym retrieves the paper plus several other clearly relevant records. That is strong evidence that the revision improves the conceptual coverage of the strategy.
Now imagine that retrieving the paper requires adding an extremely generic word that produces 30,000 additional records, almost all unrelated. The paper has an unusually vague title and abstract and poor indexing.
Forcing the database search to retrieve that one record may do more harm than good.
Watch Out
Do not optimize the entire search around one paper. A correction should improve representation of the underlying concept, not merely manufacture successful retrieval of a benchmark record.
Step 9: Use other discovery methods when database searching is not enough
Bibliographic database searching is central to many reviews, but it is not the only route to relevant evidence.
Citation searching can identify papers that cite or are cited by a known study. Reference-list checking can expose earlier work. Depending on the review, appropriate supplementary sources may include trial registers, regulatory sources, subject-specific databases, grey literature, or other resources.
Cochrane recommends citation searching on key articles in addition to database searching and notes that citation searching and reference checking can help assess search performance. If citation searches identify many additional eligible records, that may indicate that the original database strategies deserve reconsideration.
A difficult-to-retrieve key paper can therefore become a useful starting point for finding related evidence even when it cannot be captured elegantly by the main Boolean strategy.
Step 10: Re-test after making a defensible change
Once you identify a justified modification, rerun the relevant part of the search and check its consequences.
Does the missing paper now appear? What additional records does the change retrieve? Did another restriction unexpectedly eliminate something else? Did precision deteriorate dramatically?
This returns you to the broader process of piloting the search strategy before committing to it.
Document consequential changes as you go. Cochrane requires the search process to be recorded in enough detail to support accurate reporting and reproducibility, including the sources searched, dates, and search terms used.
