01 · The Question
When Does Persistence Stop Being Good Research Practice?
You have a citation for a paper that appears relevant. The DOI works, but the article is inaccessible. Your library does not have it. Repository searches lead nowhere. The author's old institutional page has disappeared. After several attempts, you are still looking.
Should you keep going?
There is no universal number of minutes, searches, or emails that makes a retrieval effort “enough.” The appropriate effort depends primarily on what the paper could contribute to your research and what would happen if you proceeded without it. A potentially decisive study in a systematic review deserves a different retrieval effort from a tangential citation you hoped might provide one more sentence for a background paragraph.
The goal is therefore not maximal persistence. It is proportionate retrieval: spending enough effort to reduce an important evidential uncertainty without allowing one source to consume resources far beyond its likely contribution.
03 · What You Need to Know
Retrieval Effort Should Be Proportionate to Evidential Value
Not every inaccessible paper creates the same problem
A difficult source can matter for very different reasons. Perhaps it appears to be the only study of a particular population. Perhaps it contains the numerical result needed for a meta-analysis. Perhaps it is merely one of several papers supporting a well-established background statement.
Those situations should not receive identical treatment. The rational question is not simply “How difficult is this paper to obtain?” but “How consequential would it be if I never obtained it?”
Situation
Likely retrieval priority
Why
Potentially eligible report in a systematic review
High
Failure to retrieve it can affect study selection and the completeness of the evidence base
Paper containing unique data needed for analysis
High
The missing information may directly affect the analysis
Source central to a contested claim
High
Direct verification may materially affect your interpretation
One of many sources supporting the same background fact
Lower
Accessible primary evidence may answer the same question
Interesting but peripheral citation
Lower
The likely informational gain may not justify extensive retrieval work
Systematic reviews require a more structured retrieval process
Formal evidence synthesis changes the calculation. The Cochrane Handbook describes retrieving full-text reports of potentially relevant studies as part of the study-selection process and recommends corresponding with investigators where appropriate when information needed to determine eligibility or obtain missing information is unavailable. If information remains unobtainable, the review process should record that status rather than pretend that the report was assessed normally.
PRISMA 2020 likewise explicitly accommodates reports that were sought but could not be retrieved. Guidance accompanying PRISMA explains that this category can include reports unavailable through local collections or interlibrary loan, failures to obtain material from authors, and broken links.
This does not mean you must search indefinitely. It means that failure to retrieve a potentially relevant report is itself information about the review process and should be made visible.
Start with high-yield, low-cost routes
Before deciding that a paper is genuinely difficult to obtain, use the routes most likely to solve the problem quickly. Resolve the DOI, inspect the publisher page, search the exact title, check your institutional library, look for legitimate repository copies, and inspect author or institutional pages where appropriate.
If the article is subscription-restricted, the relevant options are those used when a research paper is behind a paywall . If you can locate only the bibliographic record, follow a structured process for dealing with a citation whose full text cannot initially be found .
Escalate when the paper matters enough
If ordinary searching fails and the source is important, escalate to routes that require more effort. Depending on your context, these may include interlibrary loan or document delivery, help from a research librarian, searching specialized repositories or catalogs, tracing another legitimate version, and contacting the corresponding author.
These routes are not interchangeable. A library request may be particularly appropriate for an older journal article held elsewhere, while author contact may be efficient for an accepted manuscript or an associated file. If direct author contact is appropriate, make the request specific and concise rather than sending a generic demand for access. The practical considerations involved in requesting a paper from its author apply here.
Ask what another retrieval attempt is likely to change
Suppose you have already checked the publisher, your library, several appropriate repositories, and the author's current institutional profile. You have also submitted an interlibrary-loan request. Running the same title through six additional general search engines may add very little.
This is a marginal-value problem. Each additional retrieval attempt has a cost in time and attention. Continue when another route has a plausible chance of succeeding and the paper matters enough to justify that cost. Stop when you are merely repeating low-yield searches without changing the evidential situation.
Replaceable sources deserve less heroic searching
Sometimes you want a paper because another author cited it for a broad proposition. If several accessible primary studies or authoritative sources establish the same point, obtaining that one paper may add little to your work.
That does not mean replacing sources casually. Two papers that sound similar may study different populations, measures, interventions, or periods. But if your informational need can genuinely be satisfied by stronger accessible evidence, there is little methodological virtue in spending hours pursuing a particular citation merely because you encountered it first.
Unique sources deserve more effort
The calculation changes when the inaccessible source appears irreplaceable. An old study may be the only evidence for a population. A paper may contain the only available estimate needed for a meta-analysis. A methodological article may be the original source of a procedure repeatedly described secondhand.
In such cases, another retrieval attempt can have substantial informational value. Library assistance, archival searching, author contact, or tracing related reports may be justified even when you would have abandoned a peripheral source much earlier.
Do not use citation count or journal prestige as your stopping rule
A highly cited paper is not automatically important to your particular research question, and an obscure paper may contain exactly the evidence you need. Likewise, journal prestige does not determine whether retrieving an individual source is worth your time.
Evaluate relevance, uniqueness, and consequence. Retrieval effort should follow your research need, not the social status of the citation.
Set stopping rules before frustration sets them for you
A simple stopping rule can make retrieval decisions more consistent. For example, you might decide that a potentially important source receives the standard retrieval routes first, followed by one or more escalation routes appropriate to your project. If those fail, you document the source as unobtainable unless new information emerges.
The exact rule should fit the research design. A doctoral thesis, rapid review, scoping review, historical investigation, and casual literature search operate under different resource constraints. What matters is that the rule reflects methodological purpose rather than your patience on a particular afternoon.
Watch Out
Do not stop searching for difficult papers simply because their results are inconvenient, nor pursue them more aggressively because you expect them to support your argument. Retrieval decisions should be based on relevance and methodological need, not anticipated findings.
Keep a retrieval log when the stakes are high
For formal reviews and other reproducible research, record the routes you attempted and their outcomes. A brief log might include the DOI or citation, publisher access, library search, repository search, interlibrary-loan request, author contact, dates, and final retrieval status.
This serves two purposes. It prevents repeated searches that have already failed, and it allows another researcher to understand why the source was not used. More importantly, it separates “we did not bother to obtain this paper” from “we made reasonable attempts but could not retrieve it.” Those are methodologically different situations.
04 · A Practical Example
Two Inaccessible Papers Do Not Necessarily Deserve the Same Effort
Hypothetical Example
One paper may change the synthesis; the other probably will not
Imagine that you are conducting a systematic review and encounter two inaccessible papers. Paper A appears, from its title and abstract, to be the only study involving an important population and may meet your eligibility criteria. Paper B is cited in the introduction of another article for a general definition that is already supported by several accessible sources.
Paper A: Verify the citation Confirm the DOI, journal record, authors, and any related reports of the study.
Paper A: Use standard access routes Check institutional access, legitimate repositories, and library holdings.
Paper A: Escalate Use interlibrary loan or document delivery where available and contact the corresponding author if appropriate.
Paper A: Document the outcome If it remains unobtainable, record it as a report sought but not retrieved rather than silently excluding it after abstract screening.
Paper B: Clarify what you actually need Determine whether your argument depends on that specific source or merely on the general concept attributed to it.
Paper B: Stop when replacement evidence answers the question If accessible primary or authoritative sources adequately support the point and the original citation has no unique role, extensive retrieval may have little value.
The difference is not that Paper A is inherently “better.” Its absence creates greater uncertainty for the particular research task. Retrieval effort should respond to that uncertainty.
06 · What This Means for You
Use a Proportionate Retrieval Strategy
A simple decision framework
If the paper may determine eligibility, contribute unique data, or materially affect your conclusion
Use multiple legitimate retrieval routes and escalate to library or author assistance where appropriate.
If the source is useful but not unique
Try the standard high-yield routes, then consider whether accessible evidence adequately satisfies the same research need.
If the source is peripheral and readily replaceable
A limited retrieval effort may be proportionate; do not allow one citation to consume time needed for more consequential evidence.
If another retrieval route has a realistic chance of success
Consider the expected informational benefit before deciding whether to continue.
If reasonable routes have failed and additional searches merely repeat them
Stop, document the retrieval failure when relevant, and adjust your analysis or reporting accordingly.
For an informal literature search, your stopping rule may be quite modest. For a systematic review, evidence synthesis, replication, or historical analysis, the standard should generally be more explicit because missing evidence can alter the resulting evidence base.
Most importantly, do not turn “I could not obtain it” into “it does not matter.” Those are separate judgments. Sometimes the correct outcome is to stop searching while still acknowledging that the missing paper leaves uncertainty.
07 · A Quick Checklist
Before You Spend Another Hour Looking for One Paper
Before continuing the search, check:
Clarify exactly what information you expect the paper to contribute.
Determine whether the paper could materially affect eligibility, extraction, analysis, interpretation, or an important claim.
Confirm that you have already checked the DOI, current publisher page, institutional access, and appropriate legitimate repositories.
Consider interlibrary loan, document delivery, or librarian assistance when the source is sufficiently important.
Contact the corresponding author when direct contact is appropriate and other reasonable routes have failed.
Ask whether accessible primary evidence can genuinely answer the same question without substituting a non-equivalent source.
Consider whether another retrieval attempt has a realistic chance of producing new information.
Record unsuccessful retrieval attempts when transparency or reproducibility matters.
If you stop, distinguish inability to retrieve the paper from evidence that the paper is irrelevant or invalid.
11 · Cite this Guide
How to Cite This Guide
This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.
Recommended (Field Guide)
APA
MLA
Chicago
Copy Citation