01 · The Question
Does Downloading a Paper Mean You Should Keep It?
You search a database, follow references, open promising results, and download PDFs that might be useful. Before long, your computer contains dozens or hundreds of papers, many of which you have barely examined.
Should all of them become permanent entries in your reference manager?
The question matters because downloading is usually a low-threshold action. You may download a paper simply because its title looks relevant, because you want to inspect one table later, or because you are not yet sure whether it matters. A permanent reference library serves a different purpose: it should help you reliably recover sources that remain useful to your research.
Confusing those two actions can turn a reference library into a record of browsing history rather than a usable research system.
03 · What You Need to Know
Think of Downloading and Keeping as Two Different Decisions
Downloading Is Usually a Discovery Decision
A download often means little more than, “This looks sufficiently relevant that I want access to the full text.” At that point, you may know only the title and abstract. You have not necessarily evaluated the paper's methods, findings, relevance, or role in your research.
This is why the threshold for downloading can reasonably be low. During literature searching, rejecting potentially useful papers too early may be less desirable than temporarily collecting plausible candidates for closer inspection.
The decision to add a paper to your reference library , however, can use a higher threshold. Once you know more about the source, you can decide whether it deserves a durable place in your research system.
Temporary acquisition
You obtain the paper because it might be useful and you need the full text to evaluate it.
Permanent retention
You keep the paper because it has continuing evidentiary, methodological, conceptual, contextual, or documentary value.
A Reference Library Does Not Have to Be an Archive of Everything You Encounter
Reference managers are capable of storing large numbers of records, so the problem is not simply whether the software can handle another paper. The more important question is whether retaining the item improves your ability to find, understand, and reuse literature later.
A permanent library may reasonably contain much more than papers you eventually cite. You might retain a seminal article that provides theoretical background, a methodological paper whose procedure you may reuse, a strong counterargument, a useful review article, or a study that helps you understand how a research area developed.
What matters is not whether the source appears in the final bibliography. The better criterion is whether there is a plausible reason you may need to retrieve the source or its bibliographic record again.
Your Library Can Contain Papers at Different Levels of Relevance
Permanent retention does not require every paper to have equal importance. A reference manager can distinguish among projects, topics, methods, reading status, and other categories rather than treating the library as one undifferentiated pile.
For example, Zotero allows a single item to belong to multiple collections without creating duplicate copies of that item. It also supports tags that can represent topics, methods, status, ratings, or workflow categories such as “to-read.” This makes it possible to preserve useful references while still separating actively relevant material from peripheral literature.
This distinction becomes especially useful when you later decide how to tag papers by topic, method, finding, or argumentative role . Retention and organization solve related but different problems.
Keep the Bibliographic Record Even When You Do Not Need the PDF
Another useful distinction is between retaining a reference and retaining its full-text file. In reference-management systems, the bibliographic item and the PDF attachment need not be conceptually treated as the same thing. Zotero, for example, distinguishes regular bibliographic items from attachments and notes; regular items contain the metadata needed for citation and other reference-management functions.
You may therefore decide that a source is worth remembering while the local PDF is not worth retaining. Perhaps the article is readily available online, you only needed to inspect one detail, or storage constraints matter to you.
Conversely, an orphaned PDF with no reliable metadata may be less useful than it appears. A permanent research library works best when the document remains connected to enough bibliographic information to identify and cite the source correctly.
Some Excluded Papers May Still Need to Be Preserved
“Not included in my analysis” does not necessarily mean “safe to erase.” This distinction is particularly important in structured evidence reviews.
PRISMA 2020 distinguishes records, reports, and studies and treats study selection as a documented process. Its reporting guidance calls for accounting for records removed before screening, records screened, reports assessed for eligibility, reports excluded with reasons, and studies ultimately included. For potentially relevant studies excluded after closer assessment, retaining enough information to reconstruct the decision may therefore be important.
That does not mean every systematic-review search result must live forever as a PDF in your main personal library. It means that retention decisions must respect the requirements of the research design and the audit trail you need to preserve. The question of whether to keep papers you ultimately exclude therefore depends partly on why they were excluded and what documentation your project requires.
A Permanent Library Should Support Retrieval, Not Hoarding
A simple test is to imagine encountering the paper again six months from now. Would you want your system to tell you that you have already evaluated it? Would you want access to your notes? Would you need its method, theoretical framing, findings, or citation details? Could it plausibly matter to another project?
If the answer to at least one of those questions is yes, retaining the reference may save future work.
If the paper was merely a false lead, has no continuing informational value, requires no exclusion record, and is unlikely to be useful elsewhere, permanent retention may add little.
Watch Out
Do not use “I am not citing this paper” as your deletion rule. Citation is only one possible role of a source. A paper may remain valuable for methods, theory, background, comparison, negative evidence, terminology, or future projects even when it never appears in the current manuscript.
Your Workflow Should Preserve Status, Not Just Files
A folder containing 500 PDFs tells you what you acquired. It does not tell you what happened to those papers.
For serious literature work, knowing whether something was merely discovered, screened, carefully read, included in an analysis, or actually cited may be more useful than knowing that its PDF exists. Keeping these stages conceptually separate helps prevent a large library from creating a false impression that every saved source has been evaluated.
A clear distinction among found, screened, read, included, and cited papers can therefore make a relatively large library manageable without pretending that every item has the same evidentiary status.
06 · What This Means for You
Give Papers a Reason to Stay
You do not need an elaborate scoring system for every download. You need a retention rule that is clear enough to prevent your permanent library from becoming indistinguishable from your temporary search pile.
The threshold can also vary by project. An exploratory literature search may justify keeping a broad range of background sources. A tightly specified review may require detailed records of screening and exclusion decisions. A paper downloaded only to answer a minor factual question may need no permanent place at all.
A simple decision framework
If the paper directly informs your current research
Keep the reference and organize it according to its role.
If it has reusable theoretical, methodological, contextual, or evidentiary value
Consider keeping it even if you do not currently expect to cite it.
If it was excluded but the exclusion needs to remain traceable
Preserve the necessary record and exclusion information rather than treating it as disposable.
If it belongs to another project
Keep one bibliographic item and associate it with the relevant projects rather than creating separate copies where your reference manager supports this.
If it was merely a false lead with no continuing value
There is usually little reason to preserve it permanently unless your research protocol requires a record.
The goal is not to create the smallest possible library. It is to create a library whose contents remain interpretable. A large, well-organized collection can be highly useful. A smaller collection can still be dysfunctional if you cannot tell why anything is there.
As your collection grows, periodically ask whether your literature management system is reducing or creating work . The answer is a better indicator of library quality than the number of papers it contains.
07 · A Quick Checklist
Before Making a Download a Permanent Reference
Before permanently retaining a paper, check:
Can I identify a current or plausible future research use for this source?
Have I evaluated the paper enough to know why I am keeping it?
Does the item have sufficient bibliographic metadata for me to identify and cite it reliably later?
Is this already in my library under another record or PDF?
If I excluded it, do I need to preserve the exclusion decision for transparency or reproducibility?
Would a status tag, collection, or other organizational marker make its role clear?
Do I need the full-text attachment permanently, or would retaining the bibliographic record be sufficient?
If I encounter this paper again months from now, will my library tell me what I already learned or decided about it?
11 · Cite this Guide
How to Cite This Guide
This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.
Recommended (Field Guide)
APA
MLA
Chicago
Copy Citation