Should You Keep Papers You Ultimately Exclude?

If a Paper Is Excluded, Is There Any Reason to Keep It?

You find a promising paper, screen it, perhaps even read the full text, and eventually decide that it does not belong in your study. The obvious next move may seem to be deleting it.

Sometimes that is perfectly reasonable. In other situations, however, the exclusion itself is information worth preserving.

This distinction becomes particularly important in systematic and other structured reviews, where you may later need to explain which studies were considered, where they left the selection process, and why. Even outside formal evidence synthesis, retaining selected excluded papers can prevent you from repeatedly rediscovering and reassessing the same sources.

You Do Not Need to Keep Every Excluded Paper

What You Keep Should Depend on What the Exclusion Means

Not All Exclusions Occur at the Same Stage

A paper rejected after glancing at its title is not equivalent to a paper retrieved in full text, carefully assessed against eligibility criteria, and then excluded.

This is one reason it helps to distinguish the stages a paper has passed through. The further a source progresses through a structured selection process, the more consequential its exclusion decision may become.

Systematic Reviews Require an Audit Trail of Study Selection

In systematic reviews, exclusion is part of the research process rather than merely personal library housekeeping. PRISMA 2020 uses a flow diagram to report the movement of records through identification, screening, retrieval, eligibility assessment, and inclusion. The diagram accounts for exclusions at different stages and includes reasons for reports excluded after eligibility assessment.

Cochrane guidance similarly requires study selection to be documented in sufficient detail to construct a flow diagram and a table of characteristics of excluded studies. It notes that counts can be sufficient for records rejected during initial title and abstract screening, whereas studies that readers might reasonably expect to find in the review should have an explicit reason for exclusion.

You May Need the Exclusion Decision More Than the PDF

Keeping an excluded paper does not necessarily mean retaining its PDF forever. What often matters is preserving a reliable connection among the source, its screening status, and the reason for the decision.

For example, a structured review might preserve the citation, screening decision, stage of exclusion, and reason for exclusion in review software or another research record. The full-text file may also be retained according to the project's workflow, institutional requirements, access conditions, or data-management plan, but those are separate decisions.

This is closely related to the broader question of whether every downloaded paper belongs in your permanent reference library. A document can matter to the audit trail without needing to occupy the same organizational space as your actively used literature.

Record a Reason That Corresponds to Your Eligibility Criteria

For a structured review, an exclusion reason should normally explain which eligibility requirement was not met. Examples might include an ineligible population, study design, intervention, setting, publication type, or another criterion defined by the review.

Cochrane advises assessing eligibility criteria in a deliberate order where useful, so the first criterion that is not met can serve as the primary reason for exclusion. It also notes that a single explicit reason is generally sufficient for studies documented as excluded.

This matters because vague labels such as “not useful,” “bad paper,” or “irrelevant” may tell your future self very little about the actual decision.

Exclusion Is Relative to a Particular Research Question

A paper can be unsuitable for one review while remaining excellent research. It may investigate the wrong population for your question, use an ineligible design, address a different outcome, or fall outside a predefined date or setting restriction.

That distinction matters beyond systematic reviews. If a paper contains a useful method, theoretical framework, measurement instrument, definition, or discussion that may matter elsewhere, exclusion from the current evidence set is not a reason to erase it from your intellectual workspace.

In such cases, keep the source for the role it actually serves. Your organizational system can indicate that it was excluded from one project while remaining useful elsewhere.

Keeping Excluded Records Can Prevent Repeated Screening

Imagine finding the same highly plausible article six months later. Without a record of your earlier decision, you may retrieve it, reread it, and repeat the eligibility assessment before eventually reaching exactly the same conclusion.

A short exclusion record can prevent that cycle. This is particularly valuable when a paper's title and abstract make it appear eligible but a less obvious detail in the full text disqualifies it.

The principle is simple: preserve information when forgetting the decision would predictably create work, ambiguity, or problems with transparency later.

A Paper That Looks Perfect Until You Read the Methods

Deleting every trace of this paper would remove evidence of a meaningful selection decision. If another reviewer later asks why an apparently relevant study was absent, or if you encounter the article again, the exclusion record provides the answer immediately.

The paper could also remain useful for a different project. Its exclusion tells you that it does not answer this particular review question under these eligibility criteria. It does not establish that the study itself lacks value.

Common Mistakes With Excluded Literature

Preserve What You Would Need to Reconstruct the Decision

Your retention strategy should reflect the type of literature work you are doing. There is little benefit in constructing a systematic-review-style exclusion database for every casual search. Conversely, a formal review should not depend on your memory of why dozens of apparently relevant papers disappeared from consideration.

The most useful system is one in which exclusion remains a recoverable decision rather than becoming disappearance. As your collection develops, make sure a paper's status remains distinct from the notes and claims you extract from it, particularly when the same source participates in several projects.

Before Deleting an Excluded Paper or Record

Questions About Keeping Excluded Studies

Exclusion Should Remain Explainable

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.