Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Do You Find Negative or Null Studies That Were Never Published?

Negative and null studies can be disproportionately difficult to find because some never reach journals. Finding them requires tracing studies independently of their results through registries, grants, reports, organizations, references, and researcher contact.

216
Finding Unpublished Negative or Null Studies Guide 216 of 899
01 · The Question

How do you search for a study precisely because it may never have become a paper?

A database search can retrieve a published article with a positive result and a published article with a null result. The harder problem is the study that was conducted, produced an unremarkable, negative, or null finding, and never entered the searchable journal literature at all.

This matters because empirical evidence has repeatedly shown that publication can be associated with the direction or statistical significance of results. A systematic review of publication-bias studies found that trials with positive findings were more likely to be published than trials with negative or null findings.

You cannot solve that problem simply by adding “null results” to a PubMed or Scopus query. If the study was never published there, the database has nothing to retrieve. You need to search for evidence that the study existed independently of whether its results became a journal article.

02 · The Short Answer

Search for studies before you search for their findings

In Brief

To find unpublished negative or null studies, search sources that record research independently of journal publication, including study registries, grant databases, regulatory sources, organizational reports, conference material, theses, protocols, and direct researcher contacts where appropriate.

Do not assume that every unpublished study had a negative or null result. The aim is to identify missing studies without knowing their findings first, then determine whether results exist and what they actually show.

03 · What You Need to Know

Finding missing null results requires a different search strategy

Negative, null, and unpublished are not synonyms

Researchers sometimes use these terms loosely, but they describe different things. A null result generally indicates that the study did not detect the hypothesized difference or association under the analysis performed. A negative result may refer to a result that does not support the hypothesis, favours a comparator, or is otherwise regarded as unfavourable. Definitions vary by context.

Unpublished describes dissemination status. An unpublished study could have positive, negative, null, mixed, or inconclusive results.

Null or negative result Describes something about the study's findings or their interpretation.
Unpublished study Describes the study's dissemination status, not what its findings were.

Keeping those concepts separate protects you from an important inferential error: finding a missing study does not tell you why it is missing.

Why might null or negative findings be harder to find?

Publication bias occurs when the likelihood of publication is influenced by the direction or strength of results. WHO uses this definition in its clinical-trial terminology and identifies publication bias and selective reporting as reasons trial registration is important.

Empirical research has found that positive clinical-trial findings have historically been published more frequently and more quickly than negative or null findings. One systematic review estimated that trials with positive findings were substantially more likely to reach publication than those with negative or null findings.

The result can be a published evidence base that differs systematically from the underlying research that was conducted. This is the practical problem behind the file drawer problem.

Do not search only for the words “negative” and “null”

Searching bibliographic or web databases for “negative results” can retrieve some useful material, but it cannot recover studies whose results were never publicly described using those terms.

Instead, search for studies based on characteristics that existed before their results were known: intervention, population, research question, project title, investigator, sponsor, institution, grant, protocol, trial registration, conference presentation, or study identifier.

This is the core methodological shift. You are trying to reconstruct the population of studies, then determine which results are available.

Search study registries when the research type is registered

Clinical trial registries are particularly valuable because registration can create a public record before results exist. WHO notes that a registry record may be the only publicly available document about a trial until its results are published and explicitly recognizes the relevance of registry records for ongoing or unpublished trials.

Look for completed studies without identifiable journal reports, then investigate whether summary results have been posted. WHO's current guidance emphasizes public reporting of both positive and negative trial results and notes that incomplete reporting can leave a misleading evidence base.

For health-intervention reviews, this makes clinical trial registries an important route to completed but unpublished research.

Search grant databases for projects that disappeared from the publication trail

Funding records can establish that research was planned and funded independently of whether it later generated a paper. Search project titles, principal investigators, institutions, dates, abstracts, and grant numbers, then trace the project forward.

A completed grant with no obvious publication is not proof of a null result. The study may have changed, failed to proceed, produced outputs you have not found, or still be awaiting publication. Nevertheless, grant databases can reveal research projects worth investigating.

Conference material can reveal studies that subsequently vanished

Conference abstracts, posters, programmes, and proceedings may record research before full publication. If an apparently eligible conference study never becomes a journal article, trace the authors, study title, institution, registration number, and project identifiers.

A conference abstract may provide too little information for reliable extraction or appraisal, but it can establish a useful lead. When the full report cannot be found, the problem becomes what to do with a conference study that never appears as a full paper.

Search theses, dissertations, reports, and institutional repositories

Not every null finding is completely undisclosed. Some results may exist outside journals in dissertations, technical reports, institutional repositories, working papers, funder reports, government publications, or organizational research.

This is why searching theses, dissertations, reports, and working papers can recover evidence that conventional publication searches miss.

Use authors, supervisors, institutions, project titles, distinctive study terms, and dates to connect grey-literature records with known research programmes.

Regulatory documents can expose missing clinical studies and outcomes

For medicines and other regulated interventions, regulatory submissions and assessment documents may contain information about studies that are absent from journal databases or provide results not fully reported in publications.

Searching regulatory documents for evidence missing from journal articles can therefore be important when the intervention has undergone a regulatory process.

Follow researchers, not just papers

If you identify an investigator associated with a potentially missing study, search the investigator's publication history, institutional profile, ORCID record where available, project pages, co-authors, and subsequent papers.

A study title may change substantially between protocol, conference presentation, dissertation, report, and journal publication. Investigator names, sample characteristics, study dates, interventions, and institutional affiliations can help establish whether apparently different records describe the same study.

Contact researchers when the missing study could matter

Direct contact can sometimes clarify whether a study was completed, whether results exist, whether a manuscript was published under another title, and whether data can be shared.

Researcher contact is not guaranteed to succeed, and selective responses can introduce their own problems. It should therefore be systematic where possible rather than reserved for studies you happen to find interesting. Whether direct contact is justified depends on the importance of the missing evidence and the resources available.

Search for missing studies symmetrically

There is a subtle methodological trap here. If you search aggressively for unpublished studies only after seeing a surprisingly positive meta-analysis, your additional retrieval process can become outcome-driven.

A better strategy is to specify in advance which unpublished sources you will search and apply those procedures consistently. Research on publication bias has cautioned that searches for unpublished studies can themselves introduce selection problems when retrieval is uneven or dependent on researcher networks.

Watch Out

Do not label an unidentified or unavailable study “negative” simply because it was not published. Missingness is evidence about availability, not about the direction of the missing result.

Finding the study does not mean you can use its result

A registry entry, grant record, or conference title may establish that research existed without providing enough information for inclusion in a meta-analysis.

Separate three questions: Does the study exist? Does it meet your eligibility criteria? Are usable results available?

A study can be important to your assessment of missing evidence even when the answer to the third question is no. WHO guidance recognizes that unpublished and selectively reported results can leave decision-makers with an incomplete view of intervention benefits and harms.

04 · A Practical Example

How to trace a study that disappeared after registration

Hypothetical Example

Your published evidence contains five studies, but the registry contains six

Imagine that you are conducting a systematic review of an intervention. Five published trials meet your criteria. A registry search identifies a sixth completed trial that appears eligible but has no linked journal article.

Verify the study You inspect its registration date, intervention groups, eligibility criteria, outcomes, investigators, sponsor, recruitment status, and completion date.
Search for outputs You search the registration number, investigator names, trial acronym, intervention, sponsor, and distinctive study details across bibliographic databases and other relevant sources.
Check alternative dissemination You look for registry results, conference abstracts, dissertations, regulatory documents, institutional reports, and related project pages.
Contact If the study remains unresolved and could materially affect the review, you contact the investigators using a standardized request for publication status and results.
Document If results remain unavailable, you record the study as potentially eligible missing evidence. You do not assign it a null effect simply because no results were obtained.

The objective is not to make the missing study fit a publication-bias narrative. It is to establish as accurately as possible what research was conducted and what evidence remains unavailable.

05 · What Researchers Often Get Wrong

Common mistakes when looking for unpublished negative or null results

Misconception

Every unpublished study probably had a null result

No. Publication can fail for many reasons. You cannot infer the direction, magnitude, or statistical significance of a missing result from publication status alone.

Misconception

Searching journal databases more thoroughly will eventually find unpublished studies

A better database query can improve retrieval of indexed literature, but it cannot retrieve a study that never entered the database. Search sources that record research outside journal publication.

Misconception

A statistically non-significant study shows that there is no effect

Failure to reject a null hypothesis is not generally proof that the true effect is exactly zero. Interpretation depends on the estimate, uncertainty, design, statistical power, and research question rather than the p-value alone.

Misconception

Once you find a registry record, you have found the study's results

A registry can establish that a study was registered without containing usable results. Check whether summary results are available and search for other reports before deciding what information can enter the synthesis.

Misconception

Adding a few unpublished studies automatically eliminates publication bias

No. Unpublished evidence can itself be retrieved selectively. The aim is a systematic, transparent search for missing evidence rather than an ad hoc collection of studies obtained through convenient contacts.

06 · What This Means for You

Build the search around study existence, not expected results

If negative or null research may be missing, your search strategy should identify studies independently of what they found. That means moving upstream from publications toward registrations, grants, protocols, conferences, organizations, and researchers.

A simple decision framework

If the study type is prospectively registered
Search appropriate registries for completed studies and match them systematically to publications and posted results.
If relevant research is commonly grant funded
Trace funded projects forward to studies, registrations, reports, and publications.
If conferences are important dissemination venues in the field
Trace eligible-looking abstracts and presentations to subsequent publications or other results sources.
If governments, NGOs, institutes, or companies conduct relevant research
Search their report repositories and project pages rather than relying solely on academic databases.
If an unresolved study could materially affect the review
Consider investigator or sponsor contact and document the response or non-response.

Searching can expand indefinitely, so comprehensiveness has practical limits. Decide prospectively which sources matter most and how far you will pursue unresolved studies. The appropriate stopping point depends on whether searching for unpublished research is worth the effort for your particular synthesis.

07 · A Quick Checklist

Before concluding that negative or null studies are missing

When searching for unpublished results, check:
Whether your protocol specifies unpublished and grey-literature sources before you know what those searches will find.
Study or trial registries appropriate to the research design and discipline.
Relevant grant databases and completed funded projects.
Conference abstracts, proceedings, theses, dissertations, technical reports, regulatory sources, and organizational repositories where relevant.
Registration numbers, grant numbers, project names, investigators, institutions, sponsors, and study acronyms that can connect records across sources.
Whether apparently unpublished studies actually have publications under different titles or terminology.
Whether usable results are posted or available separately from a journal article.
Whether important unresolved studies justify contacting investigators, sponsors, or organizations.
Whether you have avoided inferring the direction of results merely from non-publication.
08 · Frequently Asked Questions

Questions about finding unpublished negative and null research

Are negative studies really less likely to be published?

Empirical research has found an association between study results and publication in several settings. A systematic review of clinical-trial cohorts found positive findings were published more often than negative or null findings, although the magnitude and nature of publication bias can vary across fields and contexts.

Is a null result the same as evidence that nothing works?

No. A statistically non-significant result does not establish that the true effect is exactly zero. The effect estimate, confidence interval or other uncertainty measure, study design, sample size, and inferential framework all matter.

Can I search Google Scholar for unpublished studies?

It can help locate publicly accessible reports, theses, working papers, repositories, and other documents, but it cannot reveal research that has never been publicly posted or indexed. Use it as one route rather than treating it as a complete unpublished-study registry.

Can trial registries contain results even when there is no journal paper?

Yes. WHO supports public disclosure of summary results through trial registries as well as journal publication, so a registry may contain results for a study without a corresponding journal article.

Should I contact researchers asking specifically for negative results?

A neutral request for eligible unpublished or unreported studies is generally methodologically cleaner than assuming which investigators possess negative findings. Describe your eligibility criteria and ask about relevant completed research regardless of its result.

What if I know a study exists but cannot obtain its results?

Document the study and your attempts to locate its results. Depending on the review method, it may be listed as awaiting information, an unresolved potentially eligible study, or otherwise handled according to the review protocol. Its existence may still matter when considering missing evidence.

Will searching unpublished studies completely solve publication bias?

No. Some studies may remain undiscoverable, records may be incomplete, investigators may not respond, and unpublished-study searches can themselves retrieve evidence selectively. The aim is to reduce and assess the problem, not claim perfect recovery of every study ever conducted.

09 · The Bottom Line

Look for the missing study before guessing what it found

The Bottom Line

Finding unpublished negative or null studies requires searching for research independently of its results through registries, grants, conference records, grey literature, regulatory sources, organizations, project trails, and researcher contact.

Apply those searches systematically and resist interpreting absence as a result. First establish that a study existed, then determine whether it is eligible and whether its findings can be recovered. That distinction is central to investigating publication bias without creating a new bias in the process.

10 · Sources and Further Reading

Sources on unpublished negative and null research

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes