Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Do You Write About a Literature That Has Failed to Establish an Effect Without Claiming the Effect Does Not Exist?

When a literature has failed to establish an effect, describe what the evidence supports and what remains uncertain rather than converting failure to demonstrate an effect into a claim that it does not exist.

599
Writing About a Literature That Has Not Established an Effect Guide 599 of 899
01 · The Question

How Do You Say “The Evidence Has Not Established This” Without Saying “This Does Not Exist”?

You have reviewed the literature and the expected effect has not been convincingly demonstrated. Studies are inconsistent, many results are nonsignificant, estimates are imprecise, or stronger studies have failed to reproduce earlier findings.

You need to write a conclusion. Saying “there is no effect” may go beyond the evidence. Saying “nothing can be concluded” may be equally misleading because the literature may have constrained some possibilities even if it has not settled the question.

The challenge is to write at the level of certainty the evidence actually supports: clear enough to say what has not been established, but precise enough not to transform uncertainty into proof of absence.

02 · The Short Answer

Write About the Status of the Evidence, Not the Existence of the Phenomenon

In Brief

When a literature has failed to establish an effect, state that the available evidence does not currently provide convincing, consistent, or sufficiently precise support for the effect, then specify what uncertainty remains. Do not automatically translate that evidential conclusion into “the effect does not exist.”

If the evidence is sufficiently precise to exclude effects of meaningful magnitude, you can make a stronger and more specific statement. Otherwise, distinguish lack of established evidence from evidence that the effect is absent.

03 · What You Need to Know

Good Scientific Writing Separates What Has Not Been Demonstrated From What Has Been Ruled Out

Begin with the evidential claim you can actually support

A literature review is not required to decide that an effect either exists or does not exist. Often the most accurate conclusion concerns the state of the evidence.

For example, “Current evidence does not establish a reliable improvement in the outcome” is a claim about what the available studies collectively support. “The intervention has no effect on the outcome” is a claim about the underlying effect itself.

The second statement requires stronger evidence than the first.

Claim about the evidence “The available studies have not established a consistent effect.”
Claim about the phenomenon “The effect does not exist.”

The distinction reflects the broader difference between absence of evidence and evidence of absence. A literature can fail to establish an effect while remaining compatible with effects large enough to matter.

Do not use “nonsignificant” as the conclusion of the literature

If most studies have p >.05, it may be tempting to write that “the literature is predominantly nonsignificant.” That describes a collection of threshold decisions rather than the scientific evidence researchers actually care about.

Current Cochrane guidance explicitly recommends focusing interpretation on estimates of effect and their confidence intervals rather than relying on distinctions between statistically significant and nonsignificant results. The same logic is useful beyond intervention reviews.

Ask instead what the estimates show. Are they centered near zero? Do they mostly point in the same direction? Are their intervals wide? Does an appropriate synthesis produce a precise estimate? Is heterogeneity substantial?

Those features tell readers far more than the proportion of studies crossing p <.05.

State what remains compatible with the evidence

One of the most useful ways to avoid overclaiming is to identify the important possibilities that the evidence has not eliminated.

If a meta-analysis estimates a small average effect but its confidence interval includes both negligible and substantively meaningful benefits, say so. If the literature rules out large effects but remains compatible with small ones, state that distinction explicitly.

This allows you to move beyond the unhelpful extremes of “the effect exists” and “the effect does not exist.” Scientific evidence often narrows a range before it resolves a binary question.

Use effect magnitude to calibrate the language

Suppose a literature was initially interpreted as supporting a large effect. New evidence may show that effects of that magnitude are difficult to reconcile with the accumulated data while smaller effects remain plausible.

The appropriate conclusion is then not necessarily “the effect has been disproven.” A more accurate conclusion is that the evidence does not support the originally proposed magnitude, or that the plausible effect appears smaller than originally suggested.

This is a substantive advance. Ruling out a large effect can matter even when the existence of a very small effect remains unresolved.

Use stronger absence language only when the evidence warrants it

Sometimes a literature genuinely does provide evidence against effects large enough to matter. Estimates may be precise, studies may be methodologically credible, and equivalence analyses or other appropriate approaches may exclude prespecified meaningful effects.

In that situation, excessive hedging can also misrepresent the evidence. If credible research provides meaningful evidence that an effect is absent or very small, say what magnitude the evidence weighs against.

For example, “The accumulated evidence is inconsistent with improvements of the magnitude prespecified as educationally meaningful” is more informative than either “there is no effect” or “more research is needed.”

Match the verb to the strength of inference

Words such as “demonstrates,” “proves,” “rules out,” “suggests,” “does not establish,” and “remains compatible with” imply different evidential strengths. They should not be treated as stylistic synonyms.

Evidence situation More defensible wording Wording to avoid
Evidence is sparse or highly imprecise “The available evidence is insufficient to determine whether a meaningful effect is present.” “There is no effect.”
Several studies fail to establish a consistent effect “The literature has not established a consistent effect.” “Studies prove the effect does not exist.”
Large effects are excluded but small effects remain plausible “The evidence does not support an effect of the originally proposed magnitude, although smaller effects remain compatible with the data.” “The hypothesis has been completely disproven.”
Credible evidence excludes prespecified meaningful effects “The evidence weighs against effects large enough to meet the prespecified threshold of practical importance.” “It has been proven that absolutely nothing happens.”
Effects vary substantially across contexts “The average effect is uncertain or small, with evidence of variation across contexts.” “The intervention does not work.”

Avoid “no evidence” when there actually is mixed evidence

The phrase “there is no evidence of an effect” can itself be too strong or too vague. A literature may contain positive estimates, negative estimates, and uncertain studies. It may contain evidence, just not evidence strong or consistent enough to establish the claimed effect.

In such cases, “the evidence is inconsistent,” “the available estimates remain imprecise,” or “the evidence does not currently establish the proposed effect” may describe the situation more faithfully.

Do not let “more research is needed” replace the conclusion

When uncertainty remains, researchers often end with “more research is needed.” That may be true, but by itself it tells readers almost nothing about what the existing evidence has already established.

A useful conclusion should identify the remaining uncertainty. Does the field need larger samples to distinguish small from negligible effects? Better measurement? More representative populations? Direct replications? Studies testing proposed moderators?

Research recommendations are most useful when they follow from a specific evidential limitation rather than functioning as an academic reflex. The literature has suffered enough ceremonial calls for “further research.”

Keep the scope of the conclusion aligned with the studies

A literature may fail to establish an effect in one population, setting, outcome, or implementation without resolving whether the effect occurs elsewhere.

“The available randomized studies have not established an improvement in short-term achievement among university students” is narrower than “the intervention does not work.” That narrower sentence may also be considerably more accurate.

Scope is part of evidential precision. A carefully bounded conclusion is not weaker simply because it avoids claiming more than the studies tested.

04 · A Practical Example

Turning an Overstated Null Conclusion Into an Evidence-Calibrated One

Hypothetical Example

A literature on an educational technology intervention

Suppose twelve studies examine whether an educational technology intervention improves student achievement. Most individual tests are nonsignificant. The estimates generally favor the intervention slightly, but many studies are small and confidence intervals are wide. A meta-analysis produces a small positive average estimate whose interval includes both negligible and potentially useful effects.

Overstated version “The literature shows that the intervention has no effect on student achievement.”
What is wrong with it The accumulated evidence has not ruled out effects that could matter. Failure to establish a clear effect has been converted into evidence of exact or practical absence.
Overly vague version “Results are mixed, and more research is needed.”
What is missing The sentence does not tell readers what the literature has learned or why the uncertainty persists.
Better version “The available evidence has not established a reliable improvement in student achievement. Although the pooled estimate is small, the remaining uncertainty includes both negligible and potentially useful effects, so the literature does not yet support a conclusion that the intervention has no meaningful effect.”

The revised version is not simply more cautious. It is more informative. It identifies what has failed to be established and what possibilities remain open.

05 · What Researchers Often Get Wrong

Common Writing Errors When the Evidence Is Null or Inconclusive

Misconception

“No significant effect” can be shortened to “no effect”

No. Removing the word “significant” changes the claim. The first statement describes the outcome of a statistical test; the second makes a substantive claim about the underlying effect.

Misconception

If most studies are nonsignificant, “the literature shows no effect” is fair

Not necessarily. Statistical significance depends partly on precision. A collection of individually nonsignificant studies may collectively support an effect, remain inconclusive, or provide evidence for a negligible effect. Synthesis should focus on effect estimates and uncertainty rather than counting significance labels.

Misconception

Hedging every sentence prevents overstatement

Not necessarily. Phrases such as “may possibly suggest” can make writing vague without making it accurate. The better solution is to state precisely what the evidence supports and where the uncertainty lies.

Misconception

You should never write that evidence supports absence

That goes too far in the opposite direction. Precise, credible evidence can sometimes rule out effects of meaningful magnitude. When it does, stronger language is justified as long as the magnitude and scope of the conclusion are stated clearly.

Misconception

“More research is needed” adequately summarizes uncertainty

It does not explain what is uncertain or what future evidence must resolve. Specify whether the limitation concerns precision, bias, measurement, heterogeneity, population coverage, implementation, or another identifiable problem.

06 · What This Means for You

Make Your Sentence Carry the Same Certainty as the Evidence

Before writing the conclusion of a literature review, systematic review, discussion, or introduction, decide what kind of claim the evidence supports. Is the effect unestablished? Is its magnitude uncertain? Have large effects been ruled out? Is there credible evidence of practical equivalence? Or does the effect appear to vary across contexts?

A simple decision framework

If meaningful effects remain compatible with the evidence
Write that the effect has not been established or that substantial uncertainty remains.
If the evidence rules out the originally claimed magnitude but permits smaller effects
State exactly that rather than converting the result into complete absence.
If credible evidence excludes effects beyond a justified meaningful threshold
State that the evidence weighs against effects of that magnitude, while keeping the claim bounded to the studied conditions.
If estimates differ meaningfully across settings or populations
Describe the heterogeneity rather than forcing the literature into a universal effect-versus-no-effect conclusion.

When possible, replace generic null language with quantitative information. “The pooled estimate was small but imprecise enough to include effects of practical importance” communicates far more than “the effect was nonsignificant.”

Watch Out

Avoid using cautious grammar to conceal an overstrong substantive claim. “The intervention may have no effect” still introduces absence as the favored interpretation if the evidence merely remains uncertain. Describe the uncertainty itself when uncertainty is what the studies actually show.

07 · A Quick Checklist

Before Writing That a Literature Shows No Effect

Check whether your wording matches the evidence:
Distinguish failure to establish an effect from evidence that a meaningful effect is absent.
Describe effect estimates and uncertainty rather than summarizing the literature by significance labels.
Identify which effect magnitudes remain compatible with the accumulated evidence.
State when large effects have been constrained even if smaller effects remain possible.
Assess heterogeneity before making a universal statement about the effect.
Account for study quality, risk of bias, and missing evidence when calibrating the conclusion.
Keep claims within the populations, outcomes, settings, and conditions represented by the evidence.
Replace generic calls for more research with a specific description of what uncertainty future studies need to resolve.
Read the conclusion once more and ask whether it claims anything the evidence has not actually ruled in or ruled out.
08 · Frequently Asked Questions

Questions About Writing Null and Inconclusive Literatures

What can I write instead of “there is no effect”?

If the evidence remains uncertain, wording such as “the available evidence has not established a reliable effect” or “the evidence remains insufficient to determine whether an effect of practical importance is present” may be more accurate. The wording should reflect the actual estimates and uncertainty.

Is “no evidence of an effect” always safe wording?

No. A literature may contain some evidence without providing sufficiently consistent or precise support for the claim. In that situation, saying the evidence is inconsistent, uncertain, or insufficient to establish the proposed effect may be more precise.

Can I say an effect is absent if every study is nonsignificant?

Not on that basis alone. The studies may all be too imprecise to detect or exclude meaningful effects. Examine their effect estimates, uncertainty, methodological credibility, and accumulated evidence.

When can I use stronger wording about absence?

When credible evidence is sufficiently precise to rule out effects beyond a substantively justified threshold, stronger wording may be appropriate. Specify the magnitude being excluded rather than claiming an exact universal zero.

How should I describe a literature that rules out large effects but not small ones?

Say exactly that. For example, state that the evidence does not support effects of the originally proposed magnitude while smaller effects remain compatible with the data. This preserves an important scientific distinction that a simple “effect/no effect” conclusion would lose.

Should I call the literature “inconclusive”?

Only if you explain what remains unresolved. A literature can be inconclusive about whether a small effect exists while being quite informative in ruling out a large effect. The word alone does not communicate that distinction.

When can I say a consistently null literature is genuinely informative?

That becomes more defensible when the studies are credible, sufficiently precise, appropriately synthesized, and collectively constrain effects large enough to matter. Those conditions determine when a consistently null literature becomes genuinely informative.

09 · The Bottom Line

Say What the Literature Has Failed to Establish, Then Say What Remains Possible

The Bottom Line

When a literature has failed to establish an effect, write that the available evidence does not currently provide sufficiently convincing, consistent, or precise support for that effect, rather than automatically claiming that the effect does not exist.

Then make the conclusion informative: identify which effect sizes remain plausible, which have been constrained, where uncertainty comes from, and how broadly the evidence applies. If meaningful effects have genuinely been ruled out, say so explicitly. If they have not, preserve that uncertainty rather than writing it away.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes