What Should You Do When the Literature Contradicts Your Research Assumptions?

What if the literature is telling you that your starting assumption may be wrong?

You begin with what seems like a reasonable idea: perhaps a teaching strategy improves achievement, a workplace condition increases motivation, or a particular theory explains a behavior. Then you start reading seriously. Instead of supporting your expectation, much of the literature points in another direction.

This can feel like a problem because researchers often develop questions, hypotheses, and even tentative study designs before they have fully examined the evidence. Once you have invested time in an idea, contradictory literature can start to feel like something that needs to be overcome.

Usually, it should be treated as information instead. The literature review is partly a mechanism for discovering whether the assumptions behind a proposed study survive contact with what is already known.

Do not try to make the literature agree with you

A contradiction can mean several very different things

First, identify exactly what has been contradicted

Researchers sometimes say that the literature contradicts their study when the disagreement is much narrower. Separate your research problem, theoretical assumptions, expected relationships, hypotheses, and proposed intervention. Evidence against one does not automatically invalidate the others.

For example, suppose you assume that greater use of an educational technology improves student achievement. Studies showing little association between frequency of use and achievement challenge that expected relationship. They do not necessarily show that the technology is educationally irrelevant. Effects might depend on how it is used, what students do with it, which outcomes are measured, or the conditions under which it is implemented.

This distinction matters because the appropriate response depends on what the evidence actually challenges. Literature indicating that an expected effect may be absent presents a different problem from evidence suggesting that the underlying research problem itself is poorly supported.

Check whether the apparent contradiction is really comparable evidence

Two findings can point in different directions without actually addressing the same empirical question. Before concluding that the literature contradicts your assumption, compare the populations, settings, constructs, measures, interventions, comparison conditions, study designs, and time periods involved.

A finding among university students does not automatically establish what happens among elementary pupils. Evidence concerning short-term test performance may not settle a claim about long-term retention. An observational association and an experimental estimate may also answer different questions.

The key question is not simply, “Does this paper agree with me?” It is, “How directly does this evidence bear on the assumption I am making?”

Consider the strength of the evidence, not the number of papers on each side

Literature review should not become a vote count. Ten weak or highly overlapping studies do not necessarily outweigh two rigorous studies that address the question more directly.

Consider study design, sample adequacy, measurement quality, risk of bias, consistency, precision, directness, and whether apparently independent studies rely on similar datasets or methodological assumptions. Also consider missing evidence. Selective availability of statistically significant or favorable findings can distort the published record, which is one reason systematic reviews examine risks associated with missing results rather than assuming that the visible literature represents all conducted research.

Contradictory findings may reveal heterogeneity rather than a simple disagreement

Sometimes the literature really is inconsistent. One group of studies reports positive effects, another finds negligible effects, and perhaps another reports effects in the opposite direction. That pattern should not automatically be compressed into a single claim that “the literature is mixed.”

Ask whether the variation is systematic. Effects may differ according to population, implementation, measurement, dosage, research design, setting, or another plausible moderator. Methodological guidance for evidence synthesis likewise cautions that substantial variation in results, particularly inconsistency in the direction of effects, can make a simple average misleading. Explorations devised only after seeing such heterogeneity should generally be treated cautiously and as hypothesis-generating rather than definitive explanations.

In that situation, the contradiction may help you formulate a more precise question. The interesting question may no longer be whether X affects Y, but under what conditions, for whom, through what mechanism, or using which operationalization the relationship appears.

Sometimes your assumption really should change

Researchers are allowed to be wrong before conducting the study. In fact, discovering that an initial assumption is poorly supported is one of the useful outcomes of reviewing literature before collecting data.

If multiple strong and directly relevant sources undermine an assumption, retaining it merely because it motivated your original idea is difficult to justify. You may need to narrow the claim, replace the hypothesis, reconsider the theoretical framework, or change the research question.

In more consequential cases, the evidence may indicate that the proposed research problem itself may not exist in the form originally assumed. That deserves examination before further design decisions are made.

Changing your thinking is different from rewriting history

There is nothing inherently problematic about revising an idea because you learned something from the literature. Science depends on researchers updating claims in response to evidence.

The problem arises when the chronology is concealed. If a hypothesis or explanation was developed after examining evidence or results, presenting it later as though it had always been the original prediction can misrepresent the research process. Kerr's discussion of HARKing, or hypothesizing after results are known, addresses the related problem of presenting post hoc hypotheses as though they were specified a priori.

You can therefore change your mind. Just be transparent about what was initially expected, what evidence changed your reasoning when that history is relevant, and which claims are confirmatory versus exploratory.

Contradiction does not automatically make a study unnecessary

Evidence against your assumption may sometimes make the proposed study less defensible, but not always. A contradiction can expose an unresolved boundary condition, a methodological disagreement, an inadequately studied population, or competing explanations that existing research cannot distinguish.

The important distinction is between evidence that largely settles your proposed question and evidence that creates a meaningful unresolved question. In the latter situation, contradictory literature can make further investigation more informative.

From “the literature is against my idea” to a better research question

Common ways researchers mishandle contradictory literature

Let the contradiction determine what needs reconsideration

When the literature challenges an assumption, resist making an immediate binary decision to either defend or abandon your study. Diagnose the disagreement first.

This is also where intellectual separation between literature review and justification becomes important. Your task is first to determine what the evidence says. Only then should you decide what study, if any, follows from it. Reversing that order encourages the literature review to become a hurdle used to justify a study already chosen.

Before deciding what contradictory literature means, check:

Questions researchers ask when the evidence challenges their idea

Your assumption is allowed to lose an argument with the evidence

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.