Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Should the Literature Change the Assumptions Behind Your Study?

Every study rests on assumptions, including some you may not realize you are making. Learn how the literature can expose assumptions that need stronger support, qualification, testing, or abandonment before they undermine the study.

870
Rechecking Your Study Assumptions Guide 870 of 899
01 · The Question

What Are You Assuming Before the Study Has Even Begun?

Your study begins making claims before you collect a single observation.

You may assume that two concepts are meaningfully distinct, that a questionnaire captures the construct named in your research question, that findings from one population are relevant to another, that an intervention operates through a proposed mechanism, that groups are sufficiently comparable, or that a relationship reported repeatedly in previous studies provides a sound foundation for your hypothesis.

Some of these assumptions may be well supported. Others may be convenient simplifications. A few may turn out to be precisely what the literature gives you reason to question.

A literature review should therefore do more than accumulate evidence for your proposed study. It should expose the assumptions on which the study depends and ask whether the existing evidence still permits you to make them.

02 · The Short Answer

The Literature Should Challenge the Premises Your Study Depends On

In Brief

The literature should change an assumption behind your study when prior evidence contradicts it, weakens the evidence supporting it, shows that it holds only under particular conditions, or reveals that the assumption has never been adequately tested in the first place.

Do not use the literature only to confirm the rationale you arrived with. Identify which assumptions are necessary for your question, design, measurement, analysis, and interpretation, then determine whether each should be retained, qualified, tested directly, designed around, or abandoned.

03 · What You Need to Know

Every Research Design Contains Assumptions

Some Assumptions Are Visible; Others Hide Inside Ordinary Research Decisions

Researchers readily recognize formal statistical assumptions because textbooks often label them as such. Yet studies depend on assumptions long before a statistical model is fitted.

If you use a scale developed elsewhere, you assume that its scores can support the interpretation you need in your population. If you compare naturally occurring groups, you make assumptions about whether alternative explanations can be handled adequately. If you transfer a theory to a new context, you assume that the relevant concepts and relationships remain meaningful there. If you choose a short follow-up period, you may assume that the phenomenon of interest should already be observable.

These assumptions differ in kind and require different forms of scrutiny.

Type of assumption Example What the literature may reveal
Conceptual Two constructs treated as distinct really represent different phenomena. Definitions overlap or the distinction is disputed.
Theoretical A proposed mechanism explains why one variable affects another. Competing explanations exist or the mechanism has weak empirical support.
Measurement An instrument adequately represents the intended construct. Validity evidence is limited, population-specific, or inconsistent.
Population Knowledge from one group applies to another. Relevant characteristics differ or applicability has not been established.
Design or causal The observed contrast can be interpreted as evidence about the effect or relationship of interest. Confounding, selection, time trends, co-interventions, or other explanations threaten that interpretation.
Temporal The selected observation period is sufficient for the phenomenon to emerge. Effects develop, disappear, reverse, or accumulate over a different time scale.
Statistical The planned analytical model is appropriate for the structure and properties of the data. Previous data or methodological work suggests violations that require another model or diagnostic strategy.

The categories can overlap. The point is not to create a taxonomy for its own sake. It is to notice that “assumptions” extend well beyond the checklist attached to a statistical test.

Do Not Use the Literature Only as a Prosecutor for Your Hypothesis

A proposal can become an exercise in assembling citations that support what the researcher already intends to do.

That is a weak use of prior research.

NIH guidance on rigor and reproducibility provides a useful example from biomedical research. Applicants are expected to assess strengths and weaknesses in the prior research that provides key support for a proposed project and to explain how weaknesses or gaps will be addressed. NIH explicitly distinguishes the rigor of prior research from simply stating a hypothesis or the importance of the project.

The principle travels beyond NIH-funded biomedical work: evidence used as the foundation of a new study should be examined critically, not treated as sound merely because it has been published.

Repeated Findings Do Not Automatically Make the Underlying Assumption Secure

Ten studies can reproduce the same association while sharing the same limitation.

They may all use the same questionable measure. They may draw from similarly restricted samples. They may employ designs vulnerable to the same confounding structure. They may all cite the same original theoretical proposition without testing the mechanism it proposes.

Repetition therefore increases confidence only in relation to what was actually repeated. If the same assumption remains embedded in every study, another study built on that assumption may perpetuate rather than resolve the problem.

This is one reason to inspect the weaknesses that recur across previous studies, rather than simply counting how many papers appear to support the premise.

The Literature May Turn an Assumption Into a Research Question

Sometimes the assumption underneath your original project is more interesting than the question you planned to ask.

Suppose you intend to study whether greater use of an educational platform predicts better academic performance. Your rationale assumes that more platform activity represents greater learning engagement. Yet the literature reveals that activity counts can include passive navigation, repeated attempts caused by difficulty, administrative access, or behaviors only weakly related to cognitive engagement.

You now have a choice. You could preserve the assumption and proceed. You could use a stronger measure of engagement. Or the relationship between platform activity and meaningful engagement might itself become something requiring investigation.

Good literature review can therefore move a proposition from the background of the study into the foreground.

Contradictory Evidence May Reveal a Boundary Rather Than Destroy an Assumption

An assumption does not have to be universally true to remain useful.

Perhaps prior studies suggest that peer feedback improves revision quality, but the relationship appears mainly when students receive guidance on how to evaluate and use feedback. The assumption “peer feedback supports revision” may need qualification rather than abandonment.

The revised proposition becomes conditional: peer feedback may support revision under particular implementation conditions.

Those conditions can reshape the research question you ultimately ask, the population you include, the intervention you design, or the comparison you make.

A Published Association Does Not Automatically Support a Causal Assumption

This distinction deserves particular attention because causal language can enter a study quietly.

If previous observational research reports that students who use a resource more frequently obtain higher grades, that evidence establishes an association under the conditions of those studies. It does not by itself establish that increasing use would cause grades to improve.

Students who use the resource may differ in motivation, prior achievement, available time, instructor support, course characteristics, or other factors related to the outcome. Whether a causal interpretation is defensible depends on the design, data, assumptions, and analysis, not simply on the presence of an association.

Watch Out

Do not convert a recurring correlational finding into a causal premise merely because many studies report it. Repetition cannot repair an identification problem shared by the underlying designs.

Measurement Assumptions Can Reshape the Entire Study

If the literature weakens confidence in how a central construct has been measured, the consequences extend beyond the methods section.

Suppose a widely used “digital literacy” scale largely measures self-confidence with technology. If your research question concerns demonstrated ability, adopting the scale assumes that self-confidence adequately represents competence. The literature may not support that inference.

You may need another instrument, multiple forms of evidence, a narrower construct label, or a different question. This is why examining what outcomes the literature suggests you should measure can expose assumptions hidden inside familiar measurement practices.

Population Assumptions Should Not Hide Behind the Word “Generalizable”

Researchers sometimes assume that a finding established in one population should hold elsewhere unless someone demonstrates otherwise. In other situations, they assume the opposite and declare every new setting fundamentally different.

Neither position should be automatic.

Ask which characteristics could plausibly affect the phenomenon and whether existing evidence provides information about those characteristics. Applicability is an argument about relevant similarity and difference, not a binary property attached to a paper.

Methodological Assumptions Need Methodological Evidence

Not every assumption can be settled by substantive literature alone.

If your planned analysis depends on statistical assumptions, consult appropriate methodological guidance and evaluate those assumptions using the data and diagnostics relevant to the model. If your causal inference depends on assumptions about confounding, temporal ordering, interference, missing data, or measurement, identify those assumptions explicitly and choose a design capable of addressing them as far as possible.

Some assumptions cannot be verified empirically from the observed data. In such cases, transparency, substantive justification, robustness checks, sensitivity analyses, or alternative interpretations may be necessary. Pretending the assumption disappeared because it cannot be tested is not a particularly successful methodological strategy.

Changing an Assumption Can Cascade Through the Study

Assumptions are connected to design decisions.

If you no longer assume that two populations respond similarly, your sampling plan may change. If you no longer assume that a proxy represents the desired outcome, your measurement plan may change. If you no longer assume that a no-treatment group provides the relevant counterfactual, your planned comparison may need to change.

That cascade is not a sign that the literature review has derailed the project. It may mean the review is doing exactly what it should: preventing unsupported premises from becoming structural features of the study.

04 · A Practical Example

When the Literature Exposes the Assumption Underneath the Research Question

Hypothetical Example

Does More LMS Activity Mean Greater Student Engagement?

Imagine that you plan to investigate whether student engagement predicts academic performance. You intend to operationalize engagement using the number of actions recorded in the learning management system because previous studies frequently use digital activity logs.

Your initial design contains an unstated assumption: more recorded activity represents greater engagement.

Original assumption Higher LMS activity is an adequate indicator of greater student engagement.
What the literature reveals Engagement is multidimensional, while log data primarily capture selected observable behaviors. Similar activity counts can also arise from different behaviors and circumstances.
Why this matters A relationship between click activity and grades cannot automatically be interpreted as a relationship between the broader construct of engagement and grades.
Design response Narrow the construct to the specific behavioral activity represented by the logs, or add evidence capable of representing the broader engagement construct.
Interpretive response Ensure that eventual claims refer to what the measures actually support rather than silently restoring the broader assumption in the discussion.

The literature has changed more than a variable label. It has exposed a conceptual and measurement assumption that affects the research question, operationalization, and interpretation.

A different review might support the proxy sufficiently for the intended purpose. The correct response depends on the evidence. The important move is noticing that the proxy-to-construct connection was an assumption requiring justification at all.

05 · What Researchers Often Get Wrong

Common Mistakes When Evaluating Research Assumptions

Misconception

Assumptions Are Only the Conditions Listed Under a Statistical Test

Statistical assumptions are important, but research also relies on conceptual, theoretical, measurement, population, design, causal, and temporal assumptions. Some of these determine whether the statistical analysis answers the intended question in the first place.

Misconception

A Highly Cited Study Provides a Safe Foundation

Citation frequency does not establish the rigor of the evidence supporting a claim. Examine the design, measurement, population, analysis, uncertainty, and relevant subsequent evidence. NIH's current rigor guidance similarly emphasizes evaluating strengths and weaknesses of prior research used as key support for a proposed project.

Misconception

If Many Studies Make the Same Assumption, You Can Make It Too

Consensus can provide useful evidence when the assumption itself has been examined. It can also reflect inherited convention. Trace important assumptions back to their evidential basis rather than using repetition as a substitute for justification.

Misconception

Contradictory Evidence Means the Theory or Assumption Must Be Wrong

Contradiction can arise from differences in population, measurement, implementation, design, or context. It may identify a boundary condition rather than invalidate the underlying proposition entirely. Determine what the conflicting evidence actually challenges.

Misconception

If an Assumption Cannot Be Tested, You Do Not Need to Discuss It

Some important assumptions are difficult or impossible to verify directly from the available data. That makes transparent justification more important, not less. Where appropriate, sensitivity analyses or alternative interpretations can show how conclusions depend on uncertain assumptions.

06 · What This Means for You

Turn the Literature Review Into an Assumption Audit

After drafting the rationale and methods, read your proposed study with one question in mind: what must be true for this design to mean what I say it means?

Write down the consequential assumptions. Then return to the literature for evidence supporting, qualifying, or contradicting them.

A simple decision framework

If an assumption has strong and relevant support
Retain it while keeping the claim proportional to the evidence and applicable context.
If support is mixed or appears conditional
Qualify the assumption and consider whether the relevant boundary condition should enter the design.
If the literature directly challenges the assumption
Redesign the relevant part of the study or reformulate the question rather than quietly retaining the premise.
If the assumption is widely repeated but poorly tested
Treat its status as uncertain and consider whether testing it could become part of the study.
If the assumption cannot be verified directly
State it explicitly, justify it, and use robustness or sensitivity analysis when an appropriate method exists.

This exercise can expose a larger problem: once the unsupported assumptions are removed, the study you originally planned may no longer make sense. If so, consider whether the evidence now points toward a substantially different study.

Do not preserve the original design merely because revising it is inconvenient. The literature review has little methodological value if every conclusion is allowed to change except the plan it was supposed to inform.

07 · A Quick Checklist

Which Assumptions Is Your Study Asking Readers to Accept?

Before treating the literature as sufficient support for the study, check:
Can I identify the major conceptual, theoretical, measurement, population, design, causal, and temporal assumptions relevant to my study?
Have I examined evidence that contradicts the assumptions as well as evidence that supports them?
Am I relying on repeated findings that may share the same methodological weakness?
If I use a proxy, can I justify the assumed connection between the proxy and the construct or outcome I name?
If I make a causal claim, does the design address the alternative explanations relevant to that claim?
If I apply prior findings to a different population or context, have I examined whether relevant differences could affect applicability?
Have I distinguished assumptions supported by evidence from assumptions that remain uncertain or untestable?
Where an assumption is weak, have I changed the design, limited the claim, tested the assumption, or acknowledged the dependence explicitly?
08 · Frequently Asked Questions

Questions About Assumptions Behind a Research Study

What counts as an assumption in research?

An assumption is a proposition your study relies on without establishing it as part of every step of the investigation. Assumptions can concern concepts, theory, measurement, populations, causal relationships, research design, timing, data, or statistical models. Their importance depends on how much your conclusions rely on them.

Do I need to list every assumption in my paper?

No. Focus on assumptions consequential to the interpretation of the research question, design, measurements, analysis, and conclusions. Some methodological assumptions are best addressed where the relevant method is described rather than assembled into a generic list.

What if the literature disagrees about an assumption central to my study?

Do not present the assumption as established. The disagreement may justify qualifying it, designing the study to distinguish competing possibilities, or making the contested proposition part of the research question itself.

Can I base an assumption on theory rather than empirical evidence?

Theory can provide a legitimate rationale for a proposition, particularly when the study is intended to test that proposition. Be clear about its status. A theoretically predicted relationship is not the same as an empirically established one, and relevant contradictory evidence should still be considered.

How do I identify hidden assumptions in my study?

Take each major intended conclusion and ask what must be true for the design and evidence to justify it. Then inspect the links backward through measurement, comparison, population, timing, theory, and prior evidence. Assumptions often become visible where one kind of evidence is being asked to stand for something broader.

Does statistical assumption testing solve the problem?

No. Statistical diagnostics address only particular assumptions of particular analytical methods, and even those may not be fully testable from observed data. They do not establish conceptual validity, eliminate confounding, justify population transfer, or validate the theoretical premises of the study.

What if an important assumption cannot be tested?

State and justify it rather than treating it as fact. Where appropriate, examine whether conclusions change under plausible alternative assumptions through sensitivity or robustness analyses. The appropriate strategy depends on the design and the assumption involved.

Can challenging an assumption become the contribution of the study?

Yes. If a consequential assumption is widely used but weakly examined, testing, refining, or challenging it may provide a meaningful contribution. Its value depends on how important that assumption is to the existing body of knowledge and what your design can actually establish.

09 · The Bottom Line

Do Not Build the Next Study on Premises the Literature Has Already Weakened

The Bottom Line

The literature should change the assumptions behind your study whenever it gives you reason to doubt, qualify, restrict, or directly test the premises on which your question, design, measurement, or interpretation depends.

A literature review is not only a search for support. It is a stress test of the foundation on which the new study will stand. The useful outcome is not a study with no assumptions, which is unrealistic, but one whose consequential assumptions are visible, defensible, and treated with the degree of certainty the evidence actually permits.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes