Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Which Outcomes Are Neglected in the Existing Literature?

Some outcomes matter greatly yet receive little attention in the literature. Learn how to identify genuine outcome gaps without treating every unmeasured variable as a research opportunity.

743
Outcomes Neglected in the Literature Guide 743 of 899
01 · The Question

What Important Consequences Has the Literature Barely Measured?

Once you know what researchers measure repeatedly, another pattern becomes visible: outcomes that rarely appear at all.

An intervention may have dozens of studies on immediate performance but little evidence about whether improvements persist. A workplace program may be evaluated primarily through employee satisfaction while effects on actual behavior or workload receive less attention. Research may document intended benefits carefully while collecting relatively little evidence about harms, burdens, costs, or unintended consequences.

These absences can reveal meaningful gaps. They can also generate endless trivial ones. Almost any study could have measured something else. The important task is to identify outcomes whose neglect leaves a consequential part of the research problem unresolved.

02 · The Short Answer

A Neglected Outcome Matters When Its Absence Leaves an Important Consequence Unknown

In Brief

An outcome is meaningfully neglected when it is important to understanding the phenomenon or making relevant decisions but receives little, inadequate, inconsistent, or insufficiently informative measurement in the existing evidence base.

Do not define neglect solely by low frequency. Establish why the outcome matters, verify that the evidence concerning it is genuinely limited, and explain what important conclusion remains uncertain because that outcome has not been adequately studied.

03 · What You Need to Know

How to Find Outcomes the Literature Has Left Behind

Start With What Should Matter, Not Simply What Is Absent

A literature can theoretically contain an unlimited number of unmeasured outcomes. Most are not research gaps.

Begin by asking which outcomes are consequential to the research question, theory, intervention, population, or decisions the evidence is intended to inform. Depending on the field, these may include benefits, harms, behavior, quality of life, learning, retention, implementation outcomes, costs, equity-related consequences, participant experiences, or other outcomes with a clear substantive rationale.

Cochrane recommends that systematic reviews prioritize outcomes that are critical or important to users of the evidence and include relevant benefits as well as harms. It also cautions against selecting outcomes simply because they happen to be available in the studies being reviewed.

The same reasoning is useful when looking for neglected outcomes. Importance comes first. Scarcity comes second.

Compare Important Outcomes With Outcomes Actually Measured

Begin with your map of outcomes studied repeatedly in the literature. Then compare that distribution with the set of outcomes that would be needed for a fuller answer to the research problem.

Outcome pattern Possible interpretation What to investigate
Frequently and appropriately measured Substantial outcome-specific evidence may exist Strength and consistency of findings
Frequently measured but poorly operationalized Attention is high but evidence may remain limited Measurement validity and comparability
Measured occasionally Evidence may be emerging or fragmented Whether existing studies can support a useful conclusion
Important but rarely measured Potential outcome gap Why the outcome matters and why evidence is sparse
Measured but rarely reported Potential reporting problem Availability of results and risk of selective reporting
Not measured Possible absence of evidence Whether the outcome is genuinely relevant and whether the absence is verified

This comparison is more informative than simply sorting outcome counts from highest to lowest.

Neglect Can Mean Too Little Measurement, Not Complete Absence

An outcome does not need to be completely absent to be neglected. Five studies may measure it in a literature of 150 studies, or many studies may include it only as an exploratory secondary outcome with limited follow-up or inconsistent definitions.

The key question is whether the available evidence is sufficient for the conclusion researchers or decision-makers need.

This means outcome neglect can exist on a continuum: absent, rarely measured, inadequately measured, inconsistently measured, or measured in populations and settings too narrow to support the intended inference.

Look for Outcomes That Matter to Decisions but Not to Publication Habits

Researchers and stakeholders do not always prioritize the same outcomes. A technically convenient measure may dominate publications while outcomes that matter directly to participants, practitioners, or decision-makers receive less attention.

In health research, core outcome sets have been developed partly to address inconsistency in outcome selection and to encourage routine measurement of outcomes considered important within a particular clinical area. The COMET Initiative describes a core outcome set as an agreed minimum set that should be measured and reported, while allowing additional outcomes to be explored.

Where an established core outcome set or comparable disciplinary framework exists, it can provide a useful benchmark. Its absence, however, does not prevent researchers from identifying important outcomes through theory, prior evidence, stakeholder engagement, or the substantive aims of the research.

Look for Benefits Without Harms

One particularly consequential imbalance occurs when research concentrates on desirable outcomes while adverse, burdensome, or unintended consequences receive less systematic attention.

Cochrane recommends that critical and important review outcomes normally reflect potential benefit and potential harm.

The exact meaning of harm varies by field. In education, a program that improves performance might also increase workload, anxiety, inequity, dependence, or disengagement. In organizational settings, a productivity intervention could affect stress or turnover. These possibilities should not be invented merely to create negative outcomes, but plausible consequential effects should not disappear simply because they are less convenient to measure.

Look for Proxies Where the Real Outcome Is Missing

Researchers sometimes rely on outcomes that are easier or faster to measure than the consequence they ultimately care about.

Intention may stand in for behavior. Satisfaction may stand in for effectiveness. knowledge scores may stand in for competent performance. Immediate test scores may stand in for durable learning. A process indicator may stand in for a final outcome.

Proxy and intermediate outcomes can be scientifically useful. The problem arises when conclusions silently move beyond what those measures establish.

Proxy or intermediate outcome A measure used to represent or precede another consequence of substantive interest.
Outcome of ultimate interest The consequence researchers or decision-makers actually need to understand.

If the literature repeatedly measures the proxy while rarely examining the consequential outcome itself, that may represent an important outcome gap.

Look Beyond Immediate Outcomes

Time can conceal neglect. A literature may appear to measure an outcome frequently while almost never examining whether it persists.

Cochrane recommends specifying relevant outcome time points and, where appropriate, distinguishing short-, medium-, and long-term effects.

Thus, “long-term retention” can be neglected even when “retention” appears frequently in article keywords. The actual measurement schedule matters.

Look for Outcomes That Are Measured but Not Fully Reported

Outcome absence in publications does not always mean researchers failed to collect the outcome. Sometimes results are selectively reported.

PRISMA 2020 asks systematic reviewers to specify whether all results compatible with each outcome domain were sought and, when they were not, explain how results were selected. This reflects the broader concern that choosing which outcomes or results to report can distort the available evidence.

When protocols, trial registrations, study reports, or other records are available, distinguish between an outcome that was never measured and one that appears to have been measured but is not fully reported.

Watch Out

Do not interpret every missing published outcome as proof that researchers ignored it. The problem may be measurement, reporting, indexing, or your own eligibility criteria. Verify what the available records actually support.

Measurement Quality Can Create Functional Neglect

An outcome may appear in many papers yet still be poorly understood if researchers repeatedly use weak, inconsistent, or inappropriate measures.

Suppose dozens of studies claim to assess “engagement,” but each operationalizes it differently and some measures capture only satisfaction or frequency of platform use. Numerically, engagement is common. Conceptually, the evidence may be much thinner.

For this reason, outcome-gap analysis should consider measurement validity and conceptual alignment, not merely frequency.

Cross the Outcome Map With Population and Method

A neglected outcome may not be neglected everywhere.

Perhaps long-term outcomes are measured for adults but rarely for adolescents. Perhaps behavioral outcomes appear in experiments but not in field studies. Perhaps harms are assessed in clinical populations but not in community settings.

Cross-reference outcomes with populations missing from the evidence and methodological capabilities that are missing. Sometimes the strongest research gap lies at the intersection: an important outcome is poorly studied for a consequential population because the methods required to observe it have rarely been used.

Do Not Turn an Outcome Shopping List Into a Research Agenda

Once researchers begin listing everything previous studies did not measure, gap analysis can become absurdly easy. Almost every paper excludes thousands of conceivable outcomes.

A defensible neglected outcome should pass a stronger test:

The outcome matters to the research problem, existing evidence does not adequately address it, and measuring it could materially change what researchers understand or what someone can reasonably decide.

Without that final condition, the outcome may simply be absent rather than consequentially neglected.

04 · A Practical Example

Finding the Important Outcome Hidden Behind a Popular Proxy

Hypothetical Example

When Intention Is Studied More Often Than Behavior

Imagine reviewing a hypothetical literature on adoption of an educational technology by university instructors.

Map the outcomes Most studies measure attitudes, perceived usefulness, ease of use, satisfaction, and intention to adopt.
Notice the imbalance Far fewer studies examine whether instructors subsequently use the technology, how consistently they use it, or whether use changes teaching practice.
Ask why the neglected outcome matters If the practical question concerns actual adoption, intention provides relevant information but does not by itself establish behavior.
Define the gap The literature contains extensive evidence about adoption intentions but comparatively limited evidence about subsequent sustained use and changes in instructional practice.
Research implication A study that tracks actual use over time could address a substantive outcome gap rather than simply adding another adoption-intention survey.

The contribution comes from the inferential difference between the outcomes. “Behavior has been studied less often” becomes meaningful because behavior is necessary to answer a question that intention alone cannot resolve.

05 · What Researchers Often Get Wrong

Common Mistakes When Identifying Neglected Outcomes

Misconception

Any Outcome Previous Studies Did Not Measure Is a Research Gap

No. There are virtually unlimited possible outcomes. A meaningful gap requires a substantive reason that the missing outcome matters to understanding the phenomenon or making an important decision.

Misconception

The Least Frequently Studied Outcome Must Be the Most Important Gap

Rarity and importance are separate properties. An outcome may be rare because it is peripheral to the question, while another moderately studied outcome may remain highly consequential and poorly understood.

Misconception

If Researchers Measure a Proxy, the Final Outcome Is Already Covered

A proxy can be informative without being equivalent to the consequence it represents. Determine what inference the proxy supports and whether direct evidence about the outcome of interest remains necessary.

Misconception

An Outcome Mentioned in Many Papers Cannot Be Neglected

It can be discussed frequently yet measured rarely, or measured using inadequate operationalizations. Count actual evidence rather than mentions.

Misconception

Short-Term Evidence Automatically Covers Long-Term Effects

No. Persistence is an empirical question. If the practical or theoretical issue concerns durability, immediate outcomes cannot substitute for appropriately timed follow-up evidence.

Misconception

Adding More Outcomes Always Makes a Study Better

Collecting unnecessary outcomes can increase participant burden, analytical complexity, multiplicity, and opportunities for selective reporting. Outcomes should be chosen because they serve the research question, not because a longer variable list looks comprehensive.

06 · What This Means for You

Prioritize Outcome Gaps That Would Change the Answer

When you identify an uncommon outcome, ask what would become knowable if researchers measured it properly. This separates a consequential evidence gap from an unused variable.

A simple decision framework

If an outcome is rare and peripheral to the research problem
Do not elevate its absence into a major research gap.
If the literature relies on a proxy for an outcome that matters directly
Determine whether measuring the consequential outcome itself would materially change the inference.
If benefits are well studied but plausible harms or burdens are not
Consider whether the missing evidence prevents a balanced assessment of consequences.
If immediate effects dominate but persistence matters
Treat the relevant long-term outcome as a potential gap and design follow-up accordingly.
If an important outcome appears often but measurement is poor or inconsistent
Frame the problem as an evidence or measurement limitation rather than claiming the outcome has never been studied.
If an established core outcome set or comparable framework exists
Use it as one authoritative reference for identifying important outcomes while considering additional outcomes justified by the specific research question.

A strong outcome gap can usually be expressed without the phrase “few studies.” State what consequence matters, what existing evidence measures instead, and what uncertainty remains as a result.

07 · A Quick Checklist

Before Claiming That an Outcome Is Neglected

Test the proposed outcome gap:
Can I explain why this outcome matters to the research question, theory, participants, practice, or decision-making?
Have I distinguished the outcome domain from the measures used to operationalize it?
Have I verified how often the outcome is actually measured rather than merely mentioned?
Have I considered whether the outcome is measured but incompletely or selectively reported?
Have I examined whether existing measures validly represent the outcome?
Have I checked whether timing explains the apparent gap, such as abundant immediate evidence but little long-term evidence?
Have I considered relevant benefits, harms, burdens, and unintended consequences where appropriate?
Where relevant, have I checked for an established core outcome set or comparable disciplinary framework?
Can I state what important uncertainty would be reduced by measuring this outcome?
08 · Frequently Asked Questions

Questions About Neglected Research Outcomes

How rare must an outcome be before it counts as neglected?

There is no universal numerical threshold. Consider both how much usable evidence exists and how important the outcome is to the research problem. A rarely measured but inconsequential outcome is not necessarily a meaningful gap.

Can an outcome be neglected even if several studies measure it?

Yes. The available studies may be too few, narrow, inconsistent, poorly measured, or short-term to support the inference that matters. Neglect concerns evidential adequacy as well as frequency.

Are proxy outcomes always a problem?

No. Proxy and intermediate outcomes can be useful and sometimes necessary. Problems arise when researchers treat them as equivalent to consequential outcomes without sufficient justification or when direct evidence remains important but largely absent.

Can long-term effects be considered a neglected outcome?

Yes, when persistence is substantively important and the literature measures the relevant outcome almost exclusively at short follow-up periods. The timing of measurement can define a distinct evidential question.

What is the difference between a neglected outcome and a missing method?

A neglected outcome concerns what consequence has not been adequately investigated. A methodological gap concerns the evidential capability needed to investigate a question. They may overlap when an outcome is neglected because the designs or measurements required to observe it are rarely used.

Should I always use a core outcome set when one exists?

In fields where a relevant core outcome set has been developed, it provides an important standardized minimum to consider and may improve comparability across studies. It does not prevent researchers from adding other outcomes required by their particular question.

Should a new study measure every neglected outcome I identify?

No. Prioritize outcomes that directly serve the research question and can be measured appropriately. Adding variables without a clear purpose can increase burden and complexity without materially improving the study.

09 · The Bottom Line

An Outcome Gap Matters When It Leaves an Important Consequence Unknown

The Bottom Line

A neglected outcome is not merely something previous researchers forgot to measure; it is an important consequence for which the existing literature provides inadequate evidence, leaving a meaningful part of the research problem unresolved.

Start with importance rather than rarity. Then verify the evidence gap, inspect measurement and timing, and explain what researchers cannot currently conclude because that outcome remains inadequately studied. Otherwise, every unmeasured variable becomes a “gap,” and eventually even the literature review needs a literature review.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes