Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

The Complete Library

All Research Guides

Browse every published guide in the Researcher's Field Guide, including the complete research journey and supplemental collections, listed alphabetically for quick reference.

Complete Library

Every published guide

Showing 3,701–3,750 of 5,065 guides

5,065 guides
PART 02 · SUBPART 38 · GUIDE 605

Can Expert Consensus Exceed the Evidence?

Can Expert Consensus Be Stronger Than the Underlying Evidence?

Strong expert agreement does not necessarily mean the underlying empirical evidence is equally strong. Consensus and evidence strength answer related but different questions and should be evaluated separately.

PART 02 · SUBPART 38 · GUIDE 603

Disagreement Within Consensus

How Much Disagreement Can Exist Within a Scientific Consensus?

Scientific consensus can coexist with substantial disagreement about mechanisms, magnitude, methods, and boundary conditions. The key question is whether disagreement challenges the central conclusion or mainly concerns what surrounds it.

PART 02 · SUBPART 38 · GUIDE 602

Does Every Study Need to Agree?

Does Consensus Mean Every Study Agrees?

Scientific consensus can remain strong even when individual studies disagree. What matters is how conflicting findings compare with the quality, consistency, and overall structure of the evidence.

PART 02 · SUBPART 38 · GUIDE 601

What Scientific Consensus Means

What Does Scientific Consensus Actually Mean?

Scientific consensus is the prevailing evidence-based judgment of a relevant scientific community, not a vote requiring unanimous agreement. Understanding what supports that consensus matters more than simply counting how many scientists agree.

PART 02 · SUBPART 37 · GUIDE 600

When a Consistently Null Literature Is Informative

When Is a Consistently Null Literature Genuinely Informative?

A consistently null literature becomes genuinely informative when credible studies collectively constrain effects large enough to matter. Repeated nonsignificance alone is not enough; precision, consistency, study quality, and the scope of the evidence determine what can be concluded.

PART 02 · SUBPART 37 · GUIDE 598

When a Null Finding Should Barely Change Your View

When Should a Null Finding Barely Change Your View?

A null finding should barely change your view when roughly the same result could easily have occurred whether the proposed effect was present or absent. Imprecision, weak measurement, poor implementation, and vague predictions can all make a null result weakly informative.

PART 02 · SUBPART 37 · GUIDE 597

When a Null Finding Should Reduce Confidence

When Should a Null Finding Reduce Confidence in an Effect?

A null finding should reduce confidence in an effect most when the study was capable of revealing the effect and nevertheless produced evidence difficult to reconcile with it. Weak or highly uncertain null findings may deserve much less weight.

PART 02 · SUBPART 37 · GUIDE 595

Can Many Underpowered Null Studies Establish No Effect?

Can Many Underpowered Null Studies Establish That Nothing Happens?

Many underpowered null studies do not establish that nothing happens merely because their individual results are nonsignificant. Their combined evidence can become informative, but only if the accumulated estimates meaningfully constrain effects that matter.

PART 02 · SUBPART 37 · GUIDE 594

Synthesizing Many Nonsignificant Studies

How Do You Synthesize a Literature With Many Nonsignificant Studies?

A literature containing many nonsignificant studies should not be summarized by counting null results. Synthesis should examine effect estimates, precision, heterogeneity, study quality, and whether the combined evidence can rule out effects that matter.

PART 02 · SUBPART 37 · GUIDE 592

When “No Significant Difference” Does Not Mean No Difference

When Does “No Significant Difference” Fail to Show That There Is No Difference?

“No significant difference” usually means the study did not establish a difference at the chosen significance threshold. Whether the evidence supports similarity depends on the effect estimate, uncertainty, study design, and what size of difference would actually matter.

PART 02 · SUBPART 37 · GUIDE 591

Absence of Evidence vs. Evidence of Absence

Absence of Evidence vs. Evidence of Absence: What’s the Difference?

Absence of evidence means the available study has not established an effect. Evidence of absence goes further: the data are sufficiently informative to support the conclusion that a meaningful effect is unlikely or absent.

PART 02 · SUBPART 36 · GUIDE 590

When “The Evidence Is Mixed” Is Too Vague

When Is “The Evidence Is Mixed” Too Vague to Be a Useful Synthesis?

“The evidence is mixed” may accurately describe disagreement while explaining almost nothing about it. A useful synthesis identifies what differs, how much it differs, which evidence deserves greater weight, and whether the disagreement follows an interpretable pattern.

PART 02 · SUBPART 36 · GUIDE 589

Small Literature, Strong Conclusion

Can a Small Literature Support a Relatively Strong Conclusion?

A small literature is not automatically weak. A relatively strong conclusion may sometimes be justified when a limited number of studies provide credible, direct, sufficiently precise, and mutually reinforcing evidence for a narrowly defined claim.

PART 02 · SUBPART 36 · GUIDE 588

Large Literature, Weak Conclusion

Can a Large Literature Still Support Only a Weak Conclusion?

A large number of studies can create the appearance of certainty without resolving the weaknesses that matter. Learn why literature size and evidential strength are different properties and how to tell when a large field still supports only a limited conclusion.

PART 02 · SUBPART 36 · GUIDE 587

Uncertainties Despite a Large Literature

What Important Uncertainties Remain Despite a Large Literature?

A large literature can leave its most important questions unresolved when studies repeatedly examine the same populations, methods, outcomes, or comparisons. Learn how to identify uncertainty that publication volume has failed to reduce.

PART 02 · SUBPART 36 · GUIDE 586

Conclusions Based on Indirect Evidence

Which Conclusions Are Mostly Based on Indirect Evidence?

Evidence can be methodologically strong yet still provide only indirect support for the conclusion you want to make. Learn how to identify the inferential steps between what researchers studied and what you want to conclude.

PART 02 · SUBPART 36 · GUIDE 585

Context-Dependent Conclusions

Which Conclusions Are Highly Context-Dependent?

Some research findings are reliable precisely because they specify when, where, and for whom an effect occurs. Learn how to identify context dependence and turn apparent inconsistency into a more informative conclusion.

PART 02 · SUBPART 36 · GUIDE 584

Conclusions Robust Across Populations and Methods

Which Conclusions Are Robust Across Populations and Methods?

A conclusion is more broadly credible when it survives meaningful changes in who is studied and how the phenomenon is investigated. Learn how to distinguish genuine robustness from superficial consistency.

PART 02 · SUBPART 36 · GUIDE 583

Independently Replicated Conclusions

Which Conclusions Have Been Independently Replicated?

Independent replication tests whether a research finding survives contact with new data rather than remaining dependent on its original study. Learn what counts as replication and how to interpret successful and unsuccessful attempts.

PART 02 · SUBPART 36 · GUIDE 582

Conclusions Based on One Study

Which Conclusions Depend on One Influential Study?

A conclusion may appear to have broad support because dozens of papers repeat or cite it while its empirical foundation still traces mainly to one influential study. Learn how to distinguish citation influence from independent evidential support.

PART 02 · SUBPART 36 · GUIDE 581

Independent Lines of Evidence

Which Conclusions Are Supported by Several Independent Lines of Evidence?

A conclusion becomes more persuasive when different sources of evidence converge without depending on exactly the same assumptions or vulnerabilities. Learn how to distinguish genuine evidential convergence from simple repetition.

PART 02 · SUBPART 36 · GUIDE 580

Conclusions Based on Weak Studies

Which Conclusions Depend Mainly on Weak Studies?

A conclusion can appear well supported because many studies report it while still depending mainly on evidence with serious methodological limitations. Learn how to identify where weaknesses actually threaten the conclusion.

PART 02 · SUBPART 36 · GUIDE 579

What the Literature Does Not Support

What Does the Literature Clearly Not Support?

A literature review should identify not only what research supports, but also which conclusions the available evidence cannot justify. Learn how to recognize unsupported claims without confusing uncertainty with evidence that a claim is false.

PART 02 · SUBPART 36 · GUIDE 578

What the Literature Suggests

What Does the Literature Suggest but Not Establish?

Research can point toward a plausible conclusion without establishing it with high confidence. Learn how to recognize suggestive evidence and describe it without either overstating or dismissing what the literature shows.

PART 02 · SUBPART 36 · GUIDE 577

What the Literature Lets You Conclude

What Does the Literature Actually Allow You to Say With Confidence?

A large body of literature does not automatically justify a strong conclusion. Learn how to match the confidence of your claims to the quality, consistency, precision, directness, and breadth of the evidence.

PART 02 · SUBPART 35 · GUIDE 576

Different Effects Across Settings

Can Different Effects Across Settings Reveal an Important Contextual Mechanism?

Different effects across settings can reveal clues about why, where, or under what conditions an intervention works. But contextual variation becomes mechanistically informative only when the pattern is credible, plausible, and not better explained by bias, chance, or other study differences.

PART 02 · SUBPART 35 · GUIDE 575

Consistency Across Different Settings

Can Consistent Effects Across Very Different Settings Strengthen Confidence?

Consistent effects across meaningfully different settings can strengthen confidence that a finding is not dependent on one narrow context. But consistency supports robustness only when the settings genuinely differ in relevant ways and the studies are sufficiently credible and comparable.

PART 02 · SUBPART 35 · GUIDE 573

When Evidence Applies to Your Population

When Is Evidence From Another Population Directly Relevant to Yours?

Evidence does not need to come from an identical population to be directly useful. The key question is whether differences between the studied and target populations are likely to change the magnitude or interpretation of the finding.

PART 02 · SUBPART 35 · GUIDE 572

Synthesizing Evidence Across Resource Settings

How Do You Synthesize Evidence Across High-Resource and Low-Resource Settings?

Evidence from high- and low-resource settings can sometimes be synthesized meaningfully, but resource differences may affect implementation, comparators, baseline conditions, and outcomes. The relevant question is which resources actually matter to the finding.

PART 02 · SUBPART 35 · GUIDE 570

Synthesizing Evidence Across Sex or Gender Groups

How Do You Synthesize Evidence Across Sex or Gender Groups?

Evidence across sex or gender groups can often be synthesized together, but differences should remain visible when there is a credible reason they could modify effects, experiences, risks, or implementation.

PART 02 · SUBPART 35 · GUIDE 569

Synthesizing Evidence Across Age Groups

How Do You Synthesize Evidence Across Age Groups?

Evidence from different age groups can often contribute to the same synthesis, but age differences should not be ignored when they could alter baseline risk, intervention effects, measurement, or the phenomenon itself.

PART 02 · SUBPART 35 · GUIDE 567

Synthesizing Findings Across Countries

When Can Findings From Different Countries Be Synthesized Meaningfully?

Findings from different countries can be synthesized when the studies address sufficiently comparable questions, but geographic diversity should not automatically be treated as irrelevant heterogeneity. The key question is whether country-level differences could plausibly change what the evidence means.

PART 02 · SUBPART 34 · GUIDE 560

Synthesizing Outcomes Measured at Different Times

How Do You Synthesize Evidence When Outcomes Are Measured at Different Times?

The same outcome measured at different times may represent meaningfully different intervention effects. Learn when time points can be grouped, when they should remain separate, and how to avoid selecting follow-up results opportunistically.

PART 02 · SUBPART 33 · GUIDE 556

When One Dataset Dominates the Literature

How Do You Synthesize a Literature Dominated by One Dataset?

Many publications can come from the same underlying dataset. Learn how to trace data provenance, recognize dependent evidence, and avoid mistaking repeated analyses for independent replication.