Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

The Complete Library

All Research Guides

Browse every published guide in the Researcher's Field Guide, including the complete research journey and supplemental collections, listed alphabetically for quick reference.

Complete Library

Every published guide

Showing 3,851–3,900 of 5,065 guides

5,065 guides
PART 02 · SUBPART 27 · GUIDE 455

Inconsistent or Complex Evidence?

When Is the Evidence Truly Inconsistent Rather Than Simply Complex?

Different study results do not automatically mean that a field is inconsistent. Evidence may instead reveal a coherent pattern in which effects vary across populations, outcomes, contexts, or methods. The key is whether important differences can be credibly explained.

PART 02 · SUBPART 27 · GUIDE 454

When the Best Studies Disagree With the Majority

What Does It Mean When the Highest-Quality Studies Disagree With the Majority?

A majority of studies does not automatically represent the strongest evidence. When the most credible studies point in a different direction, examine why the pattern occurs and whether methodological limitations could explain the apparent majority.

PART 02 · SUBPART 27 · GUIDE 453

Which Evidence Deserves More Weight?

How Do You Decide Which Evidence Deserves More Weight?

Research studies should not receive equal weight merely because they appear in the same literature review. Learn how to judge which evidence should influence your conclusion more without relying on shortcuts such as sample size, recency, journal prestige, or a simple hierarchy of study designs.

PART 02 · SUBPART 27 · GUIDE 452

Newer Studies vs. Older Studies

Should Newer Studies Automatically Be Trusted More Than Older Ones?

Newer research is not automatically better research. Publication date can matter when methods, technologies, populations, or contexts have changed, but the evidential value of a study depends primarily on what it investigated and how well it did so.

PART 02 · SUBPART 27 · GUIDE 451

Should Larger Studies Get More Weight?

Should Larger Studies Automatically Be Given More Weight?

Larger studies often provide more precise estimates, but sample size is only one reason to give evidence greater weight. A very large study can still be biased, poorly measured, or only indirectly relevant to the question you need to answer.

PART 02 · SUBPART 27 · GUIDE 450

Interpreting Positive and Null Study Results

How Should You Interpret a Field Where Some Studies Are Positive and Others Are Null?

A literature containing both positive and null studies is not automatically contradictory. The pattern may reflect differences in precision, effect size, populations, methods, or genuine variation, so interpretation should begin with estimates and uncertainty rather than a count of significant findings.

PART 02 · SUBPART 27 · GUIDE 449

Can Different Analyses Produce Conflicting Results?

Could Different Analyses Produce Apparently Contradictory Results?

Research findings depend partly on how data are analyzed. Different defensible choices about models, covariates, exclusions, missing data, outcomes, and statistical assumptions can sometimes produce different conclusions, making analytical robustness an important part of interpreting disagreement.

PART 02 · SUBPART 27 · GUIDE 448

Can Research Design Explain Conflicting Findings?

Could Different Research Designs Explain Conflicting Findings?

Studies can examine the same broad question yet reach different conclusions partly because their designs generate different kinds of evidence and face different threats to validity. Comparing how the evidence was produced can clarify whether findings genuinely conflict.

PART 02 · SUBPART 27 · GUIDE 447

Can Different Measures Explain Conflicting Results?

Could Different Measures Explain Why Studies Reach Different Conclusions?

Studies can investigate what appears to be the same outcome yet measure it in substantially different ways. Understanding what was measured, how it was measured, and when it was measured can reveal whether conflicting conclusions reflect a genuine difference or a measurement problem.

PART 02 · SUBPART 27 · GUIDE 446

Can Population Differences Explain Conflicting Results?

Could Different Populations Explain Why Two Studies Disagree?

Two well-conducted studies can reach different conclusions because they studied different people. Learn when population differences provide a plausible explanation, when they do not, and how to investigate the possibility without inventing subgroup effects.

PART 02 · SUBPART 27 · GUIDE 444

Can One New Study Overturn Previous Research?

Does One New Study Overturn Everything That Came Before It?

A striking new study can change what researchers think, but publication date alone does not give it authority over everything that came before. The important question is how much the new evidence should change your confidence in the existing conclusion.

PART 02 · SUBPART 27 · GUIDE 443

When Research Studies Disagree

What Should You Do When Research Studies Reach Different Conclusions?

Research studies do not always reach the same conclusion, and disagreement does not automatically mean that one study is wrong. Learn how to compare apparently conflicting findings and judge what the wider body of evidence actually supports.

PART 02 · SUBPART 26 · GUIDE 440

Trusting Papers Without Available Data or Code

Can You Trust a Paper When the Data or Code Are Unavailable?

Unavailable data or code makes some research claims harder to verify, but it does not automatically make a paper untrustworthy. The reason for unavailability and what can still be checked both matter.

PART 02 · SUBPART 26 · GUIDE 435

Can Retracted Papers Contain Valid Information?

Can a Retracted Paper Still Contain Valid Information?

Retraction does not necessarily mean every sentence in a paper is false. But identifying apparently unaffected information is not the same as restoring a retracted paper to ordinary evidential use.

PART 02 · SUBPART 26 · GUIDE 433

Does a Correction Make a Paper Unreliable?

Does a Correction Automatically Make a Paper Unreliable?

A correction is evidence that something in a published paper changed, not automatic evidence that the entire study is unreliable. What matters is what was corrected and whether it affects the evidence you need.

PART 02 · SUBPART 25 · GUIDE 430

When to Check the Primary Studies

When Should You Go Back to the Primary Studies Instead of Relying on the Review?

A strong, current systematic review can often spare you from reconstructing an evidence base study by study. But you should return to the primary studies when the review cannot answer the detail, uncertainty, or methodological question that matters to you.

PART 02 · SUBPART 25 · GUIDE 429

Choosing Between Systematic Reviews

How Do You Choose Which Systematic Review to Trust When Several Exist?

When several systematic reviews address the same topic, do not automatically choose the newest, largest, or most highly cited. Start with relevance, then compare methodological trustworthiness, currency, evidence coverage, and how cautiously each review interprets its findings.

PART 02 · SUBPART 25 · GUIDE 428

Why Systematic Reviews Disagree

Can Multiple Reviews of the Same Topic Reach Different Conclusions?

Two systematic reviews can examine what appears to be the same topic and still reach different conclusions. The disagreement often becomes understandable once you compare their questions, searches, included studies, analytical choices, and interpretation of the evidence.

PART 02 · SUBPART 25 · GUIDE 427

Publication Bias in Meta-Analysis

Can Publication Bias Make a Meta-Analysis Misleading?

A meta-analysis can accurately combine every result available to the reviewers and still be misleading if the available evidence is systematically different from the evidence that remains unpublished or unreported.

PART 02 · SUBPART 25 · GUIDE 426

High Heterogeneity and Pooled Estimates

What Does High Heterogeneity Mean for How Much You Trust a Pooled Estimate?

High heterogeneity means study results vary more than expected from sampling error alone, but it does not automatically invalidate a meta-analysis. What matters is why effects differ and whether the pooled estimate still represents a useful scientific summary.

PART 02 · SUBPART 25 · GUIDE 424

Did the Review Include the Right Studies?

How Do You Know Whether the Review Included the Right Studies?

Finding relevant papers is not enough. A trustworthy systematic review must apply appropriate eligibility criteria consistently so that the studies entering the synthesis actually answer the intended question.

PART 02 · SUBPART 25 · GUIDE 423

Was the Review Search Comprehensive Enough?

How Do You Know Whether a Review Search Was Comprehensive Enough?

A comprehensive systematic review search is not one that claims to search "widely." You need to examine whether the sources, search strategy, restrictions, dates, and supplementary methods were appropriate for the review question.

PART 02 · SUBPART 25 · GUIDE 422

Does a Larger Meta-Analysis Mean Stronger Evidence?

Does a Larger Meta-Analysis Automatically Provide Stronger Evidence?

Adding studies or participants to a meta-analysis can improve statistical precision, but size alone does not determine evidential strength. The quality, relevance, consistency, and completeness of the underlying evidence still matter.

PART 02 · SUBPART 25 · GUIDE 421

Precise Meta-Analysis From Weak Studies

Can a Meta-Analysis Produce a Precise Answer From Weak Studies?

A meta-analysis can produce a statistically precise pooled estimate even when the studies contributing to it have serious limitations. Precision describes uncertainty around an estimate, not whether that estimate is unbiased or trustworthy.

PART 02 · SUBPART 25 · GUIDE 420

Can a Systematic Review Still Be Misleading?

Can a Systematic Review Be Systematic but Still Misleading?

A systematic review can use an explicit, reproducible process and still produce a misleading conclusion. The crucial question is not only whether the review was systematic, but whether its methods protected the synthesis from important sources of bias.

PART 02 · SUBPART 25 · GUIDE 419

Systematic Reviews vs. Primary Studies

Should You Trust a Systematic Review More Than a Primary Study Automatically?

Systematic reviews can provide a stronger basis for conclusions than individual studies, but their label alone does not make them more trustworthy. What matters is how the review was conducted and the quality, relevance, and consistency of the evidence it synthesizes.

PART 02 · SUBPART 24 · GUIDE 418

When Does Mixed-Methods Complexity Add Insight?

When Does Mixed-Methods Complexity Add Insight Rather Than Just More Data?

More methods do not automatically produce more understanding. Mixed-methods complexity earns its place when integrating quantitative and qualitative evidence changes what researchers can understand, explain, test, or conclude.

PART 02 · SUBPART 24 · GUIDE 417

How Much Confidence Should Convergence Add?

How Much Additional Confidence Should Mixed-Methods Convergence Provide?

Agreement between quantitative and qualitative findings can strengthen an interpretation, but not automatically. Its value depends on evidence quality, independence, construct alignment, and what exactly has converged.

PART 02 · SUBPART 24 · GUIDE 416

Can Integration Support a New Conclusion?

Can Integration Produce a Conclusion Neither Component Supports Alone?

Mixed-methods integration can produce an insight that is not available from either component alone. But a genuinely new integrated conclusion still has to follow defensibly from the relationship between the underlying evidence.

PART 02 · SUBPART 24 · GUIDE 415

When Mixed-Methods Findings Disagree

What Should You Do When the Quantitative and Qualitative Findings Disagree?

Disagreement between quantitative and qualitative findings is not automatically a failure. The discrepancy may reveal measurement problems, sampling differences, contextual variation, or something important about the phenomenon itself.

PART 02 · SUBPART 24 · GUIDE 413

How Did the Mixed Methods Findings Relate?

Did One Method Explain, Expand, or Contradict the Other?

Mixed methods findings do not need to tell exactly the same story. Their value may lie in explanation, expansion, qualification, or even productive contradiction.

PART 02 · SUBPART 24 · GUIDE 412

Were the Mixed Methods Samples Connected?

Were the Quantitative and Qualitative Samples Appropriately Connected?

Mixed methods samples do not always need to contain the same participants, but their relationship should fit the study's purpose. Learn how to evaluate whether that connection is methodologically defensible.

PART 02 · SUBPART 24 · GUIDE 411

Did Each Component Address the Question?

Did Each Component Address a Meaningful Part of the Question?

A mixed methods study needs more than two technically competent components. Each should have a clear role in answering the larger research question and contribute evidence the study actually needs.

PART 02 · SUBPART 23 · GUIDE 407

Can Qualitative Findings Transfer to Another Context?

How Do You Judge Whether Qualitative Findings May Transfer to Another Context?

Qualitative findings may be useful beyond the setting where they were produced, but transferability depends on contextual similarity, adequate description, and the nature of the finding rather than statistical representativeness.

PART 02 · SUBPART 23 · GUIDE 406

How Do You Judge Researcher Reflexivity?

How Do You Judge Reflexivity and Researcher Influence?

Researchers inevitably influence qualitative inquiry. Reflexivity helps you judge whether that influence was recognized, examined, and handled coherently rather than ignored or treated as something that could simply be eliminated.