Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

The Complete Library

All Research Guides

Browse every published guide in the Researcher's Field Guide, including the complete research journey and supplemental collections, listed alphabetically for quick reference.

Complete Library

Every published guide

Showing 3,951–4,000 of 5,065 guides

5,065 guides
PART 02 · SUBPART 19 · GUIDE 355

When Poor Reporting Prevents Evaluation

Can Poor Reporting Make a Good Study Impossible to Evaluate?

A study may have been conducted rigorously yet reported too incompletely for readers to verify that rigor. Learn why poor reporting creates uncertainty rather than automatically proving poor methodology.

PART 02 · SUBPART 19 · GUIDE 354

Well-Written but Methodologically Weak Studies

Can a Study Be Well Written but Methodologically Weak?

Clear writing can make a study easier to understand, but it does not make the underlying methods stronger. Learn how to evaluate methodological quality without being overly persuaded by polished presentation.

PART 02 · SUBPART 19 · GUIDE 353

What to Do With a Problematic Research Paper

What Should You Do When You Discover That an Important Paper Has Serious Problems?

Discovering serious problems in an important paper does not automatically tell you what to do next. Verify the problem, determine which claims it affects, reassess the surrounding evidence, and revise your own conclusions in proportion to the damage.

PART 02 · SUBPART 19 · GUIDE 352

Using Retracted Papers in a Literature Review

Should You Use a Retracted Paper in a Literature Review?

A retracted paper should generally not be used as ordinary valid evidence for the claim that led to its retraction. It may still belong in a literature review when the retraction itself, its historical influence, or the consequences of unreliable research are relevant to the review.

PART 02 · SUBPART 19 · GUIDE 351

How to Check for Corrections or Retractions

How Do You Know Whether a Paper Has Been Corrected or Retracted?

A paper can change status after publication through a correction, expression of concern, or retraction. Before relying on an important study, check the publisher's current record and relevant scholarly databases rather than assuming the version you found reflects its present status.

PART 02 · SUBPART 19 · GUIDE 350

How to Evaluate a Systematic Review or Meta-Analysis

How Do You Evaluate a Systematic Review or Meta-Analysis?

A systematic review can summarize an entire body of research, but its conclusions are only as credible as the methods used to find, select, evaluate, and synthesize the evidence. A meta-analysis adds statistical synthesis, not an automatic guarantee of stronger evidence.

PART 02 · SUBPART 19 · GUIDE 349

How to Evaluate Mixed-Methods Research

How Do You Critically Evaluate Mixed-Methods Research?

Good mixed-methods research is more than a quantitative study and a qualitative study placed in the same paper. Each component should be rigorous, but the crucial question is whether combining them produces an integrated understanding that neither could provide as effectively alone.

PART 02 · SUBPART 19 · GUIDE 347

Does a Large Sample Make a Study Strong?

Does a Large Sample Automatically Make a Study Strong?

A large sample can improve statistical power and precision, but size alone does not make evidence trustworthy. Sampling, measurement, design, analysis, and the claims being made still determine what the data can support.

PART 02 · SUBPART 19 · GUIDE 346

Does a Small Sample Make a Study Weak?

Does a Small Sample Automatically Make a Study Weak?

A small sample may reduce statistical power or precision, but sample size cannot be judged in isolation. What matters is whether the sample is adequate for the research question, design, analysis, and claims being made.

PART 02 · SUBPART 19 · GUIDE 344

How to Evaluate a Causal Claim

What Should You Look for When a Paper Makes a Causal Claim?

A causal claim says more than two variables are associated. It says changing one would change the other. Evaluate whether the study establishes temporal order, provides a credible comparison, addresses confounding and selection, measures the relevant variables adequately, and rules out plausible alternative explanations.

PART 02 · SUBPART 19 · GUIDE 343

Are the Authors Overstating Their Results?

How Do You Recognize When Authors Are Overstating Their Results?

Overstatement happens when the language of a research paper becomes stronger, broader, more certain, or more consequential than the evidence supports. Compare every important claim with the design, measures, effect size, uncertainty, population, and results that produced it.

PART 02 · SUBPART 19 · GUIDE 342

Does the Analysis Match the Research Design?

How Do You Tell Whether the Analysis Matches the Design?

A sophisticated analysis is not necessarily an appropriate one. Check whether the analysis respects how the data were generated, the outcome being studied, dependencies among observations, timing, comparisons, and the type of conclusion the researchers want to draw.

PART 02 · SUBPART 19 · GUIDE 341

Were the Research Measures Good Enough?

How Do You Know Whether the Measures Were Good Enough?

A familiar scale or statistically reliable instrument is not automatically a good measure for every study. Ask whether the measure actually captures the construct required by the research question, works adequately in the population and context, and supports the interpretation the authors make from its scores.

PART 02 · SUBPART 19 · GUIDE 340

Was the Research Sample Appropriate?

How Do You Judge Whether the Sample Was Appropriate?

An appropriate sample is not simply a large one. Judge whether the people, cases, records, or other units studied are suitable for the research question, how they were selected, who may be missing, and how far the resulting evidence can reasonably be generalized.

PART 02 · SUBPART 19 · GUIDE 338

Methodological Limitation or Fatal Flaw?

How Do You Tell a Methodological Limitation From a Fatal Flaw?

Every study has limitations, but not every limitation invalidates its findings. The key question is whether a methodological problem merely weakens or narrows an inference, or prevents the study from supporting its central claim at all.

PART 02 · SUBPART 19 · GUIDE 337

Can a Prestigious Journal Publish a Weak Paper?

Can a Paper Be Published in a Prestigious Journal and Still Be Weak?

Yes. Publication in a prestigious journal can be a useful signal about selectivity and scholarly attention, but it does not guarantee that an individual study is methodologically strong or that its conclusions are justified.

PART 02 · SUBPART 19 · GUIDE 336

Does Peer Review Mean a Study Is Reliable?

Does Peer Review Mean a Study Is Reliable?

Peer review is an important form of scholarly scrutiny, not a guarantee that a published study is correct or reliable. A peer-reviewed paper still needs to be evaluated on its design, methods, analysis, reporting, and the strength of the evidence behind its conclusions.

PART 02 · SUBPART 18 · GUIDE 334

Interpret Results Before the Conclusion

Should You Form Your Own Interpretation Before Reading the Authors’ Conclusion?

Forming a provisional interpretation before reading the authors’ conclusion can help you see the evidence without immediately inheriting their framing. The goal is not to ignore the authors, but to compare two interpretations against the same study.

PART 02 · SUBPART 18 · GUIDE 330

Recognizing Association-to-Causation Shifts

How Do You Recognize When Authors Shift From Association to Causation?

A paper can report an association in its Results section and quietly describe it as a causal effect later. Learn how to spot the language, assumptions, and inferential steps that turn association into causation.

PART 02 · SUBPART 18 · GUIDE 329

Unsupported Claims in Conclusions

Can a Conclusion Introduce Claims That Were Not Supported by the Results?

Yes. A conclusion can extend beyond the reported results by adding causal claims, mechanisms, broad generalizations, practical importance, or recommendations that the study did not adequately establish. Learn how to trace every major conclusion back to its evidential basis.

PART 02 · SUBPART 18 · GUIDE 328

Can a Discussion Overstate Weak Results?

Can a Discussion Make a Weak Result Sound Stronger Than It Is?

Yes. A Discussion can make a weak, uncertain, or inconclusive finding sound more convincing than the underlying evidence warrants. Learn how to detect the interpretive moves that create that stronger impression.

PART 02 · SUBPART 18 · GUIDE 327

Can an Abstract Overstate Results?

Can an Abstract Overstate What the Full Results Show?

Yes. An abstract can give a stronger, simpler, or more positive impression than the full results justify. Learn what gets lost in compression and how to check an abstract against the complete paper.

PART 02 · SUBPART 18 · GUIDE 324

Separating Results From Narrative

How Do You Separate Numerical Results From the Authors’ Narrative?

The prose surrounding a statistical result can influence how strong, important, or certain it seems. Learn how to inspect the numbers first and then evaluate whether the authors’ narrative accurately represents them.

PART 02 · SUBPART 18 · GUIDE 323

What Did the Study Actually Find?

What Did the Study Actually Find Before the Authors Interpreted It?

A paper’s findings and the authors’ interpretation of those findings are related, but they are not the same thing. Learn how to reconstruct what the data actually showed before deciding what those results mean.

PART 02 · SUBPART 17 · GUIDE 320

What Was Prespecified and What Was Decided Later?

What Was Prespecified and What Appears to Have Been Decided Later?

A published paper shows the final version of a study, not necessarily the original plan. Compare the report with earlier documentation to identify what was planned and what changed later.

PART 02 · SUBPART 17 · GUIDE 319

Which Analyses Were Secondary or Exploratory?

Which Analyses Were Secondary or Exploratory?

Not every result in a paper carries the same evidential role. Distinguish secondary and exploratory analyses from the primary analysis without dismissing them or quietly promoting them after seeing the results.

PART 02 · SUBPART 17 · GUIDE 318

What Was the Primary Analysis?

What Was the Primary Analysis in the Research Study?

A paper may report dozens of analyses, but they do not all have the same role. Identify the analysis intended to provide the main answer to the study's primary question.

PART 02 · SUBPART 17 · GUIDE 317

Were All Participants Analyzed?

Were All Recruited Participants Included in the Analysis?

Recruitment does not guarantee inclusion in the final analysis. Trace who disappeared between enrollment and analysis, why they were absent, and what that means for the result.

PART 02 · SUBPART 17 · GUIDE 316

What Data Were Actually Analyzed?

What Data Were Actually Analyzed in the Research Study?

The data researchers collected are not necessarily the data that produced the published result. Trace the path from collected observations to the actual analytic dataset.

PART 02 · SUBPART 17 · GUIDE 313

What Outcome Was Actually Measured?

What Outcome Was Actually Measured in the Research Study?

A study may claim to examine learning, health, productivity, or well-being while measuring only one operational indicator. Identify the outcome that actually generated the result.

PART 02 · SUBPART 17 · GUIDE 312

What Was the Actual Comparison?

How to Identify the Actual Comparison in a Research Study?

A result only makes sense relative to what it was compared against. Identify the study's actual comparator rather than assuming that “control,” “usual care,” or “before and after” tells the whole story.

PART 02 · SUBPART 17 · GUIDE 310

How Were Participants Selected?

How Were Participants Actually Selected for the Study?

Knowing who participated is not enough. Trace how people moved from the source population into the study to understand what selection processes shaped the evidence.

PART 02 · SUBPART 17 · GUIDE 309

What Population Was Actually Studied?

What Population Was Actually Studied in the Research?

The population described in a paper's introduction may be broader than the people who actually generated its evidence. Learn how to identify the study population precisely.

PART 02 · SUBPART 17 · GUIDE 308

Is the Research Question Stated or Inferred?

Is the Research Question Explicitly Stated or Must It Be Inferred?

Some papers state their research question directly; others express it through objectives, hypotheses, or methods. Learn how to distinguish what authors explicitly asked from what you must reconstruct.

PART 02 · SUBPART 16 · GUIDE 306

How to Read a Very Long Paper

How Do You Read a Very Long Paper Without Missing the Important Parts?

A very long paper does not have to be read word by word to be understood well. Map the paper first, decide what you need from it, then read the sections carrying the evidence and methodological details relevant to your purpose.