Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

The Complete Library

All Research Guides

Browse every published guide in the Researcher's Field Guide, including the complete research journey and supplemental collections, listed alphabetically for quick reference.

Complete Library

Every published guide

Showing 2,301–2,350 of 5,065 guides

5,065 guides
PART 04 · SUBPART 76 · GUIDE 883

Hidden Active Components in Research Interventions

Can an Intervention's Name Conceal Multiple Active Components?

An intervention described as AI-supported learning, gamification, or personalized instruction may contain several active components. Learn why a valid effect estimate for the complete intervention does not identify which components caused the outcome, and how researchers can design more informative evaluations.

PART 04 · SUBPART 76 · GUIDE 882

Manipulating and Measuring the Intended Construct

Does Your Study Actually Manipulate or Measure the Intended Construct?

A study can implement an intervention correctly and collect reliable measurements while failing to investigate the construct it claims to address. Learn how to examine the relationship between theoretical concepts, intervention components, operational definitions, and evidence supporting construct interpretation.

PART 04 · SUBPART 76 · GUIDE 880

Validated Instruments and Study Validity

Does Using a Validated Instrument Make Your Study Valid?

Using an instrument with strong validity evidence can strengthen one part of your methodology, but it does not validate the study as a whole. Sampling, design, implementation, analysis, and interpretation still determine whether your conclusions are defensible.

PART 04 · SUBPART 76 · GUIDE 879

Reliable but Not Valid

Can a Measure Be Reliable but Not Valid?

A measure can produce highly consistent results and still fail to support the interpretation a researcher wants to make from them. Reliability is important, but consistency alone cannot establish validity.

PART 04 · SUBPART 76 · GUIDE 878

Types of Validity

Construct, Content, Criterion, and Face Validity: What’s the Difference?

Construct, content, criterion, and face validity describe different questions researchers may ask about measurement, but they should not be treated as four independent certificates of validity. Modern validity frameworks emphasize the evidence supporting a particular interpretation and use of scores.

PART 04 · SUBPART 75 · GUIDE 874

Transportability vs. Generalizability

What Is Transportability in Research, and How Does It Differ from Generalizability?

Transportability and generalizability both concern extending research findings beyond their original participants, but they can involve different population relationships. Learn how these concepts are distinguished, which assumptions support causal effect transport, and why a valid trial result may not apply unchanged elsewhere.

PART 04 · SUBPART 75 · GUIDE 872

Should Research Sites Be Selected for Diversity Rather Than Convenience?

Convenient research sites may make a study feasible, but they may exclude settings essential to understanding how findings apply elsewhere. Learn when contextual diversity matters, how to select informative sites, and why purposive diversity and statistical representativeness serve different research purposes.

PART 04 · SUBPART 75 · GUIDE 871

How Many Research Sites Do You Need?

How Many Research Sites Are Needed to Capture Meaningful Contextual Variation?

There is no universal minimum number of research sites needed for generalizability. Learn how to determine site requirements based on contextual diversity, research objectives, statistical precision, and the evidence needed to understand variation across settings.

PART 04 · SUBPART 75 · GUIDE 870

Multisite Research and Generalizability

Does Multisite Research Automatically Improve Generalizability?

Conducting research at multiple institutions may strengthen evidence about how findings apply across settings, but the number of sites alone does not guarantee generalizability. Learn how site selection, contextual variation, and treatment-effect heterogeneity determine what multisite research can establish.

PART 04 · SUBPART 75 · GUIDE 869

Controlled Studies and the Internal–External Validity Trade-Off

Can a Highly Controlled Study Have Strong Internal Validity but Weak External Validity?

A tightly controlled experiment may identify an intervention's causal effect convincingly while providing limited evidence about its performance in ordinary settings. Understand why internal and external validity can diverge, when experimental control becomes restrictive, and how to design research that supports credible and applicable conclusions.

PART 04 · SUBPART 75 · GUIDE 868

Strict Eligibility Criteria and External Validity

Can Strict Eligibility Criteria Undermine the Real-World Usefulness of Research Findings?

Strict eligibility criteria may improve intervention consistency and participant safety while excluding people who would use the intervention in practice. Learn when restrictions limit generalizability, which exclusions are justified, and how to design studies that remain methodologically credible and relevant to real-world populations.

PART 04 · SUBPART 75 · GUIDE 867

Sample Representativeness and the Target Population

Does Your Study Sample Need to Resemble the Target Population?

A study sample does not always need to mirror every characteristic of the target population. Learn which differences matter for descriptive and causal inference, why demographic similarity can be misleading, and when sampling design or statistical adjustment can support generalizability.

PART 04 · SUBPART 75 · GUIDE 866

Defining the Target Population for Generalizability

To Which Population Should Your Research Findings Be Generalized?

Research findings do not automatically apply to everyone beyond the study sample. Learn how to define a defensible target population, distinguish sampling and causal generalization, and determine which populations your evidence can reasonably represent.

PART 04 · SUBPART 75 · GUIDE 865

Internal Validity vs. Generalizability

Can Improving Internal Validity Reduce Generalizability?

Some design choices that strengthen control can narrow the populations and conditions represented by a study, but internal validity and generalizability are not inherently opposing goals. The real question is which design choices improve one inference while restricting another.

PART 04 · SUBPART 75 · GUIDE 864

Internally Valid but Not Generalizable

Can a Study Be Internally Valid but Not Generalizable?

A study can provide a credible estimate for the participants and conditions actually studied while offering limited evidence that the same result applies elsewhere. Internal validity and generalizability address different inferential questions.

PART 04 · SUBPART 75 · GUIDE 863

Internal vs. External Validity

Internal vs. External Validity: What Kind of Validity Does Your Study Actually Need?

Internal validity concerns whether a study supports a credible inference within the conditions studied, while external validity concerns whether that inference extends to other populations, settings, or circumstances. Strong research considers both, but their importance depends on the claim being made.

PART 04 · SUBPART 74 · GUIDE 861

Preventing Internal Validity Threats Through Design

Can Research Design Prevent Threats to Internal Validity Before Statistical Adjustment?

Statistical adjustment cannot reliably repair every weakness in a research design. Learn how to prevent major threats to internal validity through credible assignment procedures, appropriate comparison groups, consistent measurement, and carefully planned implementation.

PART 04 · SUBPART 74 · GUIDE 860

Identifying Major Internal Validity Threats

How Do You Identify the Most Serious Threat to Internal Validity in Your Research Design?

Not every threat to internal validity is equally consequential. Learn how to identify the weaknesses most likely to distort your study's causal conclusion, evaluate the evidence for each threat, and prioritize methodological safeguards without relying on a generic checklist.

PART 04 · SUBPART 74 · GUIDE 859

Missing Data and Internal Validity

How Can Missing Data Threaten Internal Validity?

Missing observations can distort research findings when the data that remain systematically differ from the information that was not collected. Understand how missing-data mechanisms affect internal validity, which analytical approaches may help, and why preventing missingness is often more valuable than correcting it afterward.

PART 04 · SUBPART 74 · GUIDE 858

Intervention Nonadherence and Internal Validity

How Can Nonadherence to an Intervention Threaten Internal Validity?

Participants do not always receive or follow interventions as assigned. Understand how nonadherence changes the treatment comparison, why excluding noncompliant participants can introduce bias, and how to design and analyze studies that preserve credible causal conclusions.

PART 04 · SUBPART 74 · GUIDE 857

Study Group Contamination and Internal Validity

How Can Contamination Between Study Groups Threaten Internal Validity?

When participants in one research group receive elements of another group's intervention, the intended comparison may change. Learn how contamination occurs, why it can distort treatment effects, and how to prevent, measure, and report intervention spillover.

PART 04 · SUBPART 74 · GUIDE 856

Measurement Changes and Internal Validity

How Can Changes in Measurement Procedures Threaten Internal Validity?

A difference between research groups or measurement occasions may reflect changes in how outcomes were assessed rather than genuine intervention effects. Understand instrumentation threats, recognize when measurements are not comparable, and learn how to protect the validity of your research conclusions.

PART 04 · SUBPART 74 · GUIDE 855

Differential Attrition and Internal Validity

How Can Differential Attrition Threaten Internal Validity?

When participants leave research groups at different rates or for different reasons, the remaining participants may no longer support a credible comparison. Understand how differential attrition introduces bias, how to assess its consequences, and what researchers can do to protect internal validity.

PART 04 · SUBPART 74 · GUIDE 854

Regression to the Mean and Internal Validity

How Can Regression to the Mean Threaten Internal Validity?

Participants selected because of unusually high or low scores may appear to improve or deteriorate even without an effective intervention. Learn why regression to the mean occurs, how it can distort causal conclusions, and how researchers can design more credible comparisons.

PART 04 · SUBPART 74 · GUIDE 853

Maturation and Internal Validity

How Can Maturation Threaten Internal Validity in Longitudinal and Intervention Studies?

Participants may improve, deteriorate, or adapt naturally during a study, even without an intervention. Learn when maturation threatens causal conclusions, how it differs from other time-related threats, and which design strategies help researchers distinguish natural change from intervention effects.

PART 04 · SUBPART 74 · GUIDE 852

History Effects and Internal Validity

How Can History Effects Threaten Internal Validity in Before-and-After Studies?

An improvement after an intervention does not necessarily mean the intervention caused it. Understand how external events create history effects, when they threaten before-and-after comparisons, and which research designs can help distinguish intervention effects from concurrent changes.

PART 04 · SUBPART 74 · GUIDE 851

Selection Differences and Internal Validity

How Can Selection Differences Between Groups Threaten Internal Validity?

When research groups differ before an intervention begins, their subsequent outcomes may not provide a fair comparison. Understand how selection differences threaten internal validity, when they create confounding, and which design strategies can make causal conclusions more credible.

PART 04 · SUBPART 74 · GUIDE 850

Threats to Internal Validity

What Threats to Internal Validity Could Undermine a Study's Main Comparison?

A difference between research groups or a change over time does not necessarily establish an intervention's effect. Learn how to identify threats to internal validity, assess competing explanations, and protect the credibility of your study's main comparison.

PART 04 · SUBPART 73 · GUIDE 849

Limitations and Useful Evidence

Can a Study Have Important Limitations and Still Produce Useful Evidence?

Important limitations do not automatically make research worthless. Their significance depends on what they threaten, how severely they affect the inference, how much uncertainty remains, and whether the conclusions stay within what the evidence can support.

PART 04 · SUBPART 73 · GUIDE 848

Design Flaw or Trade-Off?

How Do You Know Whether a Limitation Is a Design Flaw or Simply a Trade-Off?

Not every research limitation is a design flaw. Some limitations are defensible consequences of answering a particular question under ethical, practical, or methodological constraints, while others undermine the very inference the study claims to make.

PART 04 · SUBPART 73 · GUIDE 847

Rigor in Mixed-Methods Research

What Does Rigor Mean in Mixed-Methods Research?

Rigorous mixed-methods research requires more than conducting a quantitative study and a qualitative study in the same project. Each component must be methodologically sound, and their integration must be justified, coherent, transparent, and capable of producing insights that matter to the research question.

PART 04 · SUBPART 73 · GUIDE 846

Establishing Qualitative Trustworthiness

How Do Researchers Establish Trustworthiness in Qualitative Research?

Trustworthiness is established through a coherent set of practices that make qualitative interpretations credible, traceable, grounded in evidence, and appropriately contextualized. The right strategies depend on the methodology rather than a universal checklist.

PART 04 · SUBPART 73 · GUIDE 845

Reliability and Validity in Qualitative Research

Does Qualitative Research Need Reliability and Validity?

Qualitative research needs rigorous evidence that its interpretations are trustworthy, but it does not necessarily use reliability and validity in the same way as quantitative measurement. The appropriate terminology and criteria depend on the methodological tradition.

PART 04 · SUBPART 73 · GUIDE 843

Threats to Valid Research

Bias, Confounding, and Other Threats to Valid Research

Research can be distorted at many points between defining a question and reporting a result. Bias and confounding are not interchangeable problems, and preventing them often requires design decisions long before statistical analysis begins.

PART 04 · SUBPART 73 · GUIDE 842

Valid and Defensible Research Design

What Makes a Research Design Valid and Defensible?

A defensible research design is not simply one that follows a recognized method. It is one in which the research question, evidence, procedures, analysis, and conclusions are coherently aligned and the important methodological choices can be justified.

PART 04 · SUBPART 72 · GUIDE 841

Testing Measurement Equivalence Across Language Groups

When Should Measurement Equivalence Be Tested Across Language Groups?

Translated questionnaires do not automatically produce comparable scores across language groups. Learn when measurement equivalence testing is necessary, how configural, metric, and scalar invariance differ, and what to do when items function differently across languages.

PART 04 · SUBPART 72 · GUIDE 840

How Translation Can Change a Research Construct

Can Translating a Research Instrument Change the Construct Being Measured?

A translated research instrument may be grammatically accurate yet measure a different construct from the original. Learn how translation can change conceptual meaning, alter response processes, introduce construct-irrelevant influences, and affect the interpretation and comparability of research scores.

PART 04 · SUBPART 72 · GUIDE 839

Culturally Adapting Questionnaire Examples and Response Options

Should Questionnaire Examples, Idioms, and Response Categories Be Culturally Adapted?

Culturally unfamiliar examples, idioms, and response categories can affect how respondents interpret questionnaires. Learn when these elements should be adapted, how to preserve the intended construct, and what evidence is needed to support the modified instrument.

PART 04 · SUBPART 72 · GUIDE 838

When Research Constructs Have No Direct Language Equivalent

What Should You Do When a Research Construct Has No Direct Equivalent in Another Language?

Some research constructs have no direct equivalent in another language. A literal translation may distort their meaning, while an unfamiliar borrowed term may confuse respondents. Learn how to identify the underlying concept, evaluate translation alternatives, and determine when adaptation or new instrument development is necessary.

PART 04 · SUBPART 72 · GUIDE 836

Should Questionnaire Translators Have Subject Expertise?

Should Research Instrument Translators Be Familiar With the Research Topic?

Research instrument translators need more than fluency when questionnaire items contain specialized concepts. Learn when subject expertise matters, why it should be balanced with linguistic competence, and how to assemble a translation team that preserves measurement meaning.

PART 04 · SUBPART 72 · GUIDE 835

Why Back-Translation Does Not Guarantee Instrument Equivalence

Does Back-Translation Guarantee Equivalence Between Original and Translated Instruments?

A translated questionnaire may back-translate almost perfectly and still measure something different from the original. Learn what back-translation can and cannot establish, why matching wording may be misleading, and which additional evidence supports defensible cross-language measurement.

PART 04 · SUBPART 72 · GUIDE 834

Forward-Backward Translation of Research Instruments

What Is Forward-Backward Translation, and When Is It Useful for Research Instruments?

Forward-backward translation is a structured approach to translating research instruments, but reproducing the original wording does not guarantee measurement equivalence. Learn how the process works, who should participate, when it is useful, and what additional evidence is needed.