Designing a Study You Can Defend
Collecting more data does not always produce more useful evidence. Learn how to prioritize measurements, optimize assessment schedules, use suitable alternative data sources, and evaluate the information gained relative to the demands imposed on research participants.
Read Guide →
Designing a Study You Can Defend
Highly controlled intervention studies can provide strong evidence under specified conditions while depending on resources and procedures that ordinary organizations cannot reproduce. Learn how to recognize excessive control, distinguish essential intervention components from research-specific support, and design studies that produce scientifically credible and practically usable findings.
Read Guide →
Designing a Study You Can Defend
An intervention may improve outcomes but remain too costly, difficult to deliver, poorly accepted, or unsustainable in routine practice. Learn when cost, acceptability, feasibility, and sustainability belong in intervention study design, how to measure them appropriately, and how to avoid confusing implementation success with effectiveness.
Read Guide →
Designing a Study You Can Defend
Intervention delivery may need to vary across institutions, communities, or clinical settings, but excessive variation can weaken interpretation. Learn when adaptation is appropriate, which components should remain consistent, and how to document and analyze delivery differences across research sites.
Read Guide →
Designing a Study You Can Defend
An intervention may succeed in one setting and produce disappointing results in another. Learn how organizational resources, participant characteristics, delivery conditions, and wider systems influence implementation, and how researchers can investigate contextual explanations without confusing association with causation.
Read Guide →
Designing a Study You Can Defend
Hybrid effectiveness-implementation designs investigate intervention outcomes and implementation questions within one coordinated study. Learn when this approach is justified, how to select among Type 1, Type 2, and Type 3 designs, and when a focused effectiveness or implementation study may be more appropriate.
Read Guide →
Designing a Study You Can Defend
Hybrid effectiveness-implementation designs combine questions about intervention effectiveness and implementation within one coordinated study. Understand the three hybrid types, how they differ from pragmatic trials and mixed-methods research, and how to specify appropriate outcomes, comparisons, and analytical approaches.
Read Guide →
Designing a Study You Can Defend
Adding implementation questions can improve an effectiveness study, but excessive objectives may create incompatible designs, insufficient statistical power, and unnecessary burden. Learn how to recognize when a study has become too ambitious and how to prioritize questions without sacrificing methodological rigor.
Read Guide →
Designing a Study You Can Defend
Economic evaluations can be conducted alongside intervention trials or as separate studies using observational data, external evidence, and economic models. Learn when each approach is appropriate, what evidence it requires, and how to choose a design that supports credible economic decisions without unnecessarily expanding the original trial.
Read Guide →
Designing a Study You Can Defend
Direct replication requires more than repeating the original research question. Learn which procedures ordinarily need to remain consistent, how to assess methodological equivalence, and how to document unavoidable changes.
Read Guide →
Designing a Study You Can Defend
A direct replication can sometimes improve the original study's procedures without becoming a conceptual replication. Learn how to distinguish technical improvements from substantive methodological changes, evaluate procedural equivalence, and preserve the interpretability of replication findings.
Read Guide →
Designing a Study You Can Defend
A replication study does not always need participants from the same population as the original research. Learn when population similarity is essential, when differences can be informative, and how participant selection affects the interpretation of replication findings.
Read Guide →
Designing a Study You Can Defend
A replication study does not always need to reproduce every statistical procedure used in the original research. Learn when analytical consistency matters, how to handle flawed original analyses, and why effect estimates, uncertainty, and target estimands are central to interpreting replication results.
Read Guide →
Designing a Study You Can Defend
Replicating a flawed study raises a difficult methodological choice: preserve the original procedures for comparability or correct weaknesses that threaten validity. Learn how to evaluate original design flaws, distinguish minor improvements from substantive corrections, and select a replication strategy that produces interpretable evidence.
Read Guide →
Designing a Study You Can Defend
The original effect size is a useful starting point for replication planning, but treating it as the true effect can produce an underpowered study. Learn how to account for estimation uncertainty, inflated published effects, practically meaningful effects, and precision when determining replication sample size.
Read Guide →
Designing a Study You Can Defend
Poorly reported methods can make a replication difficult without necessarily making it impossible. Learn how to recover missing procedures, distinguish documented methods from assumptions, prioritize consequential uncertainties, and design a transparent replication when the original research cannot be reconstructed completely.
Read Guide →
Designing a Study You Can Defend
Using interviews and observations, or several other data collection techniques, does not automatically make a study mixed methods. What matters is the methodological nature of the evidence and how the different components are designed, analyzed, and related.
Read Guide →
Designing a Study You Can Defend
More sources, methods, or measures can strengthen a study when they address different limitations or provide genuinely useful evidence. Simply adding more, however, does not make weak evidence strong.
Read Guide →
Designing a Study You Can Defend
A method can be implemented perfectly and still be wrong for the question it is supposed to answer. When that mismatch becomes apparent, reassess what evidence the question requires before deciding whether to adapt the method, narrow the question, or redesign the study.
Read Guide →
Designing a Study You Can Defend
Not every methodological change creates a new study, but some changes alter the research question, evidence, population, comparison, or inferential logic so substantially that treating the project as unchanged becomes misleading. The boundary is conceptual, not a fixed percentage of procedures changed.
Read Guide →
Designing a Study You Can Defend
Not every tiny departure from a research plan deserves equal space in a publication, but deviations that affect interpretation, participant protections, planned analyses, or confidence in the findings generally should be visible. The goal is to let readers understand the study that was actually conducted.
Read Guide →
Designing a Study You Can Defend
Recruitment problems do not automatically mean that a study has failed. Diagnose why recruitment is falling short before changing the strategy, because some solutions can alter the sample, introduce bias, or change the study itself.
Read Guide →
Designing a Study You Can Defend
Falling short of a planned sample size does not automatically make a study worthless, but it may substantially change what the data can establish. The appropriate response is to assess the consequences of the smaller sample rather than retroactively making the original target disappear.
Read Guide →
Designing a Study You Can Defend
The people you can recruit are not always the people you originally intended to study. Before broadening eligibility or changing recruitment settings, determine whether the accessible population can still provide evidence relevant to the original research question.
Read Guide →
Designing a Study You Can Defend
Not every change to a research sample creates a different study. The critical issue is whether the revised sample still provides evidence about essentially the same population and research question, or whether the change alters what the study is actually about.
Read Guide →