Designing a Study You Can Defend
Additional control groups can clarify treatment effects, but they can also complicate recruitment, weaken individual comparisons, and introduce unnecessary analytical and ethical burdens. Learn how to recognize when another control group adds little scientific value.
Read Guide →
Designing a Study You Can Defend
When an ideal scientific comparison would require withholding beneficial treatment or essential support, researchers must reconsider the design. Learn how to preserve meaningful causal comparisons while protecting participants through active controls, add-on interventions, and other ethically defensible approaches.
Read Guide →
Designing a Study You Can Defend
Between-subjects designs compare different participants across conditions, while within-subjects designs compare conditions within the same participants. The better choice depends on what is being studied and whether experiencing one condition can influence another.
Read Guide →
Designing a Study You Can Defend
Within-subjects designs can improve statistical efficiency by comparing participants with themselves, reducing the influence of stable individual differences. Learn when these gains are meaningful, how to evaluate them, and when practical limitations outweigh the benefits.
Read Guide →
Designing a Study You Can Defend
Within-subjects designs are not appropriate for every experimental comparison. Learn when repeated exposure compromises validity, why counterbalancing may be insufficient, and how to choose a defensible alternative.
Read Guide →
Designing a Study You Can Defend
Repeated exposure can change how participants think, behave, and respond during later measurements. Understand the mechanisms involved, how they can distort experimental comparisons, and when repeated exposure is itself worth studying.
Read Guide →
Designing a Study You Can Defend
A washout period should be long enough to make residual treatment effects sufficiently negligible for the intended comparison. Learn how pharmacokinetics, biological recovery, behavioral persistence, and trial feasibility influence its duration, including why no universal washout rule applies.
Read Guide →
Designing a Study You Can Defend
Factorial designs allow researchers to investigate multiple experimental factors within one study. Learn when they are useful for evaluating interventions, how interactions affect interpretation, and why research objectives must determine the allocation, analysis, and sample size.
Read Guide →
Designing a Study You Can Defend
A stepped-wedge design introduces an intervention to different clusters at different times, often using randomized rollout sequences. Understand how the design works, when it offers advantages over a parallel trial, and why time-related confounding requires particular attention.
Read Guide →
Designing a Study You Can Defend
Stepped-wedge and parallel cluster-randomized trials can evaluate group-level interventions, but they differ in allocation, timing, analysis, and implementation demands. Learn when phased randomized rollout provides a genuine advantage and when a simpler parallel trial may be preferable.
Read Guide →
Designing a Study You Can Defend
A naturally staged intervention rollout can create an opportunity to evaluate a policy or program without controlling its implementation. Learn when staggered adoption supports credible research, how to identify comparison groups, and why implementation timing and pre-intervention trends matter.
Read Guide →
Designing a Study You Can Defend
Interventions introduced at different times can appear effective because outcomes were already changing or other events occurred during implementation. Learn when time-related confounding threatens rollout evaluations, how it differs from ordinary secular trends, and what researchers can do to strengthen causal inference.
Read Guide →
Designing a Study You Can Defend
Quasi-experimental designs can evaluate interventions when random assignment is unavailable or inappropriate. Learn when these designs are justified, which causal assumptions matter, and how to distinguish a credible quasi-experiment from a weak before-and-after comparison.
Read Guide →
Designing a Study You Can Defend
Quasi-experimental and observational studies can both involve nonrandomized exposure, making their boundaries less obvious than textbooks suggest. Learn how intervention assignment, causal identification, comparison strategies, and disciplinary conventions distinguish the approaches.
Read Guide →
Designing a Study You Can Defend
Difference-in-differences can estimate intervention effects by comparing outcome changes between treated and comparison groups. Learn when this strategy is appropriate, which assumptions matter, and why having before-and-after data is not enough.
Read Guide →
Designing a Study You Can Defend
Regression discontinuity can support credible causal inference when intervention assignment changes at a known threshold. Learn when the design is appropriate, how sharp and fuzzy designs differ, and why a cutoff alone is insufficient.
Read Guide →
Designing a Study You Can Defend
An interrupted time-series design examines whether an intervention changes an outcome's established pattern over time. Learn when this quasi-experimental approach is appropriate, how to interpret changes, and what can threaten causal inference.
Read Guide →
Designing a Study You Can Defend
Choosing a quasi-experimental design requires more than matching a method to available data. Learn how treatment assignment, counterfactual assumptions, and identification opportunities determine which design can support a credible causal conclusion.
Read Guide →
Designing a Study You Can Defend
A quasi-experimental label does not guarantee stronger causal evidence than an observational study. Learn when weak comparisons undermine quasi-experiments, how rigorous observational designs can be more informative, and what researchers should prioritize when evaluating evidence.
Read Guide →
Designing a Study You Can Defend
A natural experiment uses exposure variation created by circumstances outside the researcher's control to investigate causal effects. Learn what qualifies as a natural experiment, why natural assignment does not automatically mean random assignment, and how researchers evaluate its credibility.
Read Guide →
Designing a Study You Can Defend
Natural experiments and quasi-experiments both investigate causal effects without conventional researcher-controlled randomization, but they are not identical concepts. Learn how they differ in exposure assignment, research design, causal assumptions, and interpretation.
Read Guide →
Designing a Study You Can Defend
A naturally occurring exposure or policy change can create an opportunity for causal research, but only when its assignment mechanism supports a credible counterfactual. Learn how to assess exposure variation, comparison groups, timing, confounding, and the assumptions required for valid inference.
Read Guide →
Designing a Study You Can Defend
A natural experiment can be investigated after the relevant event has occurred, but researchers must reconstruct its assignment mechanism and establish a credible counterfactual. Learn how to design a retrospective evaluation, assess historical data, and avoid analytical decisions that undermine causal inference.
Read Guide →
Designing a Study You Can Defend
A natural experiment may coincide with other policies, disruptions, or institutional changes that affect the same outcome. Learn how concurrent events threaten causal identification, when comparison groups help, and how to distinguish intervention effects from competing explanations.
Read Guide →
Designing a Study You Can Defend
Natural experiments can provide stronger causal evidence than ordinary observational comparisons when external exposure variation creates a credible counterfactual. Learn which identification features matter, what assumptions remain necessary, and why the natural-experiment label alone does not establish stronger evidence.
Read Guide →