Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Could Different Baseline Risks Explain Why Studies Disagree?

Studies conducted in populations with different baseline risks can report very different absolute outcomes even when an intervention has a similar relative effect. Separate baseline risk from treatment effect before declaring the evidence contradictory.

459
Baseline Risk and Study Disagreement Guide 459 of 899
01 · The Question

Did the Participants Have the Same Chance of the Outcome to Begin With?

Suppose one study reports that an intervention prevents many adverse outcomes while another finds only a small absolute benefit. At first glance, their conclusions may seem inconsistent. Yet the participants in the first study might have been far more likely to experience the outcome without the intervention.

That starting probability is often described as baseline risk or comparator risk. It matters because the same relative effect can translate into very different absolute effects when applied to populations facing different underlying risks.

Before deciding that two studies genuinely disagree, ask whether their participants started from comparable levels of risk.

02 · The Short Answer

Yes, Baseline Risk Can Change the Absolute Result

In Brief

Yes. Different baseline risks can make studies appear to disagree because a similar relative intervention effect can produce much larger absolute benefits or harms in a high-risk population than in a low-risk population.

This does not mean baseline risk explains every difference. Relative effects can also vary across populations, and baseline risk may reflect other important differences. Compare relative and absolute effects separately before deciding whether the findings truly conflict.

03 · What You Need to Know

How Baseline Risk Changes the Meaning of an Effect

Baseline risk is the risk without the intervention of interest

In a comparative intervention study, baseline risk usually refers to the probability of an outcome in the absence of the experimental intervention, often represented by the risk observed in the comparator or control group over a specified period.

It should not be confused with the percentage of participants who already had a condition when the study began. The relevant baseline risk is usually the expected risk of the outcome being analyzed under the comparator condition.

Baseline or comparator risk The underlying probability of the outcome under the comparator condition over a specified time period.
Intervention effect The difference in outcome between intervention and comparator groups, expressed using a relative or absolute effect measure.

Relative and absolute effects answer different questions

A relative risk describes the intervention group's risk relative to the comparator group's risk. An absolute risk difference describes how many more or fewer events actually occur between the groups.

These quantities are related, but they are not interchangeable. If an intervention reduces risk by the same relative proportion in two populations, the number of events prevented depends heavily on how common the outcome would otherwise have been.

A Simple Illustration
Intervention risk = Baseline risk × Risk ratio
Baseline risk is the comparator event probability. The risk ratio is the intervention risk divided by the comparator risk.
If baseline risk is 20% and the risk ratio is 0.75, intervention risk is 15%, an absolute reduction of 5 percentage points. If baseline risk is 4% with the same risk ratio of 0.75, intervention risk is 3%, an absolute reduction of only 1 percentage point.

The relative effect is identical in this hypothetical calculation: a risk ratio of 0.75, corresponding to a 25% relative reduction. The absolute consequence is not. One population experiences 5 fewer events per 100 people, while the other experiences 1 fewer event per 100.

Cochrane specifically emphasizes this relationship when interpreting dichotomous outcomes. Its guidance recommends considering different comparator risks when translating relative effects into absolute risk differences or numbers needed to treat.

Different absolute effects do not necessarily mean different relative effects

This distinction can resolve some apparent disagreements immediately. Imagine that Study A reports a 6-percentage-point reduction in an adverse outcome while Study B reports only a 1-percentage-point reduction. Those numbers look quite different.

But if the comparator risks were also very different, the relative effects could be similar. Saying that the intervention “worked much better” in Study A based solely on the absolute differences would therefore be premature.

Conversely, similar absolute effects do not guarantee similar relative effects. You need to inspect the effect measures rather than infer one from the other.

Why baseline risks differ across studies

Baseline risk can vary because studies enroll participants with different prognoses, disease severity, ages, prior exposures, socioeconomic circumstances, comorbidities, or other risk factors. Settings can also matter. A study conducted where the underlying event is common may have a different comparator risk from one conducted where it is rare.

Follow-up duration matters as well. For many cumulative outcomes, participants followed for longer periods have more opportunity to experience an event. When comparing risks, therefore, the relevant time horizon should also be checked. Different follow-up times can themselves contribute to apparently different results.

Baseline risk can affect practical importance even when relative effects remain similar

Suppose an intervention reduces relative risk by 20% in both low- and high-risk groups. For someone whose underlying risk is extremely low, the absolute reduction may also be very small. For someone facing a much higher probability of the outcome, the same proportional reduction can prevent substantially more events.

This is one reason clinical and policy decisions often require absolute effects rather than relative effects alone. A relative reduction describes proportional change; it does not by itself tell you how many events are likely to be prevented.

Relative effects are not guaranteed to remain constant across baseline risk

The simple calculation above assumes that the relative effect applies similarly across risk groups. That assumption can be useful, and Cochrane notes that relative effects often tend to be more stable across risk groups than risk differences. But it is not a law of nature.

The intervention itself may genuinely work differently in people with different prognoses. Baseline risk can also be associated with characteristics that modify the treatment effect. When that happens, differences between studies cannot be explained merely by applying the same relative effect to different starting risks.

Watch Out

Do not assume that a high control-group event rate caused a larger treatment effect. Baseline risk may be associated with population, setting, follow-up, or methodological differences. Distinguish a mathematical change in absolute effect from evidence that the intervention's underlying relative effect actually differs.

Baseline risk can be informative rather than merely inconvenient

If an intervention produces meaningful absolute benefit primarily among people at high baseline risk, that pattern may help identify who stands to benefit most. What looks like heterogeneity may therefore have direct implications for targeting interventions and communicating expected benefit.

The key is to establish whether the observed pattern is credible rather than constructing a post hoc explanation from a few dissimilar studies.

04 · A Practical Example

Same Relative Effect, Very Different Absolute Benefit

Hypothetical Example

A program to prevent student dropout

Imagine an intervention that produces the same hypothetical risk ratio of 0.80 in two university populations. In other words, dropout risk under the intervention is 80% of the risk under the comparator condition.

High-risk population Without the program, 30% of students drop out. With a risk ratio of 0.80, the intervention-group risk is 24%.
Absolute effect The program is associated with 6 fewer dropouts per 100 students.
Low-risk population Without the program, 5% of students drop out. Applying the same risk ratio of 0.80 gives an intervention-group risk of 4%.
Absolute effect The program is associated with only 1 fewer dropout per 100 students.
Interpretation The absolute results differ substantially even though the assumed relative effect is identical.

If one paper emphasizes the six-percentage-point reduction and another emphasizes the one-percentage-point reduction, a casual reading might suggest conflicting intervention effectiveness. Once baseline risk is considered, however, the two results could be entirely compatible with the same proportional effect.

05 · What Researchers Often Get Wrong

Common Mistakes When Interpreting Different Baseline Risks

Misconception

A larger absolute benefit proves that the intervention worked better

Not necessarily. A larger absolute difference can arise because the outcome was more common in the comparator group. Compare relative effects and their uncertainty before concluding that the intervention itself performed differently.

Misconception

The same relative risk means the intervention matters equally to everyone

No. Identical proportional effects can translate into very different numbers of events prevented or caused. Practical importance depends partly on the underlying probability of the outcome.

Misconception

Baseline risk means how many participants already had the outcome at enrollment

That is not generally what the term means in this context. For an intervention effect, baseline or comparator risk usually refers to the probability that the outcome would occur under the comparator condition over the relevant time period.

Misconception

You can compare control-group risks without checking follow-up time

Risk is tied to a time horizon. A 5% event risk over one month and a 20% risk over five years cannot be interpreted as though the only difference were the participants' underlying vulnerability.

Misconception

Baseline risk explains every difference in absolute effects

No. Intervention effects may genuinely vary, and studies can differ in design, outcome definition, implementation, context, analysis, and other features. Baseline risk is one explanation to investigate, not a universal reconciliation device.

06 · What This Means for You

How to Check Whether Baseline Risk Explains the Disagreement

When two studies report different magnitudes of benefit or harm, first determine what effect measure you are comparing. A risk ratio, odds ratio, hazard ratio, and risk difference do not express the same quantity. Then examine the comparator event rates over comparable periods.

A simple decision framework

If absolute effects differ but relative effects are similar
Check whether different comparator risks can mathematically account for much of the difference.
If both absolute and relative effects differ substantially
Baseline risk alone may not explain the findings. Investigate effect modification and other differences between studies.
If comparator risks differ because follow-up periods differ
Align the time horizons before interpreting the difference as evidence about underlying population risk.
If high- and low-risk groups consistently show different relative effects
Consider whether baseline risk or characteristics associated with it modify the intervention effect rather than assuming a constant relative effect.

Also ask why baseline risk differs. If one study enrolled people with more severe disease, older participants, higher-risk institutions, or substantially different environmental exposures, the risk difference may be telling you something important about the populations themselves. That connects directly to whether different populations explain why the studies disagree.

When synthesizing the literature, avoid collapsing everything into the statement that “results were inconsistent.” A more informative account might explain that relative effects were broadly similar but absolute benefits were larger in populations with higher comparator risks. If the relative effects also vary, say so rather than attributing all heterogeneity to baseline risk.

This distinction can help determine whether apparently inconsistent evidence is actually reflecting a more complex pattern. Sometimes the studies disagree less about what an intervention does than about how much practical difference that effect makes in populations starting at different levels of risk.

07 · A Quick Checklist

What to Compare When Baseline Risks Differ

Before interpreting different effect sizes, check:
Identify the comparator or control-group risk in each study.
Verify that the studies use comparable outcome definitions.
Make sure the risks refer to comparable follow-up periods.
Separate relative effect measures from absolute effect measures.
Ask whether different baseline risks mathematically explain the different absolute effects.
Check whether relative effects also vary across risk groups.
Investigate why baseline risks differ, including population, setting, severity, and follow-up.
Avoid inferring effect modification solely from different absolute risk reductions.
08 · Frequently Asked Questions

Questions About Baseline Risk and Conflicting Study Results

What is baseline risk?

In intervention-effect interpretation, baseline risk generally means the probability of the outcome under the comparator condition over a specified period. It is also called comparator risk in evidence-synthesis guidance.

Why does baseline risk affect absolute treatment benefit?

A proportional reduction acts on the risk that is present to begin with. A 25% relative reduction applied to a 20% baseline risk prevents more events than the same 25% reduction applied to a 2% baseline risk.

Does baseline risk change relative risk?

Not mathematically by necessity. The same risk ratio can occur at different baseline risks. Empirically, however, relative intervention effects can sometimes vary among populations with different underlying risks, so constancy should not simply be assumed.

Which is more important, relative risk or absolute risk?

They answer different questions and are often most informative together. Relative measures describe proportional differences, while absolute measures show how many events are expected to occur or be prevented in a particular risk context.

How does baseline risk affect number needed to treat?

For a given relative effect, higher baseline risk generally produces a larger absolute risk reduction and therefore a smaller number needed to treat. Any NNT must also be interpreted over its specified time frame.

Can I use the control-group event rate as baseline risk?

It is commonly used to represent comparator risk within a study. For applying evidence to another population, however, the observed control-group risk from one trial may not represent the target population well. The appropriate risk estimate depends on the purpose of the analysis and the population of interest.

Do different baseline risks mean the study populations are different?

They may, but not necessarily in only one respect. Comparator risks can differ because of participant characteristics, settings, outcome definitions, follow-up duration, background care, chance, and other factors. Investigate the source rather than treating baseline risk as a self-explanatory characteristic.

09 · The Bottom Line

Start With the Risk the Population Already Faces

The Bottom Line

Different baseline risks can make studies report very different absolute benefits or harms even when the underlying relative intervention effects are similar.

Compare comparator risks, time horizons, relative effects, and absolute effects separately. If baseline risk accounts for the difference, the studies may be more compatible than their headline numbers suggest; if relative effects also differ, a broader explanation is needed.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes