Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

When Should Research Move From Efficacy to Implementation?

Research should move toward implementation when evidence is strong enough to justify serious study of how an intervention can be adopted, delivered, and sustained in routine settings. The transition need not wait until every effectiveness question is resolved.

769
When Research Should Move to Implementation Guide 769 of 899
01 · The Question

When should researchers stop asking only whether an intervention can work and study how it works in practice?

An intervention can perform well in a carefully controlled study and still struggle outside research conditions. Organizations may not adopt it. Practitioners may find it difficult to deliver. Participants may not engage with it. Costs, staffing, workflow, training, or local conditions may make sustained use difficult.

These are not merely logistical inconveniences after the “real” research is finished. They are research questions in their own right.

The challenge is timing. Moving toward implementation too early can devote substantial effort to disseminating an intervention whose benefits remain uncertain. Waiting for perfect evidence, however, can unnecessarily delay learning about whether the intervention can function in routine practice.

02 · The Short Answer

Move toward implementation when real-world delivery becomes a consequential uncertainty

In Brief

Research should increasingly move toward implementation when evidence of an intervention's benefit is credible enough to justify studying its use in routine settings and the major remaining questions concern adoption, feasibility, fidelity, reach, cost, sustainability, or strategies for putting the intervention into practice.

This transition does not require efficacy or effectiveness research to be completely finished. Effectiveness and implementation questions can overlap, and hybrid designs can deliberately study both when the evidence and research context justify doing so.

03 · What You Need to Know

Efficacy and implementation ask different questions about the same intervention

Efficacy asks whether an intervention can produce the intended effect

Efficacy research generally examines whether an intervention produces beneficial outcomes under comparatively controlled or favorable conditions. Researchers may closely manage eligibility, delivery, adherence, training, monitoring, and other aspects of the study to obtain a strong test of the intervention itself.

This is scientifically valuable because poor implementation is less likely to obscure whether the intervention can produce the intended effect under the studied conditions.

But successful efficacy does not guarantee successful routine use.

Effectiveness moves closer to ordinary conditions

Effectiveness research generally asks whether an intervention produces useful outcomes under conditions closer to routine practice, often with broader populations and less experimental control than a conventional efficacy study.

Efficacy and effectiveness are better understood as a continuum than as two perfectly separated categories. Studies can contain both explanatory and pragmatic features depending on their aims and design.

The important point is that evidence an intervention can work under favorable conditions does not automatically establish how well it will perform across the people, organizations, resources, and constraints encountered in practice.

Implementation research asks how an intervention becomes routine practice

Implementation research shifts attention toward the processes and strategies involved in adopting, delivering, integrating, scaling, and sustaining an evidence-based intervention or practice in real-world systems.

Proctor and colleagues distinguished implementation outcomes from service and clinical outcomes. Their widely used taxonomy includes acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration, and sustainability.

Research focus Core question Illustrative outcomes
Efficacy Can the intervention produce the intended effect under favorable conditions? Clinical, behavioral, educational, or other target outcomes
Effectiveness Does the intervention produce useful effects under conditions closer to routine practice? Target outcomes across more representative practice conditions
Implementation How can the intervention be successfully integrated into routine practice? Adoption, feasibility, fidelity, reach or penetration, cost, sustainability

The transition becomes important when intervention failure and implementation failure need to be separated

Suppose an intervention produces good outcomes in controlled research but disappointing outcomes after being introduced into routine settings. What went wrong?

One possibility is intervention failure: the intervention itself did not produce the expected effect in the new context. Another is implementation failure: an effective intervention was not adopted, delivered, accessed, or sustained sufficiently well to produce the expected outcomes.

Proctor and colleagues emphasize that distinguishing implementation effectiveness from treatment effectiveness is important because poor implementation can prevent an otherwise effective intervention from producing its intended outcomes.

Intervention effectiveness Whether the intervention produces the intended outcomes.
Implementation effectiveness Whether the intervention is successfully adopted, delivered, integrated, and sustained as intended.

You do not necessarily have to finish effectiveness research before studying implementation

The traditional research pipeline is often represented as a sequence from efficacy to effectiveness and then implementation. That sequence can be useful, but it is not mandatory in every case.

Curran and colleagues proposed effectiveness-implementation hybrid designs specifically to combine questions that conventional staged research often separates. Later methodological work has continued to develop this approach.

A Type 1 hybrid primarily tests intervention effectiveness while gathering information about implementation. A Type 2 hybrid gives substantial attention to both intervention effectiveness and implementation. A Type 3 hybrid primarily tests an implementation strategy while continuing to collect information about intervention outcomes.

Hybrid type Primary emphasis Implementation role
Type 1 Intervention effectiveness Explore implementation context, barriers, facilitators, or related outcomes
Type 2 Effectiveness and implementation Study both intervention and implementation questions together
Type 3 Implementation strategy Primarily test implementation while monitoring intervention outcomes

These designs make an important point: moving toward implementation need not mean abandoning questions about whether the intervention itself works. The balance of questions can change gradually as the evidence develops.

Implementation research becomes premature when intervention evidence is too uncertain

There is little value in optimizing large-scale uptake of an intervention when researchers do not yet have a defensible reason to believe that the intervention provides the intended benefit.

This does not mean researchers must demand absolute certainty. Science rarely supplies it. The relevant judgment concerns whether existing evidence is strong enough, the intervention sufficiently plausible and appropriate, and the risks sufficiently understood to justify investing in questions about routine use.

The threshold should also reflect consequences. Interventions that are costly, invasive, difficult to reverse, or potentially harmful may warrant stronger effectiveness evidence before widespread implementation than low-risk practices.

Watch Out

Do not treat implementation as evidence that an intervention works. Successful adoption, high fidelity, or strong acceptability can show that an intervention can be delivered, but those outcomes do not substitute for evidence that the intervention produces its intended substantive effects.

Waiting too long has costs too

The opposite problem is assuming that implementation questions should begin only after a perfectly linear research pipeline has been completed. Curran and colleagues argued that blending effectiveness and implementation research can accelerate learning and produce information that is more useful to decision makers.

Implementation barriers discovered late can be particularly consequential. An intervention might require resources that ordinary settings cannot supply, depend on specialist expertise that is scarce, conflict with existing workflows, or be unacceptable to the people expected to use it.

Studying such issues while effectiveness evidence develops can reveal whether the intervention is realistically implementable and what support might eventually be required.

Implementation is not simply “using the intervention in the real world”

Putting an intervention into practice and observing what happens is not automatically implementation research. Implementation science investigates questions about the process of uptake and the strategies used to improve it.

For example, researchers might compare different training strategies, examine determinants of adoption, measure fidelity, investigate organizational barriers, evaluate implementation costs, or study sustainment after initial support ends.

The implementation strategy itself can therefore become the object of scientific evaluation.

The move toward implementation often follows a broader maturation of the question

When evidence about basic effectiveness has accumulated, researchers may already have begun asking for whom, when, and why an intervention works. Implementation adds another layer: can those benefits be realized reliably when the intervention enters ordinary systems?

This can be particularly important when new studies rarely change the central effectiveness conclusion. Another efficacy study under familiar conditions may then provide less information than research examining the barriers between evidence and routine use.

04 · A Practical Example

When a successful educational intervention meets ordinary practice

Hypothetical Example

A faculty development program with credible evidence of benefit

Imagine that a structured faculty development program has produced improvements in teaching practice across several reasonably rigorous studies. Researchers now want to introduce the program across a large university system.

Efficacy question Can the program improve the targeted teaching practices when trained facilitators deliver it under well-supported study conditions?
Effectiveness question Do improvements remain when the program is delivered across ordinary departments with more varied faculty and facilitators?
Implementation question Will departments adopt the program? Can faculty attend it? Can facilitators deliver it with acceptable fidelity? What resources are required? Will departments continue using it after research support ends?
Implementation-strategy question Does providing local implementation support produce better adoption and sustained delivery than distributing training materials alone?

These questions are related but not interchangeable. A highly effective program that almost nobody adopts will have limited real-world impact. A widely adopted program that does not improve outcomes has a different problem entirely.

05 · What Researchers Often Get Wrong

Implementation is not simply the final box in a research pipeline

Misconception

You must finish all effectiveness research before studying implementation

Not necessarily. Hybrid designs deliberately combine effectiveness and implementation aims when doing so is scientifically appropriate. Early attention to implementation can identify barriers and contextual factors before a later implementation trial.

Misconception

One successful efficacy trial means an intervention is ready for widespread implementation

A single study may provide insufficient evidence about effectiveness, harms, generalizability, or robustness. Readiness depends on the accumulated evidence, risks, intervention, population, and decisions under consideration.

Misconception

If an intervention fails in practice, the intervention does not work

Poor outcomes may result from intervention failure, implementation failure, or both. Researchers need measurements capable of distinguishing whether the intervention was actually adopted and delivered as intended.

Misconception

High fidelity is all that matters in implementation

Fidelity is one important outcome, but implementation may also depend on acceptability, feasibility, adoption, costs, reach, appropriateness, and sustainability. In some contexts, adaptation may also be necessary rather than strict replication of every delivery feature.

Misconception

Implementation research is just program evaluation

Implementation studies can use rigorous experimental, quasi-experimental, observational, qualitative, mixed-methods, and other designs to test determinants, strategies, processes, and outcomes. The defining feature is the implementation question, not the absence of rigorous research methods.

Misconception

Implementation success proves substantive effectiveness

An intervention can be acceptable, feasible, and widely adopted without producing the intended substantive outcomes. Implementation outcomes and intervention outcomes should be distinguished and measured accordingly.

06 · What This Means for You

Identify whether the uncertainty now lies in the intervention or in putting it into practice

Before proposing implementation research, examine the evidence supporting the intervention itself. Then identify what prevents the existing evidence from translating confidently into routine use.

A simple decision framework

If evidence that the intervention produces the intended benefit remains weak or seriously inconsistent
Prioritize stronger efficacy or effectiveness evidence while considering whether limited implementation data could still inform later work.
If effectiveness remains important but implementation barriers also need to be understood
Consider an effectiveness-focused study that incorporates implementation aims, such as an appropriate hybrid approach.
If both intervention effectiveness and implementation strategies require substantial testing
A design that gives explicit attention to both questions may be appropriate.
If intervention evidence is robust and the main uncertainty is how to achieve uptake and sustained delivery
Implementation strategies and implementation outcomes can become the primary research focus.

Research progression should therefore follow the uncertainty rather than a ceremonial sequence of study types. If the original efficacy question has been answered reasonably well, ask which new question has become consequential. Sometimes that question is no longer whether the intervention can work, but how to make its benefits attainable under the conditions where people actually need it.

07 · A Quick Checklist

Check whether implementation research is becoming the priority

Before shifting toward implementation, check:
Review whether the accumulated evidence provides a credible basis for expecting the intervention to produce worthwhile outcomes.
Determine how well existing evidence represents the populations and settings in which implementation is proposed.
Identify whether the main remaining uncertainty concerns intervention effectiveness, implementation, or both.
Specify the implementation outcomes that matter, such as acceptability, adoption, feasibility, fidelity, cost, reach, or sustainability.
Identify the implementation strategy being studied rather than treating implementation as an unspecified activity.
Measure substantive intervention outcomes when needed so that implementation failure can be distinguished from intervention failure.
Consider whether an effectiveness-implementation hybrid design better matches the current state of evidence than a strictly sequential approach.
08 · Frequently Asked Questions

Questions about moving from efficacy toward implementation

What is the difference between efficacy and effectiveness?

Efficacy generally concerns whether an intervention can produce its intended effect under comparatively controlled or favorable conditions, whereas effectiveness concerns outcomes under conditions closer to routine practice. The distinction is a continuum rather than an absolute boundary.

What is the difference between effectiveness and implementation?

Effectiveness concerns whether the intervention produces its intended substantive outcomes. Implementation concerns how the intervention is adopted, delivered, integrated, and sustained and how implementation strategies influence those processes.

How much evidence is enough before implementation research begins?

There is no universal number of trials. The judgment depends on the strength and relevance of existing evidence, intervention risk, population, context, remaining uncertainty, and the type of implementation research being proposed.

Can implementation research begin during an effectiveness study?

Yes. Effectiveness-implementation hybrid designs were developed specifically to integrate these questions. The appropriate balance depends on how established the intervention evidence is and which implementation questions can be investigated responsibly.

What are implementation outcomes?

A widely used taxonomy proposed by Proctor and colleagues includes acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration, and sustainability. These are distinct from the substantive outcomes the intervention itself is intended to change.

Is implementation research only relevant to healthcare?

No. Although much implementation-science methodology developed in health and healthcare, implementation questions arise wherever evidence-based interventions, programs, policies, or practices must be integrated into routine systems, including education and community settings.

Does moving to implementation mean efficacy studies should stop?

No. New populations, adaptations, technologies, outcomes, or evidence can create new effectiveness questions. Moving toward implementation means that routine uptake and delivery have become important research problems, not that intervention effectiveness can never be reconsidered.

09 · The Bottom Line

Move toward implementation when putting the evidence into practice becomes part of the scientific problem

The Bottom Line

Research should increasingly move from efficacy toward implementation when evidence of benefit is credible enough to justify real-world use and the consequential uncertainties concern how the intervention can be adopted, delivered, reached, and sustained in routine settings.

The transition does not have to be abrupt or perfectly sequential. Effectiveness and implementation can be studied together when appropriate. The important move is to recognize when another controlled demonstration of benefit answers less than a careful investigation of what happens between an effective intervention and its successful use in practice.

10 · Sources and Further Reading

Sources and further reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes