Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

When Should Economic Evaluation Be Conducted as a Separate Study Rather Than Embedded in a Trial?

Economic evaluations can be conducted alongside intervention trials or as separate studies using observational data, external evidence, and economic models. Learn when each approach is appropriate, what evidence it requires, and how to choose a design that supports credible economic decisions without unnecessarily expanding the original trial.

1329
Standalone Versus Embedded Economic Evaluation Guide 1329 of 1361
01 · The Question

Should an Economic Evaluation Be Part of the Intervention Trial or a Separate Research Study?

A research team is preparing a randomized trial of a new intervention. The primary objective is to determine whether the intervention improves its intended outcome. Institutional decision-makers also want to understand whether adopting it would represent an economically worthwhile use of resources.

One option is to collect resource-use and cost information alongside the trial. Another is to conduct a separate economic evaluation after effectiveness evidence becomes available, potentially combining trial results with administrative records, external studies, and economic modeling.

The decision is not straightforward. Embedding economic evaluation may improve coordination between cost and outcome measurements, but it can increase study complexity and may not capture long-term consequences. A separate study may address a broader decision problem, yet it can introduce additional assumptions and difficulties in combining evidence.

How should researchers decide whether economic evaluation belongs within the original trial or should be conducted independently?

02 · The Short Answer

Choose the Approach That Best Supports the Economic Decision and Required Evidence

In Brief

Economic evaluation should be embedded within an intervention trial when the trial can collect relevant comparative cost and outcome data, the economic question aligns with the trial design, and the additional measurement requirements are feasible. A separate economic evaluation may be preferable when the economic question requires a different population, perspective, comparator, time horizon, data source, or analytical framework that the trial cannot adequately support.

These approaches are not mutually exclusive. Trial-based economic evidence may be combined with subsequent modeling or evaluated within a separate economic study. The appropriate choice depends on the decision problem, available evidence, methodological assumptions, resources, and the extent to which trial conditions reflect intended implementation.

03 · What You Need to Know

Choosing Between Trial-Embedded and Standalone Economic Evaluation

What Is an Embedded Economic Evaluation?

An embedded economic evaluation is conducted alongside an intervention trial or another primary research study, with economic measurements incorporated into the research protocol.

For example, a randomized trial may collect healthcare utilization, intervention costs, and health outcomes from participants assigned to different treatment conditions.

In education, a trial comparing two instructional support programs may collect instructor time, technology expenditure, participant expenses, and learning outcomes.

When the data support an appropriate comparison, researchers may estimate incremental costs and consequences within the study population.

However, embedding economic measurement does not automatically make the analysis valid. The economic question must still be consistent with the trial's design, follow-up, population, and available information.

What Is a Standalone Economic Evaluation?

A standalone economic evaluation is conducted as a distinct study rather than as an integrated component of the original intervention trial.

It may use existing trial results, observational datasets, administrative records, published literature, or decision-analytic models.

For example, researchers may evaluate the long-term economic consequences of an intervention after several effectiveness studies have been completed.

A standalone evaluation may also examine a decision problem that differs from the original trial, such as implementation across an entire health system or university network.

The term standalone describes the organization of the economic study, not a single required methodology. A standalone evaluation may be model-based, observational, or otherwise designed according to its economic question.

How Do Embedded and Standalone Economic Evaluations Differ?

Feature Embedded evaluation Standalone evaluation
Relationship to intervention research Integrated into the primary trial or study Conducted as a distinct economic investigation
Typical evidence Prospectively collected trial costs and outcomes Existing studies, records, models, or new economic data
Population Often follows trial eligibility and recruitment May address a different decision population
Comparator Usually aligned with trial conditions May include alternatives not studied in the original trial
Time horizon Often supported directly by trial follow-up May use modeling to address longer horizons
Important advantage Coordinated measurement of costs and outcomes Flexibility to address a broader economic decision
Important limitation May inherit trial-specific constraints May depend more heavily on external evidence and assumptions

Neither approach is universally superior. A well-designed embedded evaluation may provide strong comparative evidence, while a carefully developed standalone model may better represent the consequences relevant to a longer-term policy decision.

When Is Embedding Economic Evaluation Within a Trial Appropriate?

Embedding is particularly useful when the trial's population, intervention, comparator, and follow-up correspond closely to the intended economic question.

For example, a pragmatic intervention trial may provide an opportunity to observe both outcomes and resource utilization under conditions relevant to routine practice.

Economic data can be collected using compatible assessment schedules and participant identifiers, subject to appropriate governance safeguards.

Prospective planning can also reduce the risk that important resource quantities are unavailable when the trial concludes.

Researchers should consider whether economic evaluation should be planned prospectively when trial-based economic analysis is an important objective.

When Might a Separate Economic Evaluation Be Preferable?

A separate evaluation may be appropriate when the economic question cannot be answered adequately within the original trial.

For example, the trial may have a short observation period while the intervention influences costs and outcomes over many years.

Alternatively, the trial may use a highly selected population, intensive research support, or a comparator that does not reflect the alternatives available to decision-makers.

A standalone evaluation may integrate evidence from several studies or use administrative data to address a broader population.

However, combining evidence introduces assumptions about comparability, transferability, and causal relationships that must be examined explicitly.

Does the Intervention's Development Stage Matter?

Yes. The maturity of intervention evidence influences the value of economic evaluation.

An early efficacy study may focus on whether the intervention produces its intended effect under controlled conditions.

Detailed economic evaluation may be premature if the intervention is still undergoing substantial development or if its eventual implementation model remains uncertain.

Nevertheless, basic resource documentation may still be useful for future costing.

When sufficient effectiveness evidence has accumulated, a standalone evaluation may be appropriate for comparing adoption strategies or estimating economic consequences under routine conditions.

The choice should reflect the research uncertainty rather than a rigid requirement to complete a fixed number of trials first.

Can an Embedded Economic Evaluation Use Modeling?

Yes. Embedded economic evaluations are not necessarily limited to descriptive analysis of directly observed trial costs and outcomes.

Researchers may combine trial data with decision-analytic modeling when important consequences extend beyond follow-up.

For example, a trial may provide short-term effectiveness and resource-use estimates, while a model projects later outcomes using relevant external evidence.

The distinction between embedded and standalone evaluation therefore should not be reduced to observed data versus modeled data.

The central difference concerns whether the economic evaluation is integrated into the original study or organized as a distinct investigation.

How Does the Time Horizon Influence the Choice?

The economic time horizon should capture the important differences in costs and consequences between alternatives.

If these differences occur within trial follow-up, an embedded evaluation may provide sufficient evidence.

If important consequences arise later, researchers may require extended follow-up, record linkage, modeling, or a separate evaluation.

For example, a short-term educational trial may observe the cost of introducing a digital platform but not its maintenance requirements across subsequent academic years.

Researchers should distinguish the economic consequences missed by short-term trials from those directly observed.

A longer horizon alone does not require a standalone study, but it may strengthen the case for one when substantial additional evidence is necessary.

What Happens When the Trial Population Differs From the Decision Population?

Trial eligibility criteria may restrict participation to a population that differs from those who would receive the intervention in routine practice.

For example, an educational intervention trial may recruit students with reliable internet access, while institutional adoption would include students with more varied technological resources.

These differences may influence both costs and outcomes.

A standalone economic evaluation may incorporate evidence relevant to the broader population, but extrapolation requires appropriate assumptions and data.

Researchers should not assume that trial-based economic estimates automatically generalize to excluded groups.

How Does the Comparator Affect Economic Evaluation Design?

Economic evaluation concerns choices between alternatives. The comparator should therefore reflect the decision the analysis intends to inform.

A trial may compare an intervention with usual care or existing practice at one institution. Decision-makers elsewhere may face different alternatives.

For example, a university may need to choose among several digital support platforms rather than between one platform and no intervention.

A standalone evaluation may combine suitable evidence to compare alternatives not evaluated directly within one trial.

However, indirect comparisons require careful consideration of differences in populations, settings, outcomes, and potential confounding.

Can a Standalone Evaluation Combine Evidence From Multiple Studies?

Yes. A standalone economic evaluation may use systematic reviews, meta-analyses, administrative records, and other relevant sources.

Combining evidence may improve coverage of intervention effects, resource use, and longer-term consequences.

However, different studies may use incompatible outcome definitions, resource categories, or implementation conditions.

Researchers should assess heterogeneity and explain how evidence is selected, synthesized, and incorporated into the economic model.

Using more sources does not automatically produce more reliable estimates if their underlying assumptions are incompatible.

What Is the Role of Decision-Analytic Modeling?

Decision-analytic modeling represents possible pathways, events, resource consequences, and outcomes associated with alternative decisions.

Models may be useful when relevant outcomes extend beyond direct observation or when evidence from several sources must be combined.

Common structures include decision trees and state-transition models, although the appropriate approach depends on the decision problem.

Models require assumptions about relationships between variables, event probabilities, intervention effects, and future resource use.

Researchers should justify the model structure, validate it where feasible, and examine uncertainty.

Modeling is not a substitute for credible effectiveness evidence.

Does a Standalone Evaluation Require Randomization?

No. Economic evaluation is not defined by randomization.

A standalone evaluation may use results from randomized trials, observational studies, or other suitable evidence.

However, causal estimates derived from nonrandomized comparisons require appropriate attention to confounding, selection, and other sources of bias.

Researchers should distinguish uncertainty in resource valuation from uncertainty in the estimated causal effects of the intervention.

An elaborate economic model cannot compensate for systematically biased effectiveness inputs.

Can Trial Conditions Distort Implementation Cost Estimates?

Potentially. Trials may provide additional training, supervision, equipment, or personnel not available during routine implementation.

Some of these resources are necessary to deliver the intervention, while others exist solely to support research procedures.

Researchers should distinguish routine delivery resources from research-specific expenditure.

For example, trial outcome assessors may not be required during ordinary program delivery, whereas continuing technical support may remain essential.

A standalone evaluation may estimate costs under a different implementation model, but those estimates should be supported by evidence rather than arbitrary assumptions.

How Do Implementation Costs Differ From Intervention Delivery Costs?

Implementation costs concern activities required to introduce, adopt, and integrate an intervention into practice.

They may include training, facilitation, workflow redesign, and initial infrastructure development.

Delivery costs concern resources consumed in providing the intervention to recipients.

For example, faculty training may be an implementation cost, while routine formative feedback is a delivery activity.

Researchers should distinguish these categories when estimating initial adoption and ongoing operation.

The selection of resource-use data for intervention studies should reflect this distinction.

Can an Embedded Economic Evaluation Increase Participant Burden?

Yes. Additional resource-use questionnaires, cost diaries, productivity measures, and follow-up assessments may increase participant demands.

Some information may be obtained through administrative or financial records, reducing the need for direct reporting.

However, existing records may not capture participant expenses or unpaid time.

Researchers should consider how economic data collection affects participant burden and study quality.

Where the economic component would substantially disrupt the primary trial, a separate study or more focused measurement strategy may be preferable.

Can a Standalone Evaluation Be Conducted After the Trial?

Yes. Researchers may conduct a separate economic evaluation after trial results become available.

However, retrospective analysis may be limited when important resource quantities were not recorded and cannot be reconstructed reliably.

For example, instructor preparation time or participant connectivity expenses may be absent from institutional financial records.

A later evaluation may use external evidence or additional data collection, but the resulting assumptions and limitations should be transparent.

Researchers should distinguish the organizational decision to conduct the evaluation separately from the methodological decision to collect certain data prospectively.

Can a Trial Collect Economic Data Without Conducting a Full Embedded Evaluation?

Yes. A trial may collect selected resource-use information to support future economic analysis without attempting a complete comparative economic evaluation within the original study.

For example, researchers may document staff time, equipment use, training, and participant expenses while postponing longer-term economic modeling.

This can preserve useful information that would otherwise be difficult to recover.

However, collecting economic data does not guarantee that a future cost-effectiveness analysis will be feasible.

The eventual analysis still requires suitable comparative outcomes, an appropriate perspective, and defensible methods.

How Do Budget Impact and Cost-Effectiveness Questions Differ?

Cost-effectiveness analysis compares costs and consequences of alternatives, while budget impact analysis examines the financial consequences of adopting an intervention for a particular budget holder.

For example, a university may need to know whether an intervention offers good economic value and whether it can afford the initial expenditure during its annual budget cycle.

These are related but distinct questions.

A standalone budget impact analysis may be appropriate even when a trial-based cost-effectiveness analysis has already been completed.

Researchers should specify the decision being informed rather than assume that one economic analysis answers every financial question.

How Should Statistical Uncertainty Be Addressed in Embedded Evaluations?

Trial-based economic evaluations should account for uncertainty in costs, outcomes, and their relationship.

Cost data may be skewed, and missing observations may differ systematically across participants.

Appropriate statistical methods should reflect the trial's design, clustering, allocation, and analytical estimand.

For example, an economic evaluation alongside a cluster-randomized trial should not ignore correlation among participants within the same institution.

Researchers should avoid interpreting a nonsignificant difference in costs as proof that the alternatives have equal economic consequences.

How Should Uncertainty Be Addressed in Standalone Evaluations?

Standalone evaluations may involve parameter uncertainty, structural uncertainty, and uncertainty about transferring evidence to the decision population.

Deterministic sensitivity analyses can examine alternative assumptions, while probabilistic sensitivity analysis may characterize uncertainty in model parameters.

Scenario analyses may examine different implementation arrangements, time horizons, or population characteristics.

Researchers should distinguish uncertainty supported by empirical distributions from assumptions introduced because evidence is unavailable.

A precise model output should not be interpreted as a precise prediction when the underlying evidence is weak.

What Are the Main Advantages and Limitations of Each Approach?

Embedded Economic Evaluation

Potential advantages: Coordinated cost and outcome measurement, direct alignment with trial comparisons, and prospective collection of difficult-to-reconstruct resources.

Potential limitations: Trial-specific populations, short follow-up, additional participant burden, and economic questions constrained by the original comparison.

Standalone Economic Evaluation

Potential advantages: Flexibility to address broader populations, alternative comparators, longer horizons, and evidence from multiple sources.

Potential limitations: Dependence on external evidence, assumptions about transferability, retrospective data limitations, and potential model uncertainty.

The choice should depend on which limitations matter most for the intended decision rather than an assumption that one approach is methodologically superior in all circumstances.

When Is a Combined Approach Most Appropriate?

A combined approach may be useful when a trial can provide credible short-term cost and effectiveness data but the economic decision requires a longer horizon or broader implementation context.

Researchers may collect relevant resource-use information prospectively, conduct a trial-based analysis, and subsequently use those findings within a model-based evaluation.

For example, a university may estimate one-semester intervention costs directly and model future delivery across additional cohorts using justified assumptions about enrollment and maintenance.

However, the model should not assume that observed short-term benefits persist indefinitely.

Researchers should explain how trial evidence and external information contribute to the final economic estimates.

How Should Researchers Decide Which Approach Is Feasible?

Feasibility depends on the research objectives, available data, analytical expertise, participant burden, institutional access, and funding.

An embedded evaluation may be practical when the trial already collects most relevant outcomes and economic measurements can be added without substantial disruption.

A standalone evaluation may be more feasible when suitable datasets already exist or when the economic question requires substantial modeling expertise.

However, separating the study does not automatically reduce total research costs or eliminate data limitations.

Researchers should evaluate the full information requirements of each approach before selecting one.

How Should the Chosen Economic Evaluation Design Be Reported?

Reports should identify whether the economic evaluation was embedded, standalone, or combined, and explain the methodological rationale.

Researchers should specify the perspective, intervention, comparator, population, time horizon, outcomes, resource-use measures, valuation methods, and uncertainty analyses.

For embedded evaluations, the relationship between the economic analysis and the trial protocol should be clear.

For standalone evaluations, evidence sources, synthesis methods, modeling assumptions, and validation procedures should be described.

CHEERS 2022 provides relevant reporting guidance for health economic evaluations, although compliance with reporting guidance does not independently establish methodological validity.

Watch Out

Do not assume that embedding economic evaluation automatically produces more credible evidence, or that a standalone model can compensate for missing or biased effectiveness data. The economic design must match the decision problem, and conclusions should reflect the strengths and limitations of the evidence used.

04 · A Practical Example

Choosing Between Embedded and Standalone Economic Evaluation for a Digital Learning Program

Hypothetical Example

A One-Semester Trial With a Three-Year Adoption Decision

A university conducts a randomized trial of a digital academic support intervention involving 400 students over one semester.

The trial can measure learning outcomes, instructor time, software expenditure, and technical support costs. However, university administrators are considering adoption across several campuses over three academic years.

The research team must determine whether a trial-embedded evaluation alone can answer the adoption question or whether a separate longer-term analysis is required.

Economic question Available evidence Potential approach
What is the intervention's cost during the trial? Prospective staff, software, and support records Embedded costing
What is its incremental cost per learning outcome? Trial costs and comparative learning outcomes Embedded economic evaluation
What will implementation cost across campuses? Trial resource quantities plus external campus information Standalone or supplementary economic modeling
Will benefits persist across later cohorts? Short-term effectiveness evidence only Additional evidence and cautious extrapolation
Can the institution afford adoption? Projected expenditure and institutional budget information Budget impact analysis
Step 1: Define the trial-based question. The researchers establish that the original trial can estimate costs and learning outcomes over one semester under the study conditions.
Step 2: Plan embedded resource measurement. Instructor time, licensing, technical support, and comparator resources are recorded prospectively.
Step 3: Identify the broader decision. Institutional adoption requires estimates across several campuses and multiple academic years.
Step 4: Review additional evidence. The team identifies information about future enrollment, staffing, maintenance, and campus infrastructure.
Step 5: Select a combined approach. Trial-based economic estimates are developed first, then incorporated into a separate analysis of longer-term adoption scenarios.
Step 6: Evaluate uncertainty. The researchers examine alternative assumptions about enrollment, recurring costs, intervention durability, and effectiveness.
Step 7: Report distinct conclusions. Directly observed trial economics are distinguished from modeled institutional adoption projections.

The combined approach preserves the advantages of prospective trial-based resource measurement while addressing a decision that extends beyond the original research setting.

However, the three-year projections remain conditional on assumptions about future implementation and outcomes.

The example illustrates why the most appropriate economic evaluation structure may involve both embedded measurement and a separate analytical study rather than an exclusive choice between them.

05 · What Researchers Often Get Wrong

Common Misconceptions About Standalone and Embedded Economic Evaluation

Misconception

Is an Embedded Economic Evaluation Always More Rigorous?

No. Embedded evaluations benefit from coordinated measurement but may inherit trial-specific limitations. Rigor depends on the economic question, research design, data quality, and analytical assumptions.

Misconception

Must Standalone Economic Evaluations Use Only Retrospective Data?

No. Standalone evaluations may collect new data prospectively, use existing datasets, or combine multiple evidence sources through appropriate methods.

Misconception

Does Economic Modeling Make Trial Evidence Unnecessary?

No. Models require credible estimates of intervention effects and other parameters. Modeling cannot eliminate bias or uncertainty in the underlying evidence.

Misconception

Can Embedded Economic Evaluation Consider Long-Term Outcomes?

Yes. Trial-based economic evaluation may incorporate modeling beyond follow-up when relevant evidence and defensible assumptions are available.

Misconception

Does Collecting Cost Data Automatically Constitute a Full Economic Evaluation?

No. A full economic evaluation requires an appropriate comparison of both costs and consequences. Descriptive resource measurement alone does not establish economic value.

Misconception

Must Researchers Choose Either Embedded or Standalone Evaluation?

No. Trial-based data may inform a subsequent standalone analysis, and complementary approaches can address different aspects of the same decision problem.

06 · What This Means for You

How to Choose the Appropriate Economic Evaluation Structure

Begin by defining the economic decision independently of the intervention trial's administrative structure. Identify the population, comparator, perspective, time horizon, and evidence required.

Then determine whether the original trial can provide that evidence or whether a separate evaluation is needed.

A simple decision framework

If the trial aligns closely with the economic decision
Consider embedding economic evaluation and planning cost and outcome collection prospectively.
If the decision requires different populations or comparators
Consider a standalone evaluation using suitable additional evidence and appropriate synthesis methods.
If important consequences extend beyond trial follow-up
Consider longer-term modeling, extended observation, or a separate evaluation supported by relevant evidence.
If economic data collection would substantially compromise the trial
Prioritize essential measurements and assess whether a separate economic study would be more feasible.
If trial data are useful but insufficient for the full decision
Consider a combined approach that uses embedded measurements to inform a separate economic analysis.

The most defensible choice is the one that produces relevant economic evidence with transparent assumptions and sufficient methodological support.

07 · A Quick Checklist

Check Whether Economic Evaluation Should Be Embedded or Conducted Separately

Before selecting the economic evaluation approach, check:
Define the economic decision, perspective, population, intervention, and comparator.
Determine whether the trial's design and follow-up align with the economic question.
Identify which resource-use and outcome data can be collected prospectively within the trial.
Assess whether external evidence or modeling is required for the intended decision.
Examine the relevance of the trial population and comparator to routine implementation.
Evaluate participant burden, analytical expertise, resources, and operational feasibility.
Distinguish research-specific expenditure from routine implementation costs.
Specify methods for missing data, uncertainty, and transferability assumptions.
Consider whether a combined trial-based and standalone approach would better answer the decision problem.
08 · Frequently Asked Questions

Frequently Asked Questions About Standalone and Embedded Economic Evaluations

What is an embedded economic evaluation?

It is an economic evaluation integrated into an intervention trial or primary research study, often using prospectively collected comparative costs and outcomes.

What is a standalone economic evaluation?

It is a distinct economic study that may use trial results, observational data, administrative records, external evidence, or modeling to address a defined economic decision.

Is a standalone economic evaluation less rigorous than a trial-based evaluation?

Not necessarily. Each approach has different strengths and limitations. Rigor depends on the design, evidence, assumptions, and intended economic inference.

Can economic evaluation be conducted after a randomized trial?

Yes. A subsequent evaluation may use trial evidence and other sources, although missing resource information or incompatible outcomes may limit the analysis.

Can an embedded economic evaluation include long-term modeling?

Yes. Trial-based data may support extrapolation beyond observed follow-up when the model and assumptions are justified by appropriate evidence.

Should economic evaluation always be included in effectiveness trials?

No. Inclusion should depend on the economic question, intervention maturity, data requirements, and whether the additional evaluation is scientifically and operationally justified.

Can a trial collect resource-use data for a future standalone evaluation?

Yes. Prospective resource documentation may preserve useful information, although future economic evaluation will still require suitable comparative outcomes and methods.

When is a combined approach preferable?

It may be useful when the trial provides credible short-term cost and outcome data but the economic decision requires broader populations, alternative implementation conditions, or longer-term consequences.

09 · The Bottom Line

Economic Evaluation Should Follow the Decision Problem, Not Merely the Trial Structure

The Bottom Line

Economic evaluation should be embedded within a trial when the study can provide relevant comparative costs and outcomes with appropriate methodological rigor. A standalone evaluation may be preferable when the economic decision requires evidence beyond the trial's population, comparator, time horizon, or implementation conditions.

The approaches can also complement one another. Researchers should preserve valuable prospective economic information where feasible and select the evaluation structure that best supports the intended decision, with transparent assumptions and appropriate uncertainty analysis.

10 · Sources and Further Reading

Authoritative Sources on Trial-Based and Standalone Economic Evaluation

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes