03 · What You Need to Know
Understanding How Economic Measurement Affects Participants and Research Quality
What Is Participant Burden in Economic Data Collection?
Participant burden refers to the demands associated with providing information required by a research study. In economic evaluation, these demands may involve remembering expenditures, estimating time use, consulting financial records, completing diaries, or reporting service utilization.
Burden may be practical, cognitive, emotional, or financial. A participant might spend considerable time completing a questionnaire, struggle to distinguish routine expenses from intervention-related costs, or feel uncomfortable disclosing household financial circumstances.
These demands vary across populations. An instrument that is straightforward for one group may be difficult for participants with limited literacy, disabilities, language barriers, or competing responsibilities.
Researchers should therefore consider both the amount of information requested and the effort required to provide it accurately.
Why Can Economic Evaluation Require Additional Data Collection?
Effectiveness studies usually measure outcomes related to the intervention's intended benefits or harms. Economic evaluations additionally require information about resources consumed and, where relevant, costs borne by different stakeholders.
For example, a clinical intervention may influence healthcare visits, medication use, transportation expenses, and time away from employment. An educational intervention may require additional connectivity, equipment, instructor support, or participant time.
Some information can be obtained from organizational records. Other resource categories may be observable only to participants.
The question is not whether economic information should be collected at all, but which resource-use data are necessary for the intended evaluation.
Which Economic Measurement Methods May Create Burden?
| Measurement approach |
Potential burden |
Important methodological consideration |
| Repeated resource-use questionnaires |
Time and repeated recall demands |
Assessment frequency and completeness |
| Daily expenditure diaries |
Continuous recording and recordkeeping |
Diary fatigue and declining adherence |
| Employment questionnaires |
Sensitive information and difficult productivity estimates |
Privacy, validity, and valuation assumptions |
| Travel and time-use logs |
Recording trips, waiting, and activities |
Attribution and recall accuracy |
| Administrative record linkage |
Potentially less direct reporting |
Consent, governance, coverage, and linkage quality |
| Interviews about expenses |
Scheduling and discussion of personal circumstances |
Interviewer effects and participant comfort |
No method is universally least burdensome. A brief questionnaire may be easier than a daily diary for some participants, while frequent recording may be preferable when events are difficult to remember retrospectively.
How Can Repeated Economic Questionnaires Affect Completion?
Repeated assessments require participants to sustain attention and cooperation throughout the observation period.
When questionnaires repeatedly ask about numerous minor expenses or activities, participants may begin skipping questions, providing approximate answers, or discontinuing reporting.
However, these outcomes should not be assumed to occur uniformly. Completion may depend on questionnaire design, participant circumstances, study support, and the perceived relevance of the information.
Researchers should monitor response patterns rather than infer participant fatigue solely from the number of questionnaires administered.
The broader concern about repeated measurement and participant fatigue applies to economic data collection as well.
Can Economic Data Collection Increase Missing Data?
Yes. Participants may omit individual cost items, fail to return questionnaires, or withdraw from economic follow-up.
Missingness may be particularly consequential when it is related to resource consumption or participant circumstances.
For example, participants who experience substantial illness-related expenses may also find repeated questionnaires difficult to complete. If their resource use is systematically underrepresented, economic estimates may be biased.
Researchers should distinguish item nonresponse from complete questionnaire nonresponse and participant attrition.
They should also avoid assuming that a blank response means that no resource was used. An explicit zero and an unanswered question represent different information.
How Does Missing Economic Data Affect Cost-Effectiveness Analysis?
Incomplete cost information may reduce precision or introduce bias into estimates of mean costs and incremental economic consequences.
Cost data are often skewed because a relatively small number of participants may incur substantial expenditure. Missing observations among high-resource users can therefore be especially consequential.
Complete-case analysis may be inappropriate when participants with complete economic data differ systematically from those with missing observations.
Methods such as multiple imputation may be considered under suitable assumptions, but they cannot guarantee recovery of unobserved costs.
Researchers should investigate patterns of missingness, collect relevant auxiliary variables when feasible, and consider sensitivity analyses for assumptions that cannot be verified directly.
Can Longer Recall Periods Reduce Burden Without Reducing Accuracy?
Longer recall periods reduce the number of assessment contacts but may make certain resource-use events harder to remember.
For example, participants may recall a major hospital admission several months later but struggle to reconstruct numerous small transportation or connectivity purchases.
Shorter recall periods may improve reporting of some events while increasing the frequency of questionnaires.
The appropriate interval depends on event frequency, salience, the availability of records, and the measurement instrument.
Researchers should test recall periods rather than assume that either frequent or infrequent reporting is always superior.
Are Prospective Cost Diaries More Accurate Than Retrospective Questionnaires?
Prospective diaries can reduce reliance on long-term memory by allowing participants to record resource use close to the time it occurs.
However, diaries depend on sustained adherence. Participants may forget entries, record events retrospectively, or stop using the diary.
Retrospective questionnaires may be less demanding when events are infrequent or documented elsewhere.
Evidence comparing diary and recall methods should be interpreted in relation to the resource category and study population.
Researchers should not treat prospective recording as automatically error-free or retrospective reporting as inherently unreliable.
Can Economic Questions Create Emotional or Privacy-Related Burden?
Yes. Questions about income, employment, debt, household expenditure, or financial hardship may be sensitive.
Participants may be reluctant to disclose information they consider private, particularly when it appears unrelated to the intervention.
Researchers should explain why information is needed and avoid requesting more detail than the economic analysis requires.
Data collection procedures should include appropriate confidentiality, access controls, and applicable ethics and data protection safeguards.
Participants should not be pressured to disclose unnecessary financial information merely because the research team wishes to construct a comprehensive dataset.
Can Burden Differ Across Participant Groups?
Yes. The same instrument may require different levels of effort depending on literacy, language, disability, digital access, employment arrangements, and caregiving responsibilities.
For example, a digital expenditure diary may be convenient for participants with reliable internet access but difficult for those who depend on intermittent connectivity.
Similarly, a questionnaire based on formal employment may fail to capture unpaid work or irregular livelihood arrangements.
Researchers should consider how to make research materials accessible to participants with different literacy and disability needs.
Accessibility accommodations should preserve the intended measurement construct while reducing avoidable barriers.
Can Measurement Burden Threaten Representativeness?
Potentially. Participants with limited time, financial resources, digital access, or other constraints may be less likely to complete demanding economic assessments.
If these characteristics are associated with costs or intervention outcomes, the resulting economic sample may differ from the population the study intends to represent.
Researchers should examine whether economic data completeness varies across relevant participant characteristics.
However, differences in completion do not automatically establish selection bias. The implications depend on the analytical estimand, missing-data mechanism, and available information.
The relationship between participant burden, attrition, and research validity should be considered when designing economic follow-up.
Should Researchers Collect Every Potential Cost Category?
No. Economic measurement should follow the analytical perspective, comparator, time horizon, and decision problem.
Some resource categories may be unlikely to differ between alternatives or contribute materially to the economic conclusion.
However, omitting a category merely because it is difficult to measure can be problematic when it represents a substantial economic consequence.
Researchers should prioritize categories according to expected relevance, magnitude, variability, and availability of reliable data.
Exclusions should be justified and reported transparently.
Can Administrative Records Reduce Participant Burden?
Administrative and financial records may reduce the need for participants to report information already captured routinely.
For example, institutional records may provide software expenditure, service utilization, or reimbursement information.
However, these records may omit privately paid expenses, informal care, unpaid time, or resources not recorded by the organization.
Researchers should assess completeness, definitions, observation periods, and whether recorded charges represent the economic quantities required.
Record linkage may also require additional permissions and governance arrangements.
Replacing questionnaires with administrative records should improve the data collection process only when the records are appropriate for the intended analysis.
Can Digital Tools Make Economic Reporting Easier?
Digital tools may support convenient recording through mobile forms, reminders, and automated data capture.
For example, participants may record transportation expenses immediately after an intervention visit rather than reconstruct them months later.
However, digital tools can introduce barriers involving connectivity, device compatibility, accessibility, privacy, or technical confidence.
Researchers should evaluate whether the selected platform is suitable for the target population and whether alternative reporting methods are necessary.
Digitalization should not be confused with automatic burden reduction.
How Can Researchers Determine Which Economic Questions Are Essential?
A useful approach is to map each questionnaire item or data field to a resource category and an intended analytical use.
For example, a question about transportation expenditure may be necessary when participant travel costs differ between interventions. Detailed questions about unrelated household purchases may not be justified.
Researchers should identify whether each item contributes to the primary analysis, a prespecified secondary analysis, or an exploratory objective.
Items without a defensible analytical purpose should be reconsidered.
The aim is to maximize useful research information while minimizing unnecessary participant burden.
How Can Cognitive Interviewing Improve Economic Questionnaires?
Cognitive interviewing can help researchers investigate how participants understand questions, retrieve information, make judgments, and select responses.
For example, participants may interpret a question about travel costs as referring only to public transportation fares, while researchers intend to include parking and fuel expenditure.
Such misunderstandings may create measurement error even when questionnaires are completed fully.
Pretesting can reveal ambiguous wording, unsuitable recall periods, and categories that participants cannot reasonably estimate.
Researchers should revise instruments based on evidence about comprehension rather than assuming that a shorter questionnaire is necessarily clearer.
Should Economic Data Collection Be Piloted?
Pilot testing is particularly useful when economic measurement involves unfamiliar instruments, repeated diaries, complex recall tasks, or populations with diverse access needs.
A pilot may assess completion time, item nonresponse, reporting accuracy, acceptability, and the feasibility of obtaining administrative records.
Researchers should distinguish feasibility outcomes from definitive evidence about economic effectiveness.
A small pilot may reveal practical difficulties but may not provide precise estimates of resource-use variability or missingness in the main study.
Findings should inform proportionate revisions to the collection procedures.
Can Reducing Economic Measurement Compromise Study Quality?
Yes. Removing questions or lengthening recall periods may reduce burden while omitting consequential costs or increasing measurement error.
For example, eliminating questions about participant travel may be inappropriate when the interventions differ substantially in attendance requirements.
Researchers should distinguish redundant measurements from information necessary for valid economic comparison.
The relevant trade-off concerns the expected quality of the economic estimate, not questionnaire length alone.
Where a resource category is essential, researchers should consider less demanding ways of measuring it before deciding to exclude it.
How Should Economic Data Collection Be Scheduled?
Economic assessments should be scheduled according to when relevant resources are consumed and how reliably they can be recalled.
One-time implementation costs may be obtained from organizational records, while participant expenses may require reporting at selected follow-up intervals.
Researchers should avoid collecting information at every visit when less frequent measurement would provide sufficiently accurate data.
Conversely, important short-lived events may require more frequent recording.
The measurement schedule should be integrated with the broader protocol to avoid unnecessary additional contacts.
How Should Researchers Evaluate Whether Burden Reduction Worked?
Researchers can compare completion time, item nonresponse, questionnaire return rates, participant feedback, and the completeness of important resource categories before and after revising the measurement process.
Where feasible, alternative collection approaches may be compared directly.
However, higher completion rates do not necessarily establish greater measurement accuracy.
A revised instrument may be easier to complete but less comprehensive or less sensitive to relevant resource use.
Evaluation should therefore consider both participant experience and the quality of the economic information obtained.
How Should Burden and Missingness Be Reported?
Reports should describe the economic instruments, assessment schedule, data sources, and relevant completion patterns.
Researchers should identify substantial missing resource categories and explain how incomplete observations were handled.
Where collection procedures were changed during the study, consequential modifications should be documented.
The CHEERS 2022 reporting guidance supports transparent description of economic evaluation methods and uncertainty, while appropriate trial and feasibility reporting guidance may address participation and data completeness.
Researchers should avoid implying that economic estimates are complete merely because the effectiveness dataset has high retention.
Watch Out
Do not assume that more economic measurements automatically produce more reliable estimates. Excessive reporting demands may increase missingness and reduce participation, while indiscriminate shortening may omit important costs. The objective is to obtain sufficiently complete, accurate, and relevant economic information through proportionate procedures.