Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Do You Need an Amendment to Change the Data Analysis Plan?

Not every analytical adjustment requires a new ethics review, but some changes can alter study outcomes, data use, scientific validity, or the research described in the approved protocol. The significance depends on what changes and why.

73
Changing the Data Analysis Plan Guide 73 of 398
01 · The Question

Can You Change How You Analyze the Data After Ethics Approval?

You planned to use one statistical test, but the data violate its assumptions. An additional subgroup analysis becomes interesting. A qualitative coding framework needs refinement after researchers begin reading transcripts. Perhaps a planned model simply does not work with the data you actually collected.

Analysis plans do change, sometimes for entirely defensible methodological reasons. But once a study has ethics approval, the relevant question is not simply whether another analysis would be statistically or methodologically better. You also need to ask whether the revised analysis remains within the research that was reviewed and approved.

Some analytical adjustments may have little or no effect on participants or the ethical basis of the study. Others can change outcomes, hypotheses, data uses, privacy implications, or the scientific justification on which participant involvement was accepted. Those differences matter.

02 · The Short Answer

Some Analysis Changes Need an Amendment, but Not Every Analytical Decision Does

In Brief

A change to the data analysis plan may require an ethics amendment when it materially changes the approved research, such as its objectives, outcomes, planned use of participant data, privacy protections, or scientific design. A technical analytical adjustment that remains within the approved study may be treated differently.

The threshold varies among ethics systems and institutions. Before implementing a substantive change, compare the revised analysis with the approved protocol and determine whether the responsible ethics committee requires an amendment, notification, or another form of prospective review.

03 · What You Need to Know

Analysis Changes Differ Greatly in Their Ethical Significance

Start With What the Approved Protocol Actually Says About Analysis

Protocols vary considerably in analytical detail. One may specify the primary outcome, statistical model, covariates, subgroup analyses, handling of missing data, and sensitivity analyses. Another may state only the broad analytical approach. A qualitative protocol may describe thematic analysis while deliberately allowing coding to develop iteratively.

That difference matters. A decision already permitted by the protocol is not necessarily a protocol modification simply because it was made after data collection began.

Before asking whether an amendment is needed, identify the analytical commitments actually contained in the approved protocol. Then compare those commitments with what you now propose to do.

Changing a Statistical Technique Is Not Necessarily the Same as Changing the Research

Suppose a researcher planned an independent-samples t-test but discovers that the data do not satisfy the assumptions required for the planned analysis. Using a defensible alternative may represent a technical response to the observed data rather than a change to the study's substantive purpose.

Likewise, modifying model specifications, using a robust estimator, changing a missing-data technique, or correcting a programming error may sometimes leave the research question, outcomes, participant population, collected data, and privacy arrangements unchanged.

Whether such adjustments require ethics review depends on the specificity of the approved protocol and the applicable institutional rules. Ethics committees are not ordinarily intended to function as statistical software help desks, but methodological changes can become ethically relevant when they alter the research that was approved.

Changing Primary Outcomes Is More Consequential

Changing which outcome is considered primary can alter the scientific meaning of a study. If an outcome performs poorly or produces an inconvenient result, replacing it after examining the data also raises concerns about selective outcome reporting and interpretive bias.

This is not merely an ethics-administration issue. The change should be transparently documented in the research record and, where relevant, in trial registration, analysis documentation, manuscripts, or reports. Prospective and post hoc decisions should not be presented as though they were the same.

If the approved protocol identifies specific primary and secondary outcomes, changing their status may represent a substantive protocol modification and should be assessed under the applicable ethics procedure.

Adding a New Analysis Does Not Automatically Mean New Ethics Review

Researchers routinely explore data beyond the primary analysis. An additional correlation, sensitivity analysis, alternative model, or exploratory subgroup analysis does not automatically create a new human-participants study.

The important questions are what data are being used, whether those data were already legitimately collected for the approved research, whether the proposed analysis remains within permitted uses, and whether it creates new privacy, identifiability, or participant-group concerns.

A useful exploratory analysis may therefore be methodologically permissible without changing the approved research, yet it should still be labeled honestly as exploratory if it was not prespecified. Ethics approval should never be used to convert an analysis invented after seeing the results into a prespecified hypothesis.

New Data Linkage Can Change the Ethics Question

An analytical idea may require information that was never part of the approved dataset. For example, researchers might decide to link survey responses with academic records, clinical records, employment data, geolocation, administrative databases, or publicly available information about individual participants.

At that point, the proposal is no longer merely a different statistical test. New data are being obtained or linked, and the change may affect privacy, confidentiality, identifiability, consent, data security, or institutional permissions.

The amendment question should therefore be framed around the actual new activity rather than described vaguely as “changing the analysis.”

Subgroup Analysis Can Create Privacy and Interpretive Concerns

Analyzing smaller participant groups can be scientifically useful, but increasingly granular subgrouping may make individuals easier to identify, particularly in small populations or sensitive settings.

Subgroup analyses can also generate claims about communities or demographic groups that were not part of the original analytical rationale. That does not make such analyses inherently unethical, but it may affect how data use, disclosure risk, and interpretation should be considered.

Qualitative Analysis Is Often Iterative by Design

Qualitative research requires particular care because its analytical process is often intentionally iterative. Codes may be refined, categories merged, themes reconsidered, and interpretations developed as researchers engage with the data.

If that flexibility is part of the approved methodological approach, every adjustment to a codebook is not necessarily a protocol amendment. The situation changes when the analysis expands into a materially different research purpose, requires new data, introduces new identifiable linkages, or otherwise moves beyond the approved study.

Researchers should therefore distinguish methodological iteration within an approved qualitative design from redesigning the research question after data collection has begun.

Scientific Validity Has Ethical Relevance

Research involving participants should be capable of producing knowledge sufficient to justify the burdens and risks imposed. OHRP guidance describing the criteria for IRB approval notes that risks should be minimized through procedures consistent with sound research design.

An analysis change that repairs a defensible methodological problem may therefore strengthen rather than undermine the ethical basis of the study. Conversely, an analytical change that substantially weakens the study, abandons its original purpose, or introduces avoidable bias may raise questions about scientific validity.

Ethics review and methodological peer review remain different functions, but they overlap where scientific inadequacy affects the justification for exposing participants to research burdens or risks.

Changes to Analysis Can Originate Upstream

A revised analysis plan may be the consequence of another protocol modification. Adding questions to a survey creates new variables. Changing the sample size may affect power and modeling. Removing a research site may change planned site comparisons. Altering an intervention may change the outcomes that need to be analyzed.

In such cases, the analytical change should not be assessed in isolation. If the underlying modification also changes the approved research instrument, consider the implications of changing the research instrument. If enrollment changes, assess the sample-size modification as well.

Prospective Changes and Post Hoc Analyses Should Be Distinguished

If researchers decide before seeing relevant outcome data that the analysis plan should change, they can document the rationale and follow whatever amendment or protocol process applies. Once results are known, the interpretive situation changes.

Post hoc analysis is not inherently illegitimate. Many useful findings emerge through exploration. The problem arises when exploratory decisions are concealed or represented as though they were prespecified.

Good research records should therefore preserve when an analytical decision was made, why it changed, and whether relevant outcome data had already been examined.

Watch Out

Do not rewrite the analysis plan after seeing the results and then present the revised analysis as the plan that existed all along. Ethics documentation, protocol history, registrations, analysis plans, and publications should preserve the distinction between prespecified and post hoc decisions where that distinction matters.

Whether an Amendment Is Required Depends on the Governing Process

Under U.S. HHS requirements, proposed changes to approved research generally require IRB review and approval before implementation, except when necessary to eliminate apparent immediate hazards to participants. OHRP also recognizes expedited review of qualifying minor changes.

This does not mean that every analytical keystroke constitutes a protocol amendment. The key question is whether the proposed analytical change is a change to the approved research under the applicable framework. Institutions should have procedures for determining which changes are minor and which require a different level of review.

04 · A Practical Example

When a Different Statistical Test Is Not the Only Change

Hypothetical Example

A researcher wants to explain an unexpected survey finding

A researcher has completed an approved survey examining faculty adoption of educational technology. The protocol specifies several primary variables and a regression analysis. After examining the results, the researcher notices an unexpected difference among departments and proposes linking participants' responses to identifiable personnel records to obtain rank, employment status, and years of service.

Original analysis The approved dataset and regression model use information collected through the survey.
New analytical question The researcher wants to explain departmental differences using additional employment information.
What actually changes The proposal requires acquiring and linking identifiable data that were not part of the original dataset.
Ethics implications Data access, linkage, privacy, confidentiality, consent, and the scope of approved data use may change.
Action The researcher determines what prospective ethics and institutional authorization is required before obtaining or linking the additional records.

Describing this simply as “another regression” would miss the ethically important part. The statistical technique is not the main issue. The new data needed to perform the analysis are.

05 · What Researchers Often Get Wrong

Common Misunderstandings About Changing the Analysis Plan

Misconception

“Any Change in Statistical Test Requires an Ethics Amendment”

Not necessarily. A technical analytical adjustment may remain within the approved research, particularly when the protocol allows methodological flexibility. The applicable ethics procedure and substance of the change determine whether further review is required.

Misconception

“Analysis Happens After Participation, So Ethics No Longer Matters”

Analysis can still implicate privacy, confidentiality, permitted data use, identifiability, scientific validity, and the commitments made to participants. The end of data collection does not make every subsequent use of the data unrestricted.

Misconception

“I Can Change the Primary Outcome if Another Result Looks More Interesting”

Changing outcomes after examining results raises methodological and reporting concerns and may also alter the approved protocol. Exploratory findings can be reported as exploratory rather than retrospectively rewriting what the study originally set out to test.

Misconception

“Using Existing Data Means I Can Analyze Them for Anything”

Not necessarily. The permitted use of research data can depend on consent, ethics approval, data-access conditions, agreements, privacy requirements, and applicable law. Possessing a dataset is not equivalent to having unrestricted authorization for every conceivable analysis.

Misconception

“Qualitative Analysis Can Never Require an Amendment Because It Is Emergent”

Iterative coding and interpretation may be intrinsic to an approved qualitative design. A materially new research purpose, new data linkage, or substantive expansion beyond the approved study is different from ordinary analytical iteration.

06 · What This Means for You

Ask Whether You Are Changing the Technique or Changing the Research

When the analysis needs revision, describe the proposed change precisely. “Change the statistics” is not enough. Identify what variables, outcomes, hypotheses, participant groups, datasets, linkages, or analytical procedures will differ and why.

A simple decision framework

If you are making a technical analytical adjustment within the approved research question, dataset, outcomes, and permitted data uses
Check whether the approved protocol and institutional procedures already allow that analytical flexibility.
If primary outcomes, hypotheses, research objectives, or substantive analytical purposes will change
Determine whether the revision constitutes a protocol modification requiring prospective ethics review.
If the new analysis requires additional data, record linkage, identifiers, or a new data source
Assess the associated consent, privacy, confidentiality, data-access, and ethics requirements before obtaining or linking those data.
If the analytical decision was made after relevant results were examined
Document it transparently as post hoc or exploratory where appropriate rather than presenting it as prespecified.
If you cannot tell whether the revised analysis remains within the approved research
Ask the responsible ethics office whether an amendment or other determination is required.

If the revised plan genuinely changes the approved study, follow the applicable process for changing approved research. If the modification appears limited, check how the responsible committee handles minor changes to an approved study rather than assuming that analytical changes sit outside ethics oversight.

07 · A Quick Checklist

Before Changing an Approved Data Analysis Plan

Before implementing the revised analysis, check:
What does the approved protocol actually specify about analysis?
Does the change affect only the analytical technique, or does it change an outcome, hypothesis, objective, or research purpose?
Will the revised analysis use only data already collected and permitted for this research purpose?
Does it require new data, record linkage, identifiers, or access to another dataset?
Could the revised analysis affect privacy, confidentiality, or identifiability of individuals or small subgroups?
Does the change materially affect the scientific validity or interpretation of the study?
Was the analytical decision made before or after examining the relevant results, and is that timing documented?
Have you obtained any amendment, notification, or prospective approval required by the responsible ethics committee?
08 · Frequently Asked Questions

Frequently Asked Questions About Analysis-Plan Amendments

Do I need an amendment just to use a different statistical test?

Not necessarily. If the alternative test addresses the same approved question using the same approved data and does not materially change the research, it may fall within ordinary analytical flexibility. Check the specificity of your protocol and your ethics committee's requirements.

Can I add an exploratory analysis after seeing my results?

Potentially, provided the data may legitimately be used for that purpose and applicable ethics requirements are satisfied. Methodologically, the analysis should be identified honestly as exploratory or post hoc when appropriate rather than represented as prespecified.

Does changing the primary outcome require an amendment?

It may, particularly when the primary outcome is specified in the approved protocol. Changing it can materially alter the scientific design and should be assessed under the responsible ethics committee's modification procedures.

Can I link my research data with another dataset for a new analysis?

Do not assume so. Linkage may introduce new data, identifiers, privacy risks, access requirements, or uses not covered by the original consent and approval. Determine what ethics, data-governance, and institutional authorization is required before linking the records.

Does changing a qualitative coding framework require an amendment?

Not automatically. Iterative refinement of codes may be part of the approved qualitative method. A revision that creates a materially new research purpose or requires data outside the approved scope is more likely to raise an amendment question.

What if I discover that my original analysis plan was statistically inappropriate?

Do not preserve an indefensible analysis merely because it appeared in the protocol. Document the methodological problem and proposed correction, then determine whether the change requires ethics or other protocol approval. Transparent correction is preferable to quietly changing the plan or knowingly using an inappropriate analysis.

09 · The Bottom Line

Not Every Analytical Adjustment Changes the Study, but Some Clearly Do

The Bottom Line

A change to the data analysis plan may require an ethics amendment when it materially changes the approved research, its outcomes or objectives, the data being used, participant privacy, or the scientific basis on which the study was approved.

Distinguish a defensible technical adjustment within the approved design from a substantive change in what the study is trying to establish or what participant data will be used. Whatever the ethics pathway, preserve a transparent record of what was planned, what changed, when it changed, and why.

10 · Sources and Further Reading

Authoritative Sources on Protocol Changes and Research Analysis

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes