Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Should the Literature Change the Population You Plan to Study?

The population you originally planned to study may not be the population the literature shows you need. Learn how existing evidence should influence whom you include, exclude, narrow, or deliberately add.

867
Letting the Literature Refine Your Study Population Guide 867 of 899
01 · The Question

Are You Planning to Study the Population That Can Actually Answer the Research Question?

You may begin a project already knowing whom you want to study: university students, nurses, teachers, adolescents, older adults, employees, patients with a particular condition, or perhaps whoever is realistically accessible to you.

Then the literature complicates that choice.

You discover that previous studies concentrated heavily on one group. Findings differ by age or experience. A population routinely excluded from earlier research is directly affected by the problem. Evidence from one setting may not reasonably transfer to another. Or you learn that the population you planned to recruit is convenient but poorly aligned with the phenomenon you actually want to understand.

At that point, population selection is no longer merely a recruitment decision. The literature is telling you something about who needs to be studied for your research question to produce meaningful evidence.

02 · The Short Answer

Your Population Should Follow the Scientific Question, Not Just Access

In Brief

The literature should change your planned population when existing evidence shows that another group is more relevant to the research question, important groups have been systematically excluded or understudied, findings may not reasonably apply across populations, or your original population is broader or narrower than the problem requires.

The goal is not maximum demographic variety in every study. Population boundaries should have a scientific, ethical, theoretical, or consequential practical rationale. Sometimes the literature justifies broader inclusion; sometimes it supports deliberate restriction. Either way, the choice should be defensible rather than merely convenient.

03 · What You Need to Know

What the Literature Can Tell You About Whom to Study

Start With the Population Your Question Is About

A useful distinction is the one between the population about which you ultimately want to make an inference and the participants you can realistically recruit.

Suppose your research question concerns burnout among hospital nurses, but the easiest participants available to you are nurses enrolled in a graduate program at one university. Those nurses may provide useful evidence, but accessibility does not automatically make them an adequate representation of the population your question implies.

The literature helps you identify which population characteristics may matter. Previous research might indicate that burnout differs according to clinical area, employment status, shift pattern, career stage, organizational conditions, or other factors relevant to the phenomenon. That does not mean every factor must appear in your eligibility criteria. It means you should understand which restrictions change the population to which your findings can reasonably speak.

Target population The broader population about which the research question is intended to produce knowledge.
Study population The population defined by the study's actual eligibility, setting, recruitment, and sampling decisions.

The Literature May Show That Your Population Is Too Broad

A broad label can conceal substantively different groups.

“Teachers,” for example, may include early-childhood educators, elementary teachers, secondary teachers, vocational instructors, and university faculty working under very different professional conditions. “Older adults” can cover decades of life during which health, cognition, employment, caregiving, and technology use may differ considerably. Even apparently precise clinical populations can contain important variation in severity, treatment history, comorbidity, or disease subtype.

If the literature indicates that the phenomenon operates differently across these groups, combining them indiscriminately may produce an average that answers no particularly useful question.

Narrowing is therefore justified when a characteristic defines the phenomenon you intend to understand, marks an important boundary in existing evidence, or is necessary for a coherent test of the research question. Narrowing merely because a smaller group is easier to recruit is a different rationale and should not be disguised as a scientific one.

The Literature May Show That Your Population Is Too Narrow

Researchers can also inherit unnecessarily restrictive populations from previous studies.

Perhaps most studies included only younger adults even though the condition affects older people. Perhaps research on an educational intervention repeatedly sampled high-achieving students even though the intervention is intended for all learners. Perhaps clinical evidence excludes people with common comorbidities, leaving uncertainty about how well findings apply to the patients who would actually receive an intervention.

In clinical research, this concern is explicit in current policy. NIH's Inclusion Across the Lifespan policy requires inclusion of individuals of all ages in NIH-supported human-subjects research unless exclusion has a scientific or ethical justification, with the aim of generating knowledge applicable to populations affected by the condition under study. FDA guidance similarly encourages clinical-trial eligibility and enrollment practices that can produce study populations more representative of people likely to use the medical product.

Those are specific policies for particular research contexts, not universal rules for all disciplines. The broader lesson is still useful: exclusions should earn their place.

Underrepresentation Matters When It Creates an Important Evidence Problem

Discovering that a group is underrepresented in previous studies deserves attention, but the appropriate response requires thought.

Sometimes the rationale is inferential. Existing evidence may not establish whether findings apply to a population with meaningfully different characteristics. Sometimes it is practical: a group substantially affected by a policy, intervention, technology, or condition lacks evidence needed for decisions concerning them. Ethical considerations may also matter, particularly when groups bear the consequences of research-informed decisions while rarely being represented in the evidence used to make those decisions.

But “understudied” should not become another mechanical gap statement. Ask what uncertainty the missing population creates and what studying that population would allow you to learn.

Watch Out

Do not assume that findings must differ between groups simply because demographic characteristics differ. If you expect population characteristics to alter a relationship, outcome, mechanism, or interpretation, identify the evidence or reasoning behind that expectation. Otherwise, describe the missing evidence as uncertainty rather than asserting a difference before studying it.

A Different Population Does Not Automatically Create a New Study

“This relationship has been studied among university students, but not among senior high school students” identifies a population difference. It does not yet establish why the new study is necessary.

The change becomes more meaningful when developmental stage, institutional environment, curriculum, autonomy, technology access, social conditions, exposure, or another relevant characteristic could affect the phenomenon. The literature may provide theoretical or empirical grounds for expecting that difference to matter.

This is closely connected to the contribution you expect the study to make. If changing the population merely changes the address or age label without changing what can be learned, the resulting contribution may be limited.

Population Differences Can Limit Generalization Without Making Earlier Research Wrong

A study conducted in one population can be internally informative while having limited applicability elsewhere. These are separate issues.

Suppose an intervention has been tested rigorously among adults aged 18 to 40. The results do not become invalid because older adults were absent. Rather, the evidence may be insufficient to establish what happens among older adults, particularly if age could influence treatment response, risk, implementation, or another relevant feature.

The same reasoning applies outside health research. Findings from large urban universities may not automatically describe small rural institutions. Research involving experienced professionals may not characterize novices. Evidence from high-resource settings may not transfer straightforwardly to settings where implementation conditions differ.

Do not claim non-generalizability merely because populations are not identical. Identify which differences could plausibly matter and calibrate your inference accordingly.

Sometimes the Literature Justifies Restricting the Population

Broad inclusion is not always methodologically preferable.

If your question specifically concerns first-time mothers, novice teachers, adolescents with a defined condition, or employees during their first year of employment, restricting eligibility is integral to the question. A narrowly defined population can also reduce irrelevant heterogeneity when a study is intended to examine a process under specific conditions.

Inclusion policies themselves recognize this logic. NIH permits age-based exclusions when scientifically or ethically justified and requires the selected age range to be justified in relation to the scientific question.

The principle is not “include everyone.” It is “include and exclude deliberately.”

The Population You Need and the Population You Can Recruit May Not Match

The literature may reveal an ideal population that your resources cannot realistically reach.

You may lack access to multiple institutions, specialized clinical groups, geographically dispersed participants, or a sufficiently large subgroup for the analysis you hoped to conduct. This creates a design constraint, not permission to pretend that the accessible population answers the broader question equally well.

You may need to narrow the research question, redesign recruitment, collaborate with additional sites, reconsider the intended inference, or acknowledge the resulting limitation. What you should not do is quietly allow convenience to redefine the target population after the fact.

04 · A Practical Example

When the Literature Shows That the Convenient Population Is Not Enough

Hypothetical Example

Studying Faculty Adoption of a New Educational Technology

Imagine that you plan to investigate factors associated with adoption of an AI-supported teaching platform. Because you work at a university, you initially intend to recruit full-time faculty from your own institution.

During the literature review, you notice that most existing studies already concentrate on full-time university faculty. Much less is known about part-time instructors, even though the literature suggests they may differ in institutional access, professional development opportunities, technical support, workload arrangements, and decision-making autonomy.

Original population Full-time faculty at one university.
What the literature reveals The population already dominates existing evidence, while employment conditions appear relevant to several proposed determinants of technology adoption.
The population question changes Would another study restricted to full-time faculty answer the most important remaining uncertainty, or should employment status be represented deliberately?
Revised population Faculty with differing employment arrangements are included using a recruitment strategy capable of representing the groups needed for the intended comparison.

The literature has not proven that part-time instructors will adopt the technology differently. Instead, it has revealed a defensible reason why excluding them would leave an important question unresolved.

If adequate recruitment of the relevant groups is impossible, the appropriate response may be to narrow the research question rather than claim that a convenience sample represents faculty generally.

05 · What Researchers Often Get Wrong

Common Mistakes When Choosing a Study Population From the Literature

Misconception

An Understudied Population Automatically Makes a Strong Study

Underrepresentation can create an important evidence problem, but you still need to explain what uncertainty follows from it. The scientific case is stronger when the population matters to the phenomenon, inference, application, or decisions the research is intended to inform.

Misconception

A More Diverse Sample Is Always Methodologically Better

Diversity can improve applicability and permit important comparisons, but broader inclusion is not automatically appropriate for every research question. A narrowly defined population may be necessary when the phenomenon or intended inference is population-specific. Inclusion should follow the scientific purpose rather than become a numerical goal detached from the question.

Misconception

If Previous Studies Used This Population, You Should Use It Too

Repeated practice is not necessarily methodological justification. Earlier studies may have selected participants for convenience, inherited restrictive eligibility criteria, or focused deliberately on a particular group. Determine why the population was chosen and whether that rationale applies to your question.

Misconception

Studying the Same Phenomenon in Another Country Automatically Tests Generalizability

A new country can provide a meaningful test when relevant contextual characteristics differ. Merely moving the study geographically does not establish which feature of the context could alter the phenomenon. Specify what aspect of the population or setting makes the transfer of existing evidence uncertain.

Misconception

Your Accessible Participants Define Your Target Population

Access determines whom you can recruit, not automatically whom your research question concerns. If the accessible sample covers only part of the population of interest, either align the question with that narrower population or make the limitation on inference explicit.

06 · What This Means for You

Recheck Every Important Population Boundary Before Recruitment

Return to your inclusion and exclusion criteria after the literature review. For each consequential boundary, ask why it exists.

A simple decision framework

If previous research concentrates heavily on one population while another relevant group remains poorly represented
Determine what uncertainty the missing group creates and whether your study is positioned to address it.
If evidence suggests the phenomenon differs meaningfully across population characteristics
Consider whether those groups should be represented, distinguished, or studied separately.
If your planned population includes groups for whom the research question has substantially different meanings
Consider narrowing the population or designing the study to account for those differences.
If an exclusion exists mainly because recruitment would be easier
Treat convenience as a constraint and ask whether it changes the question or limits the inference.
If you propose a new population primarily because it has not been studied
Specify what studying that population can teach you that existing evidence cannot.

Population decisions may also expose weaknesses in the studies you are using as precedents. If the literature repeatedly excludes the people most affected by the phenomenon or uses samples poorly aligned with the claims being made, that may be one of the weaknesses your own study should deliberately avoid.

Finally, population and outcome decisions interact. Once you change whom you study, revisit what outcomes are appropriate to examine. An outcome meaningful, valid, or feasible in one population may not function identically in another.

07 · A Quick Checklist

Does Your Planned Population Still Make Sense?

Before finalizing eligibility and recruitment, check:
Can I state clearly the population to which my research question refers?
Does my planned study population correspond closely enough to that population for the inference I intend to make?
Have previous studies identified population characteristics that may affect the phenomenon or applicability of findings?
Are important groups consistently missing from the evidence, and can I explain why that absence matters?
Can I justify each major inclusion or exclusion criterion scientifically, ethically, theoretically, or practically?
Am I treating convenience as a recruitment constraint rather than pretending it is a scientific rationale?
If I expect differences between population groups, is that expectation grounded in evidence or defensible reasoning rather than assumption?
Will my eventual claims stay within the population that my design can reasonably support?
08 · Frequently Asked Questions

Questions About Choosing a Study Population From the Literature

What if most previous studies used the same type of participants?

Determine whether that concentration is scientifically justified or simply conventional. If important affected populations are missing, ask what uncertainty their absence creates. Your study does not automatically need a different population, but the pattern should inform the decision.

Should I always study an underrepresented population?

No single study can represent every population. Prioritize populations relevant to the research question and to the knowledge or decisions the study is intended to inform. When underrepresentation creates an important evidential, ethical, or practical problem, deliberate inclusion may be especially consequential.

Can convenience sampling still be acceptable?

It can be appropriate for some research purposes, but convenience affects what can reasonably be inferred from the resulting sample. Be explicit about the sampling strategy, consider relevant selection processes, and avoid describing the accessible sample as representative without evidence supporting that claim.

Does a different population make my study original?

It makes the population different. Whether that difference constitutes a meaningful contribution depends on what studying the new population allows you to learn. Explain why existing evidence may not answer the question adequately for that group.

Should I broaden my population to improve generalizability?

Not automatically. Broader inclusion may increase the range of people represented, but it can also introduce heterogeneity that the study is not designed or powered to examine. Align the population with the inference you need and the design you can support.

Can the literature justify excluding a group?

Yes. Exclusion may be scientifically or ethically justified when the research question does not apply to a group, participation would be inappropriate, or a deliberately bounded population is necessary for the intended inference. Requirements differ across research contexts, so applicable ethics, funder, institutional, and regulatory policies should also be checked.

What if I cannot recruit the population the literature suggests I need?

Consider changing recruitment, collaborating with additional sites, narrowing the research question, or explicitly limiting the intended inference. Recruitment difficulty is a real design constraint, but it does not make a different accessible population scientifically equivalent.

09 · The Bottom Line

Study the Population Your Question Requires, Not Merely the One Within Reach

The Bottom Line

The literature should change your planned population when it reveals that your original participants do not adequately represent the people needed to answer the question, that consequential groups are missing from existing evidence, or that population differences alter what can reasonably be inferred.

Broader is not automatically better, and narrower is not automatically more rigorous. Use the literature to justify who needs to be included, who may reasonably be excluded, and how far the resulting evidence can travel beyond the people actually studied.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes