How Do You Judge Whether the Participants Were Appropriate for a Qualitative Question?

Were these actually the right people to answer the qualitative question?

A qualitative paper may contain detailed interviews and sophisticated analysis, yet still rest on a weak foundation if the people providing the data were poorly matched to the research question.

The difficulty is that appropriateness cannot usually be judged by asking whether participants statistically represent a population. Many qualitative studies deliberately select participants because they have particular experiences, roles, characteristics, or knowledge. The more useful question is whether the people selected were capable of illuminating the phenomenon the researchers claimed to investigate.

That requires looking beyond the sample size and examining the logic connecting the research question, eligibility criteria, sampling strategy, recruitment, participant characteristics, and eventual claims.

Participant appropriateness depends on relevance to the question

Follow the logic from the question to the people selected

Purposeful sampling is widely used in qualitative research to identify information-rich cases related to the phenomenon under investigation. Palinkas and colleagues describe purposeful sampling in precisely these terms, while also showing that multiple purposeful sampling strategies exist and may serve different research purposes.

This gives you a useful starting principle: do not ask whether the participants look like the population first. Ask why these particular participants could illuminate this particular question.

Identify what experience or knowledge the question requires

Begin with the wording and purpose of the research question. What would someone need to have experienced, observed, known, or participated in to provide meaningful evidence?

Suppose researchers ask how doctoral candidates experience receiving detailed feedback after a dissertation proposal defense. Participants who have actually completed such a defense can potentially speak from experience. First-year doctoral students who have never defended a proposal cannot provide the same kind of experiential evidence, even if they have opinions about dissertation feedback.

This distinction sounds obvious when stated plainly. It can become less obvious in published studies where broad inclusion criteria are hidden beneath phrases such as "participants were recruited from the university community."

The sampling strategy should have a reason

Qualitative sampling is not one technique. Researchers may use criterion, maximum-variation, homogeneous, snowball, convenience, theoretical, or other sampling approaches depending on the methodology and purpose of the study.

The label itself matters less than the rationale. A study using criterion sampling should have defensible criteria. Maximum-variation sampling should capture dimensions of variation that matter to the question. Snowball sampling may be useful for populations that are difficult to identify or reach, but the referral process may also shape who enters the sample.

Convenience sampling deserves particular attention. Accessibility can be a legitimate practical consideration, and convenience does not automatically invalidate a study. The problem arises when convenience becomes the effective rationale for participant selection even though the research question requires experiences or perspectives that the accessible group cannot adequately provide.

Eligibility criteria should correspond to the phenomenon

Look carefully at inclusion and exclusion criteria. They tell you how the researchers operationalized the idea of an appropriate participant.

If the study examines nurses' experiences of implementing a newly introduced electronic medication system, how much experience with that system was required? Could someone who used it once participate? Did participants work during the implementation period? Were both frontline users and supervisors included, and if so, was that intentional?

There is no universally correct eligibility rule. The criteria should make conceptual sense for the phenomenon and the intended claims.

Participant characteristics matter when they affect the phenomenon

Demographic characteristics are not automatically important simply because they can be reported. Their relevance depends on the question.

Age may be central to one inquiry and largely peripheral to another. Professional role, institutional position, years of experience, location, socioeconomic circumstances, language, or exposure to a particular event may matter far more.

Good appraisal therefore asks whether the paper reports the characteristics necessary to understand participants' relationship to the phenomenon. COREQ, a reporting guideline for interview and focus-group studies, includes sampling, sample size, non-participation, and relevant sample characteristics among its reporting items. Transparent reporting makes it easier to judge whether the selected participants actually fit the inquiry.

Think about whose perspective is missing

Appropriateness also concerns the boundaries created by sampling. Every sample includes some perspectives and excludes others.

Suppose a study asks how a university's new learning management system affected teaching but interviews only faculty members who voluntarily attended advanced training workshops. Those participants may provide rich evidence about their own experiences. They may be much less informative about instructors who avoided the system, struggled to adopt it, or never attended training.

The sample is not necessarily wrong. The problem appears if the paper silently turns findings about highly engaged users into claims about faculty generally.

Homogeneity and diversity should serve the question

A narrowly defined participant group can be a strength when the researchers want intensive understanding of a particular experience. Conversely, variation can be valuable when the question asks how experiences differ across roles, contexts, or circumstances.

Neither diversity nor homogeneity is intrinsically superior.

Appropriate participants and an adequate sample are different questions

Do not collapse participant appropriateness into sample size.

A study could recruit 40 people who are only weakly connected to the phenomenon and still have an inappropriate sample. Another could recruit 12 highly relevant participants and obtain substantial information about a focused question. Whether those 12 participants are enough is a separate methodological judgment.

First ask whether the researchers selected the right kinds of participants. Then ask whether the resulting qualitative sample was adequate for the scope and analytic purpose of the study.

Recruitment can shape the evidence even when eligibility is appropriate

Who was eligible is only part of the story. Who actually agreed to participate may matter too.

Self-selection can produce systematic differences between participants and eligible nonparticipants. Recruitment through managers may influence who volunteers or what participants feel comfortable saying. Recruiting through advocacy groups may provide excellent access to people with relevant experience while disproportionately reaching those who are particularly engaged with an issue.

These possibilities do not automatically disqualify a study. They help define what the evidence can reasonably support.

The final claims must remain aligned with the sampled participants

This is one of the most consequential checks.

Researchers may begin with a defensible sample and then make claims broader than that sample warrants. Interviews with students from one specialized program become conclusions about "university students." Interviews with early adopters become statements about "teachers." Experiences of people who remained in a program are presented as though they explain those who dropped out.

A strong qualitative paper keeps the identity and context of its participants visible when interpreting the findings. This helps readers judge whether findings might transfer to another context without pretending that sampling itself establishes universal applicability.

The same number of interviews can answer very different questions

Notice what this judgment does not establish. It does not tell you whether 20 participants were sufficient, whether the interviews were deep enough, or whether the subsequent analysis was rigorous. Those require separate appraisal. Participant appropriateness answers a narrower but foundational question: did the researchers obtain their evidence from people positioned to provide the kind of evidence they needed?

Common mistakes when judging qualitative participants

Judge participant selection by reconstructing the sampling argument

When reading a qualitative paper, try to reconstruct the researchers' sampling logic in one sentence: "We needed to understand X, so we selected people with Y experience or position because they could tell us Z."

If you can complete that sentence from the paper and the reasoning makes methodological sense, participant selection has at least been made transparent. If you cannot tell why these people were recruited beyond their availability, examine the study more cautiously.

Participant appropriateness is one part of deciding how convincing a qualitative study is overall. A well-chosen sample cannot rescue superficial data collection or weak analysis. But if the wrong people supplied the evidence, sophisticated analysis later in the research process cannot fully repair the mismatch.

Check whether the participants fit the qualitative question

Questions about selecting participants in qualitative research

The right participants are the people who can illuminate the question

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.