Can Government Consultation Documents Contain Useful Research Evidence?

Can a policy consultation tell you something the journal literature cannot?

Government consultations are usually created to inform decisions, not to publish academic research. Yet the consultation process can bring together evidence from government agencies, researchers, professional bodies, charities, businesses, advocacy groups, practitioners, and members of the public.

The resulting material may include research summaries, administrative statistics, commissioned analyses, evaluations, technical evidence, references to unpublished reports, and submissions from organizations with substantial subject expertise.

That makes consultation material potentially valuable grey literature. The difficulty is that useful research evidence may sit alongside advocacy, opinion, organizational interests, and responses that were never designed as research studies. You therefore need to evaluate the evidence within the document rather than treating the document itself as a single type of evidence.

Yes, but the evidential value depends on what is actually inside

What kind of evidence can appear in government consultations?

Consultations are part of decision-making rather than academic publishing

Governments and public bodies use consultations to obtain information and views before making certain policy, regulatory, or administrative decisions. Consultation documents may describe a proposed change, explain the evidence or reasoning behind it, and ask stakeholders to provide information relevant to the decision.

Consultation responses can then introduce additional evidence. The UK's Medicines and Healthcare products Regulatory Agency, for example, has explicitly studied how to improve the quality of evidence submitted through government consultations. Its work recognizes that consultation responses can provide evidence useful to those conducting policy evaluations and making decisions.

This purpose distinguishes consultation material from a conventional research article. The consultation process may collect evidence, but it also collects preferences, arguments, experiences, and positions.

Consultation documents can lead you to research that is difficult to find elsewhere

A government consultation may cite commissioned research, departmental evaluations, administrative datasets, technical analyses, regulatory assessments, surveys, or reports produced by external organizations. Some of these sources fall outside conventional scholarly publishing and may not be indexed in Scopus, Web of Science, PubMed, or discipline-specific databases.

This is particularly relevant when your question concerns policy implementation, public services, regulation, professional practice, or other areas where evidence is routinely produced outside universities. Recent methodological research on grey-literature searching found government and organizational websites among the commonly used sources in systematic reviews across areas including public health, education, health services, and social care.

The supporting documents may be more valuable than the consultation itself

Suppose a consultation states that a programme reduced waiting times by 18%. The consultation's statement is useful for discovering the claim, but the underlying evaluation is normally the more informative source. If the consultation links to the evaluation, follow that source and inspect its methods.

The same principle applies when consultation material summarizes a survey, economic analysis, pilot programme, modelling exercise, or administrative dataset. Whenever possible, retrieve the original evidence rather than relying solely on the consultation's summary of it.

This is similar to following citations in a journal article. The document that alerts you to evidence is not necessarily the document you should ultimately use to evaluate that evidence.

Responses from organizations can contain otherwise hard-to-find evidence

Professional associations, charities, industry organizations, universities, local authorities, and other respondents may submit analyses or data drawn from their own work. These submissions can sometimes identify research conducted by organizations that rarely publish in academic journals.

Such evidence can be especially informative when the research question concerns implementation or operational conditions. An organization may possess administrative records or evaluation findings unavailable in academic databases.

That does not make organizational evidence intrinsically superior or inferior to academic evidence. Its evidential value depends on how the information was generated and whether the underlying methods can be evaluated.

Consultation responses can also contain advocacy and selective evidence

Respondents participate because they have something to say about the proposed policy. Some may be directly affected by the outcome. A submission may therefore select evidence strategically, emphasize particular outcomes, or combine empirical claims with normative arguments.

The same caution applies to claims presented by stakeholders. Ask where the data came from, who collected them, how participants or cases were selected, what was measured, whether alternative explanations were considered, and whether enough methodological information is available to judge credibility.

A government-hosted document is not automatically government-endorsed evidence

A consultation webpage may publish responses submitted by external stakeholders. Hosting a submission does not necessarily mean that the government accepts every factual claim within it.

Keep provenance clear. Distinguish between evidence generated by the government, commissioned by it, cited by it, and merely submitted to it by another party. Those distinctions can matter when evaluating authority and potential conflicts of interest.

Consultation outcomes can reveal how evidence influenced policy

Some consultation processes culminate in government responses or decision documents explaining what was heard and how the proposal changed. These can be useful when your research question concerns policy development rather than merely the effectiveness of an intervention.

For example, a consultation outcome may document competing stakeholder interpretations, implementation concerns, or evidence gaps that shaped a final policy. In policy research, that process can itself be analytically relevant.

Still, a government summary of consultation responses should not automatically be treated as a complete qualitative dataset. The way submissions were coded, summarized, weighted, or selected needs to be understood if you intend to draw research conclusions from the summary.

Search consultation material when your question makes it plausible that evidence lives there

Consultation searching is unlikely to be equally useful across all research questions. It becomes more promising when the subject has been the focus of recent legislation, regulation, standards development, public-service reform, or formal policy review.

It may also be valuable when academic literature appears disconnected from current implementation or when relevant government departments and regulatory bodies are known to commission research.

For a systematic review, however, consultation websites should be searched according to a defensible plan rather than opportunistically collecting documents that happen to support the emerging argument. Grey-literature searching is already difficult to reproduce, and methodological research has highlighted substantial variation in how such searches are conducted and reported.

How a consultation can uncover research missing from your database search

Common mistakes when using consultation material

Treat consultation documents as evidence sources and discovery pathways

Government consultations are most useful when your research question intersects with policy, regulation, implementation, or public services. In those settings, restricting your search to journals can exclude evidence produced specifically for decision-makers.

The key is to avoid source-category thinking. “Government consultation” tells you where a document came from and why it was created. It does not tell you whether the material inside constitutes strong empirical evidence. That requires the same critical attention you would give to any non-peer-reviewed report.

Before using evidence from a government consultation

Questions about government consultations as research sources

Use consultation documents critically, not categorically

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.