Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Do You Search for Evidence When Local Research Is Published Mainly as Reports, Theses, or Government Documents?

Local evidence may be distributed across theses, government reports, institutional repositories, technical documents, and other grey literature rather than conventional journals. Finding it requires searching the organizations and systems that produce the evidence, not only bibliographic databases.

230
Searching Local Reports, Theses, and Government Documents Guide 230 of 899
01 · The Question

What if the local evidence you need was never published in a journal?

You search the usual academic databases for research on a local policy, education system, health program, community intervention, or government initiative. Very little appears. Yet you know universities have studied the issue, government agencies have commissioned evaluations, and organizations working in the field have produced reports.

The problem may not be a lack of research. It may be where that research lives.

Some evidence is disseminated through theses, dissertations, government reports, technical documents, monitoring and evaluation reports, conference materials, institutional repositories, and organizational websites rather than conventional scholarly journals. These materials are often described collectively as grey literature, although the category is broad and its boundaries vary.

Searching this evidence requires a different mindset. Instead of asking only “Which database should I search?”, you also need to ask “Who would have produced this research, where would they have deposited it, and how would they have described it?”

02 · The Short Answer

Search the producers and repositories of local evidence, not just journal databases

In Brief

When local research is published mainly as reports, theses, government documents, or other grey literature, search the repositories, agencies, universities, organizations, catalogues, and websites that produce or preserve those materials, using targeted web searching, simplified search strings, citation chasing, and direct organizational searching alongside bibliographic databases.

There is no single grey-literature database that guarantees comprehensive coverage. Choose sources according to the research question, document what and how you searched, and apply explicit eligibility and appraisal criteria to the evidence you find rather than treating grey literature as automatically stronger or weaker than journal articles.

03 · What You Need to Know

Grey-literature searching follows the evidence ecosystem

First understand what counts as grey literature

Cochrane describes grey literature as material produced outside traditional commercial publishing and specifically identifies reports, dissertations, theses, and conference abstracts as relevant examples for evidence searches. Its technical guidance uses the widely cited definition encompassing material produced by government, academia, business, and industry where commercial publishing is not the primary activity of the producing organization.

JBI uses a similarly broad conception and notes that grey literature can include dissertations, theses, webpages, government white papers, reports from think tanks, patents, court filings, ongoing or unpublished trials, conference proceedings, and posters.

For local research questions, this category matters because universities, government departments, research institutes, professional organizations, development agencies, and other institutions may conduct substantial research without publishing every output as a conventional journal article.

Journal literature Research disseminated through conventional scholarly journals and usually searchable through bibliographic databases when those journals are indexed.
Grey literature Research and research-related material disseminated outside traditional commercial or journal publishing channels, often through institutions, governments, repositories, conferences, and organizations.

The boundary is not always perfectly tidy. For searching purposes, the useful question is less “Is this document philosophically grey?” and more “Could relevant evidence exist here that my journal databases will not retrieve?”

Why search grey literature at all?

For comprehensive evidence synthesis, one reason is publication bias. Research appearing in conventional journals may not be representative of all research that has been conducted.

A Cochrane methodology review examining randomized healthcare trials found that published trials tended to show larger treatment effects than trials identified through grey literature. Across three methods studies that could be pooled, published trials showed an approximately 9% greater treatment effect on average. The authors concluded that identifying grey literature could help reduce publication bias in systematic reviews.

That numerical finding concerns healthcare intervention trials and should not be generalized mechanically to education, policy, social science, or every form of local evidence. The broader point is that publication route can be associated with what becomes visible in the conventional literature.

For local questions, another reason may be even more important: grey literature can contain evidence produced specifically for implementation, policy, administration, or institutional decision-making. Cochrane's technical guidance notes that government documents and monitoring and evaluation reports may be particularly useful when the research question concerns implementation or implications for practice.

Do not begin with Google; begin with likely evidence producers

A general web search can be useful, but an unstructured query for a broad topic may produce thousands or millions of results. Search engines rank results according to mechanisms that are not designed to reproduce a systematic evidence search.

Before searching, map the organizations likely to produce, commission, fund, or preserve research on your topic.

Possible evidence producer What you might find Where to look
Universities Theses, dissertations, faculty research, technical reports, conference papers Institutional repositories, graduate-school collections, university libraries, research-office pages
Government ministries and agencies Evaluations, surveys, policy studies, technical reports, statistics, commissioned research Official websites, publication libraries, research divisions, data portals
Local governments Program evaluations, planning studies, needs assessments, local statistics Official government portals, planning offices, legislative or administrative repositories
Research institutes Working papers, policy briefs, technical studies, datasets, commissioned reports Institutional publication pages and repositories
Professional societies Conference proceedings, reports, standards, surveys Society websites, conference archives, publication sections
International and nongovernmental organizations Country reports, evaluations, implementation studies, monitoring reports Organization libraries, project pages, country offices, document repositories

This source map turns a vague web search into a set of plausible evidence locations.

Search theses and dissertations through the systems that preserve them

Theses and dissertations are a recognized category of grey literature. They may contain substantial original research that never becomes a journal article or may contain more methodological and contextual detail than a later publication.

Cochrane recommends selecting dissertation and thesis sources according to the research question and topic area and suggests consulting local libraries or universities about databases relevant to a particular country or region.

Depending on the setting, useful routes can include national thesis catalogues, university institutional repositories, library catalogues, dissertation databases, graduate-school archives, and regional research portals.

Do not assume that one global dissertation database covers every local university. If particular institutions are major producers of research on your topic, inspect their repositories directly.

Government searching works best when you know the administrative landscape

Government evidence is often distributed according to institutional responsibility. A study of teacher deployment may sit with an education ministry. An evaluation of a vaccination program may be published by a health department. Environmental monitoring may be handled by a separate agency, while national statistics may sit with a statistical authority.

Before searching, identify which agencies have jurisdiction over the phenomenon.

Identify the policy area Determine which level and branch of government is responsible for the issue.
Identify likely agencies List ministries, departments, commissions, authorities, councils, and research units that might produce or commission evidence.
Search internally Use each organization's publication, research, reports, data, and document sections where available.
Search externally Use targeted web queries restricted to the organization's domain when its internal search is weak.
Follow references Use relevant reports to identify earlier studies, contractors, research institutions, datasets, and related government documents.

Use targeted web searching rather than one enormous query

Web interfaces rarely support the complex Boolean strategies available in bibliographic databases. Cochrane's technical guidance therefore recommends adapting database terminology for web searching while recognizing that simpler searches may be necessary. This may involve fewer concepts or several smaller searches using different combinations of terms.

Useful targeted patterns can include a topic combined with the organization name, document type, location, or a domain restriction. For example, a search may combine a program name with terms such as evaluation, report, study, thesis, or assessment.

When supported by the search engine, restricting results to an official government or university domain can reduce irrelevant material. Searching for likely document formats can also help, although file type alone should never be treated as an indicator of research quality.

Search using the language of the institution

Government and institutional terminology can differ substantially from academic vocabulary. A program may have an official local name, acronym, administrative classification, or legislative title that rarely appears in international journal articles.

Once you find one relevant document, inspect its terminology carefully. Search program names, agency acronyms, policy titles, geographic units, project names, and local expressions in addition to the conceptual terms used in your academic database strategy.

If important documents are published in another language, the same logic applies to translating selected search concepts into the terminology actually used by local sources.

Use known documents as gateways into document networks

Grey literature often lacks the standardized indexing available in bibliographic databases, but documents still cite one another.

A government report may cite an earlier evaluation. A thesis may cite unpublished institutional research. A technical report may identify the university or consultancy that conducted the original study. A policy document may name the dataset on which its recommendations were based.

Follow those trails backward and forward where possible. Search exact report titles, authors, institutions, project names, contract numbers, report series, and distinctive phrases.

Search the organization, not only the document title

Organizations frequently reorganize websites, change URLs, rename departments, or archive older publications poorly. A dead link does not necessarily mean that a report has disappeared permanently.

Search the document title, responsible organization, named authors, publication year, and distinctive phrases separately. Library catalogues, institutional repositories, citing publications, and archived organizational pages may preserve copies or bibliographic records.

Local evidence may require regional and journal searching too

Grey-literature searching should not become a replacement for bibliographic searching. Local evidence may be split between journal articles and institutional publications.

If international databases provide weak geographic coverage, appropriate regional databases may expose additional local scholarship. Similarly, research appearing in journals outside major international indexes may require direct or alternative discovery methods.

The search should follow the evidence ecosystem rather than forcing every document through one discovery channel.

Grey literature is not automatically low quality

A government report may describe a rigorous national survey. A doctoral dissertation may contain a substantial empirical study. A glossy institutional report may contain weak methods. The publication format alone does not resolve the question.

JBI notes that grey literature spans a very wide range of materials. That diversity is precisely why appraisal must follow the nature of the evidence rather than the label attached to it.

Assess authorship, methods, data sources, sampling, measurement, analysis, transparency, conflicts of interest, and other criteria appropriate to the document and study design.

Grey literature is not automatically unbiased either

A government agency may evaluate its own program. A consultancy report may have been commissioned by an organization with an interest in the findings. A thesis may not have undergone journal peer review. An advocacy organization may select evidence strategically.

These considerations do not make the documents unusable. They tell you what needs scrutiny.

Look for funding, commissioning arrangements, institutional interests, author affiliations, methodological transparency, and whether conclusions extend beyond the reported evidence.

Document your search while you perform it

Grey-literature searches can be difficult to reproduce because websites change, search engines reorder results, internal search tools behave unpredictably, and documents move.

Cochrane's technical guidance specifically recommends careful documentation to make grey-literature searching as reproducible as possible.

Record the organization or repository searched, URL, date searched, search terms or navigation route, any filters used, and how much of the result set you screened. For web search engines, record the exact query and a predefined stopping rule where appropriate, such as the number of result pages screened.

Watch Out

Do not search the web until the results “feel repetitive” and then describe the process as systematic. Grey-literature searching may never be perfectly reproducible, but predefined sources, queries, dates, and stopping rules make the process considerably more transparent.

04 · A Practical Example

How to build a local evidence search beyond journal databases

Hypothetical Example

Evaluating a national teacher-development program

A researcher wants to understand the implementation and outcomes of a government teacher-development program in Country X. Searches of international education databases retrieve only four journal articles.

Map the evidence producers The researcher identifies the education ministry, teacher-training authority, national universities, major education research institutes, and organizations involved in implementing or evaluating the program.
Search university repositories The program's official name, acronym, and related terminology identify several master's theses and doctoral dissertations.
Search government sources The education ministry's publication archive contains implementation reports, while an evaluation report is found through a targeted domain-restricted web search.
Follow citations and organizations One government report names a university research center that conducted an earlier evaluation. Searching that center reveals an additional technical report.
Screen consistently All retrieved documents are assessed against the same substantive eligibility criteria. Some reports provide background only; others contain original empirical evidence and qualify for inclusion.
Appraise rather than assume The included documents are evaluated according to their study designs, methods, data sources, transparency, and relevant institutional interests rather than being accepted or rejected because they are grey literature.

The final evidence base is larger than the four journal articles originally retrieved. More importantly, it contains evidence about implementation that was produced for local decision-making and was never designed primarily for international journal visibility.

05 · What Researchers Often Get Wrong

Common mistakes when searching reports, theses, and government evidence

Misconception

“If it is research, it should appear in an academic database”

Not necessarily. Universities, governments, research institutes, and other organizations produce empirical work outside journal publishing. A database search can therefore miss relevant research even when the work is publicly available elsewhere.

Misconception

“Google is my grey-literature database”

General web search engines can help locate difficult material, but their ranking, coverage, and search functionality differ from bibliographic databases. Use targeted queries and organizational searches, and document what you screened rather than assuming that the first pages represent the evidence base.

Misconception

“Grey literature is not peer reviewed, so I should exclude it”

Peer-review status varies across grey literature, and peer review is not the only relevant quality consideration. Whether a document is eligible should follow the review question and predefined criteria; its methodological credibility should then be appraised directly.

Misconception

“Government reports are authoritative, so I do not need to appraise them”

Institutional authority does not remove methodological limitations or potential conflicts of interest. Examine who commissioned the work, how the evidence was collected and analyzed, and whether the conclusions are supported by the reported methods and data.

Misconception

“A thesis is automatically lower-quality evidence than a journal article”

Publication format does not determine the methodological quality of an individual study. A thesis may contain extensive methods and data, while a journal article may have important limitations. Evaluate the actual research design and execution.

Misconception

“Finding the same study as a thesis and an article gives me two studies”

No. Different reports may describe the same underlying study. Link related publications before synthesis so that the same participants or findings are not inadvertently counted more than once.

06 · What This Means for You

Design the grey-literature search around who produces the evidence

Do not try to search every possible grey-literature source. That would quickly become unmanageable. Identify the sources most likely to contain evidence relevant to your particular question.

A simple decision framework

If the question concerns academic research that may not reach journals
Prioritize thesis and dissertation databases, university repositories, research-office pages, and relevant institutional catalogues.
If the question concerns government policy, implementation, or public programs
Prioritize responsible agencies, government publication repositories, monitoring and evaluation documents, official data portals, and commissioned research.
If international databases retrieve little local evidence
Check whether database coverage is making the local problem appear less studied than it is and add suitable regional and institutional sources.
If organizational websites have poor search functions
Use targeted external web searching with the organization, domain, document type, program name, and key concepts, then record the queries and screening limits used.
If a grey-literature document appears eligible
Apply the same substantive eligibility criteria as elsewhere and appraise its methods using criteria appropriate to the evidence rather than its publication format.

A manageable search is usually better than an unbounded promise to search “all grey literature.” Define the sources most relevant to your question, explain why they were chosen, and make the search transparent enough for readers to understand its scope and limitations.

07 · A Quick Checklist

Before finishing a search for local grey literature

Check whether you have:
Identified which universities, government agencies, research institutes, professional organizations, and other bodies are likely to produce evidence on the topic.
Searched relevant thesis and dissertation databases, university repositories, or library catalogues where appropriate.
Examined official government publication pages, research divisions, document repositories, and data portals relevant to the question.
Used official program names, agency terminology, acronyms, geographic terms, and local-language vocabulary where they could improve retrieval.
Used targeted web searching when organizational search tools were inadequate rather than relying solely on broad general searches.
Checked references, citations, authors, organizations, and related projects from relevant documents for additional evidence.
Checked whether multiple reports describe the same underlying study before treating them as separate evidence.
Applied explicit eligibility and appraisal criteria rather than assuming grey literature is either inferior or authoritative.
Recorded sources, URLs, search dates, queries, navigation routes, and stopping rules sufficiently to describe what was actually searched.
08 · Frequently Asked Questions

Questions about searching local reports, theses, and government documents

What counts as grey literature?

The category commonly includes research and related documents produced outside traditional commercial or journal publishing, such as reports, theses, dissertations, conference materials, government documents, working papers, and various institutional outputs. Exact definitions and boundaries vary.

Should I always search grey literature?

Not every project requires the same search. For comprehensive systematic reviews, relevant grey-literature searching may help identify additional evidence and reduce publication bias. For other reviews, its importance depends on the question and where the relevant evidence is likely to be disseminated.

How do I search government reports systematically?

Identify agencies responsible for the topic, search their publication and research sections, use targeted domain-restricted web queries where necessary, follow references between government documents, and record the sites, dates, terms, and extent of screening. Searching several predefined organizations is generally more transparent than an unrestricted web search.

Where should I search for local theses and dissertations?

Check national thesis services where available, university institutional repositories, graduate-school collections, library catalogues, dissertation databases, and regional research portals. Coverage differs among countries and institutions, so no single source should automatically be assumed to contain all local theses.

Can I use Google or another search engine for a systematic review?

Web search engines can be useful supplementary tools for locating grey literature, particularly organizational and government documents. Because ranking and interfaces can limit reproducibility, predefine and document your queries, dates, domain restrictions, and how far through the results you screened.

Are government reports reliable sources?

They can contain valuable and rigorous evidence, but government authorship does not guarantee methodological quality. Examine the study design, data sources, analysis, reporting, commissioning arrangements, and relevant institutional interests just as you would scrutinize other evidence.

Can I include a thesis if a journal article reports the same study?

Both documents may be useful, particularly if the thesis contains methodological or outcome details omitted from the article, but they should be linked as multiple reports of the same underlying study rather than counted as independent studies.

How do I know when to stop searching grey literature?

Define the important source categories and organizations before searching and use reasonable stopping rules for less structured sources such as web search engines. The goal is a search proportionate to the research question, not an impossible demonstration that every document on the internet has been examined.

09 · The Bottom Line

When evidence lives outside journals, search where the evidence is produced

The Bottom Line

When local research is concentrated in reports, theses, government documents, and other grey literature, build the search around the universities, agencies, repositories, organizations, and publication systems that produce and preserve that evidence rather than relying only on conventional bibliographic databases.

Use targeted and documented searches, follow terminology and citation trails, and evaluate each retrieved document according to its relevance and methods. Grey literature can fill important gaps in local evidence, but finding more documents is only the first task; determining which ones provide credible evidence still requires critical appraisal.

10 · Sources and Further Reading

Sources and further reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes