Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Search the Field Guide

What are you trying to figure out?

Search across guide titles, topics, keywords, and content throughout the Researcher's Field Guide.

Search Results

Results for “research design”

Showing 1,976–2,000 of 2,171 results

2,171 guides
Supplement D · Guide 861

Can Synthetic Data Replace Real Participant Data in Research?

Artificial Intelligence in Research

Synthetic data can replace real participant records for certain methodological tasks, but they generally cannot substitute for genuine human participation when a study aims to understand actual experiences, attitudes, or behaviors. Learn where synthetic data are useful, what claims they can support, and why empirical validation remains important.

Read Guide →
Supplement D · Guide 862

Can Synthetic Data Be Used to Test Research Analysis Code?

Artificial Intelligence in Research

Synthetic data can help researchers test analytical code before working with genuine research observations. By generating artificial datasets with known characteristics and expected results, researchers can identify programming errors, verify data transformations, and improve reproducibility. Learn how to design meaningful tests and recognize what synthetic data cannot establish.

Read Guide →
Supplement D · Guide 863

Can Synthetic Data Be Used to Develop Prediction Models?

Artificial Intelligence in Research

Synthetic data can support prediction-model development by providing artificial training examples, testing analytical pipelines, and representing selected scenarios. However, models trained on generated data may learn artificial patterns that do not generalize to real populations. Learn when synthetic data are useful, how to evaluate their contribution, and why independent empirical validation remains essential.

Read Guide →
Supplement D · Guide 868

How Should the Use of Synthetic Data Be Reported in a Research Paper?

Artificial Intelligence in Research

Synthetic data must be reported transparently so readers can distinguish artificially generated observations from genuine empirical evidence. Researchers should explain why synthetic data were used, how they were generated, which validation procedures were performed, and what conclusions the data can support. Learn how to document synthetic-data methods without overstating their scientific significance.

Read Guide →
Supplement D · Guide 869

Can Generative AI Simulate Human Research Participants?

Artificial Intelligence in Research

Generative AI can simulate responses from hypothetical research participants, including survey answers, interview narratives, and behavioral decisions. However, these outputs reflect model behavior rather than genuine human participation. Learn when AI-simulated participants can support methodological research, how their responses should be evaluated, and why realistic language does not establish empirical validity.

Read Guide →
Supplement D · Guide 870

Can AI-Generated “Participants” Replace Real Participants in Behavioral Research?

Artificial Intelligence in Research

AI-generated participants can simulate selected human responses and support methodological experiments, but they cannot automatically replace real participants in behavioral research. Their outputs may reproduce some empirical patterns while failing to capture human experiences, contextual influences, and population diversity. Learn when simulated participants are useful and what evidence is required before drawing conclusions about actual people.

Read Guide →
Supplement D · Guide 871

Can Generative AI Predict How a Human Population Would Respond to a Survey?

Artificial Intelligence in Research

Generative AI can produce survey responses that resemble selected patterns observed in human populations, but predicting actual population attitudes requires empirical validation. Learn how AI-based survey simulations work, why demographic prompting does not guarantee representativeness, and how researchers should evaluate prediction accuracy, bias, and generalizability.

Read Guide →
Supplement D · Guide 872

Can Large Language Model Responses Be Treated as Human Survey Data?

Artificial Intelligence in Research

Large language models can generate plausible questionnaire responses, but these outputs are not equivalent to observations collected from human participants. Researchers must distinguish model-generated answers from empirical survey data, particularly when reporting sample sizes, estimating population characteristics, or interpreting statistical significance. Learn when LLM responses can be used legitimately and which scientific claims require genuine human evidence.

Read Guide →
Supplement D · Guide 877

What Scientific Claims Can Researchers Make From AI-Simulated Participants?

Artificial Intelligence in Research

AI-simulated participants can support scientific claims about model behavior, simulation performance, and certain methodological procedures. However, their responses do not independently establish what real people believe, experience, or do. Learn how researchers can frame defensible findings, distinguish computational observations from human evidence, and avoid unsupported population-level conclusions.

Read Guide →
Supplement D · Guide 878

What Scientific Claims Cannot Be Made From AI-Simulated Participants?

Artificial Intelligence in Research

AI-simulated participants can provide useful evidence about model behavior and methodological procedures, but they cannot independently establish what real people experience, believe, or do. Learn which scientific claims exceed the evidentiary limits of simulated responses, why statistical significance does not resolve these limitations, and how researchers can avoid unsupported conclusions.

Read Guide →
Supplement D · Guide 879

How Do Researchers Prevent AI-Simulated Participants From Being Mistaken for Empirical Evidence?

Artificial Intelligence in Research

AI-simulated participants can produce convincing survey responses and interview narratives, creating a risk that artificial observations will be mistaken for genuine human evidence. Researchers can reduce this risk through clear labeling, reliable provenance records, separation of datasets, transparent reporting, and appropriate analytical safeguards. Learn how to preserve the distinction throughout the research lifecycle.

Read Guide →
Supplement D · Guide 881

What Changes Methodologically When AI Itself Is the Object of a Research Study?

Artificial Intelligence in Research

When artificial intelligence itself becomes the object of a research study, researchers must treat model behavior as the phenomenon being investigated. This changes how observations are collected, experimental conditions are controlled, responses are evaluated, and findings are generalized. Learn why model versions, prompts, conversation history, repeated testing, and system updates become important methodological considerations.

Read Guide →
Supplement D · Guide 882

How Do Researchers Study a Commercial AI Model That Can Change Without Notice?

Artificial Intelligence in Research

Commercial AI models may change through updates to their underlying models, system instructions, safety mechanisms, or supporting infrastructure, sometimes without detailed public notice. These changes complicate reproducibility and longitudinal research. Learn how researchers can document testing conditions, detect behavioral changes, and produce scientifically defensible findings even when the AI system cannot be frozen or fully inspected.

Read Guide →
Supplement D · Guide 883

Should Researchers Record the Exact AI Model Version Being Studied?

Artificial Intelligence in Research

Recording the exact AI model version helps researchers establish which system produced the observations in a study. However, commercial AI services do not always expose immutable model identifiers, and a model name may refer to a changing deployment. Learn what version information should be preserved, why model identity matters for reproducibility, and how to report uncertainty when the exact model state is unavailable.

Read Guide →
Supplement D · Guide 884

Should Researchers Record the Date and Time When an AI Model Was Tested?

Artificial Intelligence in Research

Recording when an AI model was tested helps researchers establish the temporal context of their findings, especially when commercial systems may change without notice. Learn when testing dates are sufficient, when individual response timestamps are necessary, and how time zones, model updates, and longitudinal designs affect the reproducibility and interpretation of AI research.

Read Guide →
Supplement D · Guide 885

Should Researchers Preserve Every Prompt Used to Study an AI Model?

Artificial Intelligence in Research

Prompts are often central methodological materials when researchers study generative AI systems. Preserving only successful prompts may conceal selection bias, while incomplete conversation records can make evaluations difficult to reproduce. Learn which prompts should be archived, how to document exploratory and formal testing, and when confidentiality or practical constraints justify restricted preservation.

Read Guide →
Supplement D · Guide 889

How Do Researchers Compare AI Models Fairly?

Artificial Intelligence in Research

A fair AI model comparison requires more than submitting the same questions to different systems. Learn how to establish comparable testing conditions, select appropriate performance measures, account for response variability, and avoid misleading conclusions about which model performs better.

Read Guide →