Simulating Human Participants with Large Language Models: Principles, Limitations, and Recommendations

Xie Tian, Qiu Lin

Journal of Psychological Science ›› 2026, Vol. 49 ›› Issue (4) : 770-782.

PDF(704 KB)
PDF(704 KB)
Journal of Psychological Science ›› 2026, Vol. 49 ›› Issue (4) : 770-782. DOI: 10.16719/j.cnki.1671-6981.20260401

Simulating Human Participants with Large Language Models: Principles, Limitations, and Recommendations

Author information +
History +

Abstract

The rapid advancement of Large Language Models (LLMs) is catalyzing a profound transformation in psychological research. This review advances a dual-view framework for critically assessing LLMs: as powerful simulators of human participants and as novel non-human agents for scientific inquiry. As simulators, LLMs demonstrate considerable potential in replicating human responses. Empirical studies have shown that models can mimic human cognitive biases in decision-making tasks, achieve performance on the Theory of Mind (ToM) tasks comparable to that of young children, and successfully replicate a significant portion of main and interaction effects from classic psychology experiments. However, this paper moves beyond cataloging these successes to deconstruct the simulator concept itself, revealing two fundamental, principle-level limitations. First, the model's core compression principle, while effective at capturing group averages, inherently struggles to replicate the internal structural associations of individual differences. Second, a profound asymmetry exists between the model's training phase (knowledge acquisition) and its alignment phase (strategic expression), which fundamentally determines that any simulation is a strategically optimized expression rather than a faithful representation of the model's internal knowledge state. Consequently, their inherent limitations and systematic biases - such as reflecting a predominantly Western, Educated, Industrialized, Rich, and Democratic (WEIRD) perspective - are not merely data-level flaws, but deep-seated mechanistic properties. This transforms them into valuable data for investigating the mechanisms of non-human intelligence. This critical perspective aligns with recent scholarly calls to systematically analyze the theoretical fallacies, such as anthropomorphism and identity essentialization, that arise from uncritically substituting LLMs for human participants.

Within this theoretical framework, the paper systematically organizes the current methodologies into two primary technical paths, distinguished by their depth of intervention. The first is the path of prompt engineering, which guides the model's output without altering its internal parameters. This path encompasses techniques for individual-agent simulation, where methods like simple prompts are used to assign specific personas to the model, as well as techniques for group-level simulation, where in-context learning allows the model to predict aggregate public opinion by generalizing from a few examples. The second, more intensive path is that of model fine-tuning, which directly modifies the model's parameters by retraining it on large-scale, individual-level datasets to enhance its predictive accuracy for specific populations. To rigorously assess the outputs from these methods, the review scrutinizes two key evaluation frameworks. The first, algorithmic fidelity, evaluates the degree to which an LLM can mirror the complex relationships between thoughts, attitudes, and socio-cultural backgrounds within specific human subpopulations. The second, the Turing Experiment, assesses an LLM's ability to replicate the behavioral outcomes of human subjects in classic social science experiments, focusing on functional equivalence in contexts like the Ultimatum Game or Milgram's obedience studies, while also critiquing the fallacy of “perfect alignment” as a goal.

Finally, this review provides crucial suggestions for leveraging LLMs in psychological research. It strongly emphasizes that LLMs cannot replace human participants due to fundamental limitations, such as the lack of embodied cognition, subjective experience, and genuine understanding. This is particularly evident in their inability to natively generate non-textual data crucial for many fields, such as reaction times in cognitive psychology or physiological indicators in neuroscience. Instead, the paper argues that future research should proceed along dual paths: (1) Deepening the role of LLMs as a tool and (2) Pioneering the study of LLMs as a subject. As a tool, LLMs can serve as invaluable simulators for hypothesis generation, pre-testing study materials, and conducting exploratory research on sensitive topics where human participation poses ethical risks. As a subject, researchers can investigate the LLM itself as a novel agent. For instance, they can systematical map the ideological spectrums of different models, analyze their "hallucinations" as a form of computational creativity, or design "implicit association tests" to uncover their deep-seated biases. This dual-path approach ensures that this powerful technology is leveraged rigorously and responsibly for knowledge discovery. Ultimately, it highlights the irreplaceable value of human researchers in proposing profound questions, interpreting complexity, and defending scientific integrity.

Key words

large language models (LLMs) / simulation / human participants / non-human agents / research automation

Cite this article

Download Citations
Xie Tian , Qiu Lin. Simulating Human Participants with Large Language Models: Principles, Limitations, and Recommendations[J]. Journal of Psychological Science. 2026, 49(4): 770-782 https://doi.org/10.16719/j.cnki.1671-6981.20260401

References

[1]
谢天, 邱林, 李雨曈, 罗殷, 刘盼. (2023). 大模型时代的社会科学, 何去何从?图书情报知识, 40(6), 6-9, 30.
[2]
Abdurahman, S., Atari, M., Karimi-Malekabadi, F., Xue, M. J., Trager, J., Park, P. S., & Dehghani, M. (2024). Perils and opportunities in using large language models in psychological research. PNAS Nexus, 3(7), Article 245.
[3]
Aher, G., Arriaga, R. I., & Kalai, A. T. (2023). Using large language models to simulate multiple humans and replicate human subject studies. In Proceedings of the 40th International Conference on Machine Learning (pp.337-371). JMLR.org.
[4]
Argyle, L. P., Busby, E. C., Fulda, N., Gubler, J. R., Rytting, C., & Wingate, D. (2023). Out of one, many: Using language models to simulate human samples. Political Analysis, 31(3), 337-351.
We propose and explore the possibility that language models can be studied as effective proxies for specific human subpopulations in social science research. Practical and research applications of artificial intelligence tools have sometimes been limited by problematic biases (such as racism or sexism), which are often treated as uniform properties of the models. We show that the “algorithmic bias” within one such tool—the GPT-3 language model—is instead both fine-grained and demographically correlated, meaning that proper conditioning will cause it to accurately emulate response distributions from a wide variety of human subgroups. We term this propertyalgorithmic fidelityand explore its extent in GPT-3. We create “silicon samples” by conditioning the model on thousands of sociodemographic backstories from real human participants in multiple large surveys conducted in the United States. We then compare the silicon and human samples to demonstrate that the information contained in GPT-3 goes far beyond surface similarity. It is nuanced, multifaceted, and reflects the complex interplay between ideas, attitudes, and sociocultural context that characterize human attitudes. We suggest that language models with sufficient algorithmic fidelity thus constitute a novel and powerful tool to advance understanding of humans and society across a variety of disciplines.
[5]
Argyle, L. P., Busby, E. C., Gubler, J. R., Hepner, B., Lyman, A., & Wingate, D. (2025). Arti-"fickle" intelligence: Using LLMs as a tool for inference in the political and social science. arXiv.
[6]
Bai, X. C. Z., Wang, A., Sucholutsky, I., & Griffiths, T. L. (2025). Explicitly unbiased large language models still form biased associations. Proceedings of the National Academy of Sciences of the United States of America, 122(8), Article e2416228122.
[7]
Bai, Y. T., Kadavath, S., Kundu, S., Askell, A., Kernion, J., Jones, A., & Kaplan, J. (2022). Constitutional AI: Harmlessness from AI feedback. arXiv.
[8]
Binz, M., & Schulz, E. (2023). Using cognitive psychology to understand GPT-3. Proceedings of the National Academy of Sciences of the United States of America, 120(6), Article e2218523120.
[9]
Bisbee, J., Clinton, J. D., Dorff, C., Kenkel, B., & Larson, J. M. (2024). Synthetic replacements for human survey data? The perils of large language models. Political Analysis, 32(4), 401-416.
Large language models (LLMs) offer new research possibilities for social scientists, but their potential as “synthetic data” is still largely unknown. In this paper, we investigate how accurately the popular LLM ChatGPT can recover public opinion, prompting the LLM to adopt different “personas” and then provide feeling thermometer scores for 11 sociopolitical groups. The average scores generated by ChatGPT correspond closely to the averages in our baseline survey, the 2016–2020 American National Election Study (ANES). Nevertheless, sampling by ChatGPT is not reliable for statistical inference: there is less variation in responses than in the real surveys, and regression coefficients often differ significantly from equivalent estimates obtained using ANES data. We also document how the distribution of synthetic responses varies with minor changes in prompt wording, and we show how the same prompt yields significantly different results over a 3-month period. Altogether, our findings raise serious concerns about the quality, reliability, and reproducibility of synthetic survey data generated by LLMs.
[10]
Chen, J. Y., Qiu, L., & Ho, M. H. R. (2020). A meta-analysis of linguistic markers of extraversion: Positive emotion and social process words. Journal of Research in Personality, 89, Article 104035.
[11]
Chen, W. Z., Su, Y. S., Zuo, J. W., Yang, C., Yuan, C. F., Chan, C. M., & Zhou, J. (2023). AgentVerse: Facilitating multi-agent collaboration and exploring emergent behaviors. arXiv.
[12]
Cui, Z. Y., Li, N., & Zhou, H. K. (2024). Can AI replace human subjects? A large-scale replication of psychological experiments with LLMs. https://ssrn.com/abstract=4940173
[13]
Danry, V., Pataranutaporn, P., Groh, M., & Epstein, Z. (2025). Deceptive explanations by Large Language Models lead people to change their beliefs about misinformation more often than honest explanations. In Proceedings of the 2025 CHI conference on human factors in computing systems (pp. 933). Yokohama, Japan: ACM.
[14]
Dillion, D., Mondal, D., Tandon, N., & Gray, K. (2025). AI language model rivals expert ethicist in perceived moral expertise. Scientific Reports, 15(1), Article 4084.
[15]
Dillion, D., Tandon, N., Gu, Y. L., & Gray, K. (2023). Can AI language models replace human participants? Trends in Cognitive Sciences, 27(7), 597-600.
Recent work suggests that language models such as GPT can make human-like judgments across a number of domains. We explore whether and when language models might replace human participants in psychological science. We review nascent research, provide a theoretical model, and outline caveats of using AI as a participant.Copyright © 2023 Elsevier Ltd. All rights reserved.
[16]
Durmus, E., Nguyen, K., Liao, T. I., Schiefer, N., Askell, A., Bakhtin, A., & Ganguli, D. (2024). Towards measuring the representation of subjective global opinions in language models. arXiv.
[17]
Gottweis, J., Weng, W. H., Daryin, A., Tu, T., Palepu, A., Sirkovic, P., & Natarajan, V. (2025). Towards an AI co-scientist. arXiv.
[18]
Grossmann, I., Feinberg, M., Parker, D. C., Christakis, N. A., Tetlock, P. E., & Cunningham, W. A. (2023). AI and the transformation of social science research. Science, 380(6650), 1108-1109.
Careful bias management and data fidelity are key.
[19]
Harding, J., D’Alessandro, W., Laskowski, N. G., & Long, R. (2024). AI language models cannot replace human research participants. AI and Society, 39(5), 2603-2605.
[20]
Hofmann, V., Kalluri, P. R., Jurafsky, D., & King, S. (2024). AI generates covertly racist decisions about people based on their dialect. Nature, 633(8028), 147-154.
[21]
Jiang, H., Zhang, X. J., Cao, X. B., Breazeal, C., Roy, D., & Kabbara, J. (2024). PersonaLLM: Investigating the ability of large language models to express personality traits. arXiv.
[22]
Kim, J., & Lee, B. (2024). AI-augmented surveys: Leveraging large language models and surveys for opinion prediction. arXiv.
[23]
King, G., Keohane, R. O., & Verba, S. (2021). Designing social inquiry: Scientific inference in qualitative research. Princeton University Press.
[24]
King, R. D., Rowland, J., Oliver, S. G., Young, M., Aubrey, W., Byrne, E., & Clare, A. (2009). The automation of science. Science, 324(5923), 85-89.
The basis of science is the hypothetico-deductive method and the recording of experiments in sufficient detail to enable reproducibility. We report the development of Robot Scientist "Adam," which advances the automation of both. Adam has autonomously generated functional genomics hypotheses about the yeast Saccharomyces cerevisiae and experimentally tested these hypotheses by using laboratory automation. We have confirmed Adam's conclusions through manual experiments. To describe Adam's research, we have developed an ontology and logical language. The resulting formalization involves over 10,000 different research units in a nested treelike structure, 10 levels deep, that relates the 6.6 million biomass measurements to their logical description. This formalization describes how a machine contributed to scientific knowledge.
[25]
Kosinski, M. (2024). Evaluating large language models in theory of mind tasks. Proceedings of the National Academy of Sciences of the United States of America, 121(45), Article e2405460121.
[26]
Li, B. H., Wang, R., Wang, G. Z., Ge, Y. Y., Ge, Y. X., & Shan, Y. (2023). SEED-bench: Benchmarking multimodal LLMs with generative comprehension. arXiv.
[27]
Li, Y. T., Qiu, L., Xie, T., Luo, Y, & Liu, P. (2025). Large language models can forecast public opinions but with biases. PsyArXiv.
[28]
Lin, Z. C. (2025). Six fallacies in substituting large language models for human participants. Advances in Methods and Practices in Psychological Science, 8(3), 1-19.
[29]
Luo, Y., Du, J. S., & Qiu, L. (2024). On the cultural sensitivity of large language models: GPT's ability to simulate human self-concept. In 2024 11th International Conference on Behavioural and Social Computing (BESC) (pp. 1-8). Harbin, China: IEEE.
[30]
Malmqvist, L. (2025). Sycophancy in large language models: Causes and mitigations. In K. Arai (Ed.), Intelligent computing (pp. 61-74). Springer
[31]
Mitchell, M., & Krakauer, D. C. (2023). The debate over understanding in AI’s large language models. Proceedings of the National Academy of Sciences of the United States of America, 120(13), Article e2215907120.
[32]
Mou, X. Y., Wei, Z. Y., & Huang, X. J. (2024). Unveiling the truth and facilitating change: Towards agent-based large-scale social movement simulation. arXiv.
[33]
Myers, D., Mohawesh, R., Chellaboina, V. I., Sathvik, A. L., Venkatesh, P., Ho, Y. H., & Jararweh, Y. (2024). Foundation and large language models: Fundamentals, challenges, opportunities, and social impacts. Cluster Computing, 27(1), 1-26.
[34]
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., & Lowe, R. (2022). Training language models to follow instructions with human feedback. In Proceedings of the 36th International Conference on Neural Information Processing Systems (pp.27730-27744). New Orleans, LA, USA: Curran Associates Inc..
[35]
Park, J. S., O'Brien, J., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023). Generative agents:Interactive simulacra of human behavior. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (pp.2). San Francisco, CA, USA: Association for Computing Machinery.
[36]
Peng, T. Q., Yang, K., Lee, S., Li., Chu, Y., Lin, Y., & Liu, H. (2024). Beyond partisan leaning: A comparative analysis of political bias in Large Language Models. arXiv.
[37]
Qin, X., Huang, M. P., & Ding, J. (2024). AITurk: Using ChatGPT for social science research. https://ssrn.com/abstract=4922861
[38]
Qiu, L., Chan, S. H. M., & Chan, D. (2018). Big data in social and psychological science: Theoretical and methodological issues. Journal of Computational Social Science, 1(1), 59-66.
[39]
Qiu, L., Lin, H., Ramsay, J., & Yang, F. (2012). You are what you tweet: Personality expression and perception on Twitter. Journal of Research in Personality, 46(6), 710-718.
[40]
Santurkar, S., Durmus, E., Ladhak, F., Lee, C., Liang, P., & Hashimoto, T. (2023). Whose opinions do language models reflect? In Proceedings of the 40th International Conference on Machine Learning (pp. 29971-30004). Honolulu, HI, USA.
[41]
Saqr, K. (2025). Narratives of divide: The polarizing power of Large Language Models in a turbulent world. https://ssrn.com/abstract=5124882
[42]
Simmons, G., & Savinov, V. (2024). Assessing generalization for subpopulation representative modeling via in-context learning. arXiv.
[43]
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22(11), 1359-1366.
In this article, we accomplish two things. First, we show that despite empirical psychologists' nominal endorsement of a low rate of false-positive findings (≤.05), flexibility in data collection, analysis, and reporting dramatically increases actual false-positive rates. In many cases, a researcher is more likely to falsely find evidence that an effect exists than to correctly find evidence that it does not. We present computer simulations and a pair of actual experiments that demonstrate how unacceptably easy it is to accumulate (and report) statistically significant evidence for a false hypothesis. Second, we suggest a simple, low-cost, and straightforwardly effective disclosure-based solution to this problem. The solution involves six concrete requirements for authors and four guidelines for reviewers, all of which impose a minimal burden on the publication process.
[44]
Taylor, J. E. T., & Taylor, G. W. (2021). Artificial cognition: How experimental psychology can help generate explainable artificial intelligence. Psychonomic Bulletin and Review, 28(2), 454-475.
[45]
Tong, S. B., Liu, Z., Zhai, Y. X., Ma, Y., LeCun, Y., & Xie, S. N. (2024). Eyes wide shut? Exploring the visual shortcomings of multimodal LLMs. In Proceedings of the 2024 IEEE/CVF conference on computer vision and pattern recognition (pp. 9568-9578). Seattle, WA, USA: IEEE.
[46]
van Noorden, R., & Perkel, J. M. (2023). AI and science: What 1, 600 researchers think. Nature, 621(7980), 672-675.
[47]
Wang, H. C., Fu, T. F., Du, Y. Q., Gao, W. H., Huang, K. X., Liu, Z. M., & Zitnik, M. (2023). Scientific discovery in the age of artificial intelligence. Nature, 620(7972), 47-60.
[48]
Wang, P. D., Zou, H. Q., Yan, Z. H., Guo, F., Sun, T. J., Xiao, Z. A., & Zhang, B. (2024). Not yet: Large Language Models cannot replace human respondents for psychometric research. https://osf.io/preprints/osf/rwy9b_v1.
[49]
Wang, X. T., Xiao, Y. Z., Huang, J. T., Yuan, S. Y., Xu, R., Guo, H. R., & Xiao, Y. H. (2024). InCharacter: Evaluating personality fidelity in role-playing agents through psychological interviews. arXiv.
[50]
Wu, S. Q., Fei, H., Qu, L. G., Ji, W., & Chua, T. S. (2024). NExT-GPT: Any-to-any multimodal LLM. arXiv.
[51]
Yildirim, I., & Paul, L. A. (2024). From task structures to world models: What do LLMs know? Trends in Cognitive Sciences, 28(5), 404-415.
In what sense does a large language model (LLM) have knowledge? We answer by granting LLMs 'instrumental knowledge': knowledge gained by using next-word generation as an instrument. We then ask how instrumental knowledge is related to the ordinary, 'worldly knowledge' exhibited by humans, and explore this question in terms of the degree to which instrumental knowledge can be said to incorporate the structured world models of cognitive science. We discuss ways LLMs could recover degrees of worldly knowledge and suggest that such recovery will be governed by an implicit, resource-rational tradeoff between world models and tasks. Our answer to this question extends beyond the capabilities of a particular AI system and challenges assumptions about the nature of knowledge and intelligence.Copyright © 2024 Elsevier Ltd. All rights reserved.
[52]
Zhang, D. Z., Yu, Y. H., Dong, J. H., Li, C. X., Su, D., Chu, C. H., & Yu, D. (2024). Mm-LLMs: Recent advances in multimodal large language models. arXiv.
[53]
Ziegler, D. M., Stiennon, N., Wu, J., Brown, T. B., Radford, A., Amodei, D., & Irving, G. (2020). Fine-tuning language models from human preferences. arXiv.
PDF(704 KB)

Accesses

Citation

Detail

Sections
Recommended

/