Evidence map›Paper›PMID 42693192›Full record

ArticleScientific reports2026

Persona-prompted LLM agents achieve modest but genuine prediction of human social media reactions.

Ljubiša Bojić, Alexander Felfernig, Bojana Dinić, Velibor Ilić, Achim Rettinger, Vera Mevorah, Damian Trilling

Abstract read
In one paragraph

Article in Scientific reports, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Ljubiša BojićInstitute for Artificial Intelligence Research and Development of Serbia, 1 Frukogorska 1, Novi Sad, 21000, Serbia.ORCID 0000-0002-5371-7975
Alexander FelfernigGraz University of Technology, Inffeldgasse 16b/2, Graz, Austria.ORCID 0000-0003-0108-3146
Bojana DinićFaculty of Philosophy, University of Novi Sad, Dr Zorana Đinđića 2, Novi Sad, 21102, Serbia.ORCID 0000-0002-5492-2188
Velibor IlićInstitute for Artificial Intelligence Research and Development of Serbia, 1 Frukogorska 1, Novi Sad, 21000, Serbia.ORCID 0000-0001-5010-1377
Achim RettingerUniversity of Trier, Universitätsring 15, 54296, Trier, Germany. rettinger@uni-trier.de.ORCID 0000-0003-4950-1167
Vera MevorahInstitute for Philosophy and Social Theory, Digital Society Lab, University of Belgrade, Natalije 45, Belgrade, 11000, Serbia.ORCID 0000-0002-4313-475X
Damian TrillingVrije University Amsterdam, De Boelelaan 1105, Amsterdam, 1081 HV, Netherlands.ORCID 0000-0002-2586-0352

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Social media platforms mediate how billions form opinions and engage with public discourse. As autonomous AI agents increasingly participate in these spaces, understanding their behavioral fidelity becomes critical for platform governance and democratic resilience. Previous work demonstrates that LLM-powered agents can replicate aggregate survey responses, yet few studies test whether agents can predict specific individuals' reactions to specific content. This study benchmarks LLM-based agents' accuracy in predicting human social media reactions (like, dislike, comment, share, no reaction) across 120,000 + unique agent-persona combinations derived from 1,511 Serbian participants and 27 large language models. In Study 1, agents achieved 70.7% overall accuracy, with LLM choice producing a 13%-point performance spread. Study 2 employed binary forced-choice (like/dislike) evaluation with chance-corrected metrics. Agents achieved Matthews Correlation Coefficient (MCC) of 0.29, indicating genuine predictive signal beyond chance. However, conventional text-based supervised classifiers using TF-IDF representations outperformed LLM agents (MCC of 0.36), indicating that the predictive signal derives from semantic text content rather than from any capacity for individualized behavioral simulation. The genuine but modest predictive validity of zero-shot persona-prompted agents suggests that, while current accuracy is insufficient for precise individual targeting, the capacity to predict reactions at rates above chance warrants attention in discussions of AI-driven influence and social simulation methodology. The advantage of zero‑shot agents is that they require no task‑specific training, which makes large‑scale deployment easy across diverse contexts, including election campaigns and mass‑scale manipulation. Limitations include single-country sampling. Future research should explore multilingual testing and fine-tuning approaches.

Indexed as

Social MediaArtificial IntelligenceHumansLarge Language ModelsPrediction AlgorithmsAI agentsBehavioral benchmarkingLLM-based social simulationPersona promptingSocial media behavior prediction

Identifiers

PMID42693192
PMCPMC13542291

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.