Evidence map›Paper›PMID 39304760›Full record

ReviewNature human behaviour2024

How large language models can reshape collective intelligence.

Jason W Burton, Ezequiel Lopez-Lopez, Shahar Hechtlinger, Zoe Rahwan, Samuel Aeschbach, Michiel A Bakker, Joshua A Becker, Aleks Berditchevskaia, Julian Berger, Levin Brinkmann and 18 more

Abstract readReview
PubMed Publisher
In one paragraph

Review in Nature human behaviour, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed.

  1. Article
  2. Article
  3. Moral stereotyping in large language models.Proceedings of the National Academy of Sciences of the United States of America · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Human-AI collectives most accurately diagnose clinical vignettes.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  13. Review
  14. AI-enhanced collective intelligence.Patterns (New York, N.Y.) · 2024
    Review
  15. Embracing the ubiquity of machines.Nature human behaviour · 2024
    Article
  16. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

28 authors.

Jason W BurtonDepartment of Digitalization, Copenhagen Business School, Frederiksberg, Denmark. jb.digi@cbs.dk.ORCID http://orcid.org/0000-0002-6797-2299
Ezequiel Lopez-LopezCenter for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.
Shahar HechtlingerCenter for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.ORCID http://orcid.org/0000-0003-0650-822X
Zoe RahwanCenter for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.ORCID http://orcid.org/0000-0003-1506-0105
Samuel AeschbachCenter for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.ORCID http://orcid.org/0000-0002-6167-4901
Michiel A BakkerGoogle DeepMind, London, UK.
Joshua A BeckerUCL School of Management, University College London, London, UK.
Aleks BerditchevskaiaCentre for Collective Intelligence Design, Nesta, London, UK.
Julian BergerCenter for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.
Levin BrinkmannCenter for Humans and Machines, Max Planck Institute for Human Development, Berlin, Germany.ORCID http://orcid.org/0000-0002-1642-8744
Lucie FlekBonn-Aachen International Center for Information Technology, University of Bonn, Bonn, Germany.
Stefan M HerzogCenter for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.ORCID http://orcid.org/0000-0003-2329-6433
Saffron HuangCollective Intelligence Project, San Francisco, CA, USA.
Sayash KapoorCenter for Information Technology Policy, Princeton University, Princeton, NJ, USA.
Arvind NarayananCenter for Information Technology Policy, Princeton University, Princeton, NJ, USA.
Anne-Marie NussbergerCenter for Humans and Machines, Max Planck Institute for Human Development, Berlin, Germany.ORCID http://orcid.org/0000-0002-1805-9399
Taha YasseriSchool of Sociology, University College Dublin, Dublin, Ireland.ORCID http://orcid.org/0000-0002-1800-6094
Pietro NicklCenter for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.
Abdullah AlmaatouqSloan School of Management, Massachusetts Institute of Technology, Cambridge, MA, USA.ORCID http://orcid.org/0000-0002-8467-9123
Ulrike HahnDepartment of Psychological Sciences, Birkbeck, University of London, London, UK.
Ralf H J M KurversCenter for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.ORCID http://orcid.org/0000-0002-3460-0392
Susan LeavySchool of Information and Communication, Insight SFI Research Centre for Data Analytics, University College Dublin, Dublin, Ireland.
Iyad RahwanCenter for Humans and Machines, Max Planck Institute for Human Development, Berlin, Germany.ORCID http://orcid.org/0000-0002-1796-4303
Divya SiddarthCollective Intelligence Project, San Francisco, CA, USA.
Alice SiuDeliberative Democracy Lab, Stanford University, Stanford, CA, USA.
Anita W WoolleyTepper School of Business, Carnegie Mellon University, Pittsburgh, PA, USA.
Dirk U WulffCenter for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.ORCID http://orcid.org/0000-0002-4008-8022
Ralph HertwigCenter for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.ORCID http://orcid.org/0000-0002-9908-9556

Funding

Deutsche Forschungsgemeinschaft (German Research Foundation) 390523135Deutsche Forschungsgemeinschaft (German Research Foundation) 458366841Irish Research Council (An Chomhairle um Thaighde in Éirinn) IRCLA/2022/3217
6 · The paper itself

Abstract

Collective intelligence underpins the success of groups, organizations, markets and societies. Through distributed cognition and coordination, collectives can achieve outcomes that exceed the capabilities of individuals-even experts-resulting in improved accuracy and novel capabilities. Often, collective intelligence is supported by information technology, such as online prediction markets that elicit the 'wisdom of crowds', online forums that structure collective deliberation or digital platforms that crowdsource knowledge from the public. Large language models, however, are transforming how information is aggregated, accessed and transmitted online. Here we focus on the unique opportunities and challenges this transformation poses for collective intelligence. We bring together interdisciplinary perspectives from industry and academia to identify potential benefits, risks, policy-relevant considerations and open research questions, culminating in a call for a closer examination of how large language models affect humans' ability to collectively tackle complex problems.

Indexed as

IntelligenceLanguageCooperative BehaviorGroup ProcessesHumansModels, Theoretical

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.