Evidence map›Paper›PMID 39242743›Full record

ArticleCommunications psychology2024

Studying and improving reasoning in humans and machines.

Nicolas Yax, Hernán Anlló, Stefano Palminteri

Abstract read
In one paragraph

Article in Communications psychology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed.

  1. Review
  2. Legal Decision Biases in GPT: A Comparison with Human Judgment.Behavioral sciences (Basel, Switzerland) · 2026
    Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. The simulation of judgment in LLMs.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  8. Article
  9. Observational
  10. How should the advancement of large language models affect the practice of science?Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Nicolas Yax *Laboratoire de neurosciences cognitives et computationnelles, Institut national de la santé et de la recherche médicale, Paris, France.ORCID http://orcid.org/0009-0008-1176-5806
Hernán Anlló *Laboratoire de neurosciences cognitives et computationnelles, Institut national de la santé et de la recherche médicale, Paris, France.ORCID http://orcid.org/0000-0002-1663-1881
Stefano PalminteriLaboratoire de neurosciences cognitives et computationnelles, Institut national de la santé et de la recherche médicale, Paris, France. stefano.palminteri@ens.fr.ORCID http://orcid.org/0000-0001-5768-6646

Funding

Agence Nationale de la Recherche (French National Research Agency) ANR-21-CE28-0024-01Agence Nationale de la Recherche (French National Research Agency) ANR-21-CE37-0008- 01EC | EU Framework Programme for Research and Innovation H2020 | H2020 Priority Excellent Science | H2020 European Research Council (H2020 Excellent Science - European Research Council) 101043804
6 · The paper itself

Abstract

In the present study, we investigate and compare reasoning in large language models (LLMs) and humans, using a selection of cognitive psychology tools traditionally dedicated to the study of (bounded) rationality. We presented to human participants and an array of pretrained LLMs new variants of classical cognitive experiments, and cross-compared their performances. Our results showed that most of the included models presented reasoning errors akin to those frequently ascribed to error-prone, heuristic-based human reasoning. Notwithstanding this superficial similarity, an in-depth comparison between humans and LLMs indicated important differences with human-like reasoning, with models' limitations disappearing almost entirely in more recent LLMs' releases. Moreover, we show that while it is possible to devise strategies to induce better performance, humans and machines are not equally responsive to the same prompting schemes. We conclude by discussing the epistemological implications and challenges of comparing human and machine behavior for both artificial intelligence and cognitive psychology.

Identifiers

PMID39242743
PMCPMC11332180

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.