Evidence map›Paper›PMID 36746144›Full record

ArticleNeural computation2023

Large Language Models and the Reverse Turing Test.

Terrence J Sejnowski

Abstract read
In one paragraph

Article in Neural computation, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed.

  1. Review
  2. Review
  3. Article
  4. Metacognition of ChatGPT in confidence judgements.Frontiers in artificial intelligence · 2026
    Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Active inference goes to school: the importance of active learning in the age of large language models.Philosophical transactions of the Royal Society of London. Series B, Biological sciences · 2024
    Article
  11. Review
  12. Article
  13. Article
  14. GPT-4 passes the bar exam.Philosophical transactions. Series A, Mathematical, physical, and engineering sciences · 2024
    Article
  15. Review
  16. Eight challenges in developing theory of intelligence.Frontiers in computational neuroscience · 2024
    Article
  17. Embodiment and agency in a digital world.Frontiers in psychology · 2024
    Article
  18. Article
  19. The emergence of economic rationality of GPT.Proceedings of the National Academy of Sciences of the United States of America · 2023
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

1 author.

Terrence J SejnowskiSalk Institute for Biological Studies, La Jolla, CA 92093, U.S.A.

Funding

Nonlinear Causal Analysis of Neural SignalsR01EB026899 · NIBIB · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI SEJNOWSKI, TERRENCE J · 2018 to 2020
$1.0M
NIBIB NIH HHS R01 EB026899
6 · The paper itself

Abstract

Large language models (LLMs) have been transformative. They are pretrained foundational models that are self-supervised and can be adapted with fine-tuning to a wide range of natural language tasks, each of which previously would have required a separate network model. This is one step closer to the extraordinary versatility of human language. GPT-3 and, more recently, LaMDA, both of them LLMs, can carry on dialogs with humans on many topics after minimal priming with a few examples. However, there has been a wide range of reactions and debate on whether these LLMs understand what they are saying or exhibit signs of intelligence. This high variance is exhibited in three interviews with LLMs reaching wildly different conclusions. A new possibility was uncovered that could explain this divergence. What appears to be intelligence in LLMs may in fact be a mirror that reflects the intelligence of the interviewer, a remarkable twist that could be considered a reverse Turing test. If so, then by studying interviews, we may be learning more about the intelligence and beliefs of the interviewer than the intelligence of the LLMs. As LLMs become more capable, they may transform the way we interact with machines and how they interact with each other. Increasingly, LLMs are being coupled with sensorimotor devices. LLMs can talk the talk, but can they walk the walk? A road map for achieving artificial general autonomy is outlined with seven major improvements inspired by brain systems and how LLMs could in turn be used to uncover new insights into brain function.

Indexed as

Artificial IntelligenceBrainHumansLanguageLearning

Identifiers

PMID36746144
PMCPMC10177005

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.