Evidence map›Paper›PMID 39030292›Full record

ArticleNPJ digital medicine2024

Large language models outperform mental and medical health care professionals in identifying obsessive-compulsive disorder.

Jiyeong Kim, Kimberly G Leonte, Michael L Chen, John B Torous, Eleni Linos, Anthony Pinto, Carolyn I Rodriguez

Abstract read
In one paragraph

Article in NPJ digital medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 33 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
33citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

33 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Large language models accurately identify immunosuppression in intensive care unit patients.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Jiyeong Kim *Stanford Center for Digital Health, Department of Medicine, Stanford University, Palo Alto, CA, USA. jykim3@stanford.edu.ORCID http://orcid.org/0000-0002-2869-5751
Kimberly G Leonte *Clearview Horizons, North Andover, MA, USA.ORCID http://orcid.org/0009-0002-9180-564X
Michael L ChenStanford Center for Digital Health, Department of Medicine, Stanford University, Palo Alto, CA, USA.
John B TorousDivision of Digital Psychiatry, Department of Psychiatry, Beth Israel Deaconess Medical Center, Boston, MA, USA.ORCID http://orcid.org/0000-0002-5362-7937
Eleni LinosStanford Center for Digital Health, Department of Medicine, Stanford University, Palo Alto, CA, USA.ORCID http://orcid.org/0000-0002-5856-6301
Anthony PintoDepartment of Psychiatry, Donald and Barbara Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA.
Carolyn I RodriguezDepartment of Psychiatry and Behavioral Sciences, School of Medicine, Stanford University, Palo Alto, CA, USA. cr2163@stanford.edu.ORCID http://orcid.org/0000-0001-6697-1692

Funding

Patient Oriented Research in Vulnerable Populations with Skin DiseaseK24AR075060 · NIAMS · STANFORD UNIVERSITY · PI Eleni Linos · 2019 to 2026
$1.6M
Leveraging Large Language Models and Machine Learning Algorithms to Assess Depression and Anxiety Symptoms and Risks for Patients with Cardiovascular Disease or Diabetes MellitusK01MH137386 · NIMH · STANFORD UNIVERSITY · PI Jiyeong Kim · 2024 to 2026
$406k
NIAMS NIH HHS K24 AR075060NIMH NIH HHS K01 MH137386U.S. Department of Health & Human Services | National Institutes of Health (NIH) K24AR075060
6 · The paper itself

Abstract

Despite the promising capacity of large language model (LLM)-powered chatbots to diagnose diseases, they have not been tested for obsessive-compulsive disorder (OCD). We assessed the diagnostic accuracy of LLMs in OCD using vignettes and found that LLMs outperformed medical and mental health professionals. This highlights the potential benefit of LLMs in assisting in the timely and accurate diagnosis of OCD, which usually entails a long delay in diagnosis and treatment.

Identifiers

PMID39030292
PMCPMC11271579

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.