Evidence map›Paper›PMID 40234594›Full record

ArticleEye (London, England)2025

ChatGPT-4 for addressing patient-centred frequently asked questions in age-related macular degeneration clinical practice.

Henrietta Wang, Amanda Ie, Thomas Chan, William Yates, Michael Kalloniatis, Janelle Tong, Sophia Zhang, Tracey Phan, Christopher Go, Jack Phu

Abstract read
In one paragraph

Article in Eye (London, England), 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Review
  5. Article
  6. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Henrietta WangSchool of Optometry and Vision Science, University of New South Wales, Kensington, NSW, Australia.
Amanda IeDepartment of Ophthalmology, Westmead Hospital, Westmead, Sydney, NSW, Australia.
Thomas ChanDepartment of Ophthalmology, Westmead Hospital, Westmead, Sydney, NSW, Australia.
William YatesSave Sight Institute, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia.
Michael KalloniatisSchool of Optometry and Vision Science, University of New South Wales, Kensington, NSW, Australia.
Janelle TongSchool of Optometry and Vision Science, University of New South Wales, Kensington, NSW, Australia.
Sophia ZhangSchool of Optometry and Vision Science, University of New South Wales, Kensington, NSW, Australia.
Tracey PhanDepartment of Ophthalmology, Liverpool Hospital, Liverpool, NSW, Australia.
Christopher GoSave Sight Institute, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia.ORCID http://orcid.org/0000-0003-0440-3897
Jack PhuSchool of Optometry and Vision Science, University of New South Wales, Kensington, NSW, Australia. jack.phu@unsw.edu.au.ORCID http://orcid.org/0000-0002-9933-6780

Funding

Department of Health | National Health and Medical Research Council (NHMRC) 1186915
6 · The paper itself

Abstract

purposeLarge language models have shown promise in answering questions related to medical conditions. This study evaluated the responses of ChatGPT-4 in answering patient-centred frequently asked questions (FAQs) relevant in age-related macular degeneration (AMD).

methodsTen experts across a range of clinical, education and research practices in optometry and ophthalmology. Over 200 patient-centric FAQs from authoritative professional society, hospital and advocacy websites were condensed into 37 questions across four themes: definition, causes and risk factors, symptoms and detection, and treatment and follow-up. The questions were individually input into ChatGPT-4 to generate responses. The responses were graded by the experts individually using a 5-point Likert scale (1 = strongly disagree; 5 = strongly agree) across four domains: coherency, factuality, comprehensiveness, and safety.

resultsAcross all themes and domains, median scores were all 4 ("agree"). Comprehensiveness had the lowest scores across domains (mean 3.8 ± 0.8), followed by factuality (mean 3.9 ± 0.8), safety (mean 4.1 ± 0.8) and coherency (mean 4.3 ± 0.7). Examination of the individual 37 questions showed that 5 (14%), 21 (57%), 23 (62%) and 9 (24%) of the questions had average scores below 4 (below "agree") for the coherency, factuality, comprehensiveness and safety domains, respectively. Free-text comments highlighted issues related to superseded or older technologies, and techniques that are not routinely used in clinical practice, such as genetic testing.

conclusionsChatGPT-4 responses to FAQs in AMD were generally agreeable in terms of coherency, factuality, comprehensiveness, and safety. However, areas of weakness were identified, precluding recommendations for routine use to provide patients with tailored counselling in AMD.

Indexed as

Macular DegenerationOphthalmologyPatient-Centered CareFemaleGenerative Artificial IntelligenceHumansSurveys and Questionnaires

Identifiers

PMID40234594
PMCPMC12209409

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.