Evidence map›Paper›PMID 38719344›Full record

ReviewThe British journal of ophthalmology2024

Medical education with large language models in ophthalmology: custom instructions and enhanced retrieval capabilities.

Mertcan Sevgi, Fares Antaki, Pearse A Keane

Registry-linked trialAbstract readReview
In one paragraph

Review in The British journal of ophthalmology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT07183111 (Comparison of Traditional Instructions Vs AI Based Instructions With Customized Chat GPT as Remote Support System on Education of Orthodontic Patients), which is not on this map. Cited by 19 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT07183111 narecruitingnot on this mapstarted 2025, after this paper: background citation

Comparison of Traditional Instructions Vs AI Based Instructions With Customized Chat GPT as Remote Support System on Education of Orthodontic Patients:A Randomised Control Trial

TypeinterventionalSponsorPakistan Institute of Medical SciencesRan2025 to 2026Enrolled60ConditionsFocus of the Study is Plaque and Gingival Index Score Before and After Instructions, Satisfaction Assessment of Orthodontic Patients With Both Instruction Modalities, Knowledge Assessment, Recall Ability of Orthodontic Instructions With Both ModalitiesArmsInstructions given via artificial intelligence chatbot in form of voice instructions at chair side with Customized chatbot for remote home support, Control group instructions given by chair side orthodontist verbally and written pamphlet as home care support
3 · Its place in the literature

Who cites it

19 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Observational
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Review
  16. A review of ophthalmology education in the era of generative artificial intelligence.Asia-Pacific journal of ophthalmology (Philadelphia, Pa.)
    Review
  17. Article
  18. Article
  19. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Mertcan SevgiInstitute of Ophthalmology, University College London, London, UK.ORCID 0009-0003-8426-6534
Fares AntakiInstitute of Ophthalmology, University College London, London, UK.ORCID 0000-0001-6679-7276
Pearse A KeaneInstitute of Ophthalmology, University College London, London, UK p.keane@ucl.ac.uk.ORCID 0000-0002-9239-745X

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Foundation models are the next generation of artificial intelligence that has the potential to provide novel use cases for healthcare. Large language models (LLMs), a type of foundation model, are capable of language comprehension and the ability to generate human-like text. Researchers and developers have been tuning LLMs to optimise their performance in specific tasks, such as medical challenge problems. Until recently, tuning required technical programming expertise, but the release of custom generative pre-trained transformers (GPTs) by OpenAI has allowed users to tune their own GPTs with natural language. This has the potential to democratise access to high-quality bespoke LLMs globally. In this review, we provide an overview of LLMs, how they are tuned and how custom GPTs work. We provide three use cases of custom GPTs in ophthalmology to demonstrate the versatility and effectiveness of these tools. First, we present 'EyeTeacher', an educational aid that generates questions from clinical guidelines to facilitate learning. Second, we built 'EyeAssistant', a clinical support tool that is tuned with clinical guidelines to respond to various physician queries. Lastly, we design 'The GPT for GA', which offers clinicians a comprehensive summary of emerging management strategies for geographic atrophy by analysing peer-reviewed documents. The review underscores the significance of custom instructions and information retrieval in tuning GPTs for specific tasks in ophthalmology. We also discuss the evaluation of LLM responses and address critical aspects such as privacy and accountability in their clinical application. Finally, we discuss their potential in ophthalmic education and clinical practice.

Indexed as

Artificial IntelligenceOphthalmologyEducation, MedicalHumansLanguageMedical Education

Identifiers

PMID38719344
PMCPMC11503072

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.