ArticleClinical imaging2025
Exploring the accuracy of embedded ChatGPT-4 and ChatGPT-4o in generating BI-RADS scores: a pilot study in radiologic clinical support.
Article in Clinical imaging, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
13 citing papers in PubMed.
- Attitudes Toward Large Language Models in Health Care and Preferences for Their Adoption and Oversight Among Health Care Professionals: Cross-Sectional Survey.Journal of medical Internet research · 2026Article
- Diagnostic accuracy and consistency of ChatGPT-4o in radiology: influence of image, clinical data, and answer options on performance.Diagnostic and interventional radiology (Ankara, Turkey) · 2026Article
- Fine-tuned multimodal GPT-4o for generating diagnostic impressions in breast magnetic resonance imaging: insights into non-mass enhancement lesions.Quantitative imaging in medicine and surgery · 2026Article
- Tracing the Pen: Electronic Health Records Amid the Rise of Generative AI.NPJ digital medicine · 2026Review
- Large Language Model Performance and Clinical Reasoning Tasks.JAMA network open · 2026Article
- Preparing for Pandemics with Large Language Models: An Evaluation of Sensitivity Across COVID-19, Zika, and Monkeypox Case Reports.Journal of medical systems · 2026Article
- Evaluating the Role of Artificial Intelligence in Enhancing Multidisciplinary Team Decisions for Breast Cancer Management.European journal of breast health · 2026Article
- Designing Patient-Centered Communication Aids in Pediatric Surgery Using Large Language Models.Journal of pediatric surgery · 2025Article
- The Digital Standardized Patient: An Artificial Intelligence Coach for Cultural Dexterity in Surgical Care.Journal of the American College of Surgeons · 2025Article
- Development and Evaluation of an Artificial Intelligence-Powered Surgical Oral Examination Simulator: A Pilot Study.Mayo Clinic proceedings. Digital health · 2025Article
- Decoding large language models for radiology: strategies for fine-tuning and prompt engineering.Radiology advances · 2025Review
- Synthetic medical education in dermatology leveraging generative artificial intelligence.NPJ digital medicine · 2025Article
- A Future of Self-Directed Patient Internet Research: Large Language Model-Based Tools Versus Standard Search Engines.Annals of biomedical engineering · 2025Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
4 authors.
Funding
Abstract
This study evaluates the accuracy of ChatGPT-4 and ChatGPT-4o in generating Breast Imaging Reporting and Data System (BI-RADS) scores from radiographic images. We tested both models using 77 breast cancer images from radiopaedia.org, including mammograms and ultrasounds. Images were analyzed in separate sessions to avoid bias. ChatGPT-4 and ChatGPT-4o achieved a 66.2 % accuracy across all BI-RADS cases. Performance was highest in BI-RADS 5 cases, with ChatGPT-4 and ChatGPT4o scoring 84.4 % and 88.9 %, respectively. However, both models struggled with BIRADS 1-3 cases, often assigning higher severity ratings. This study highlights the limitations of current LLMs in accurately grading these images and emphasizes the need for further research in these technologies before clinical integration.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.