Evidence map›Paper›PMID 42018072›Full record

ArticleInsights into imaging2026

Comparative evaluation of large language models for generating CAD-RADS 2.0-compliant diagnostic conclusions in cardiac CT reports.

Giovanni Lorusso, Giorgio Ruscino, Alessia Spitaleri, Chiara Morelli, Sara Greco, Ilaria Villanova, Nicola Maria Lucarelli, Michele Mariano, Amato Antonio Stabile Ianora, Nicola Maggialetti

Abstract read
In one paragraph

Article in Insights into imaging, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Giovanni LorussoInterdisciplinary Department of Medicine, Section of Radiology and Radiation Oncology, University of Bari "Aldo Moro", Bari, Italy.
Giorgio RuscinoInterdisciplinary Department of Medicine, Section of Radiology and Radiation Oncology, University of Bari "Aldo Moro", Bari, Italy.
Alessia SpitaleriInterdisciplinary Department of Medicine, Section of Radiology and Radiation Oncology, University of Bari "Aldo Moro", Bari, Italy. alespita9.8med@gmail.com.ORCID http://orcid.org/0009-0009-5882-5316
Chiara MorelliInterdisciplinary Department of Medicine, Section of Radiology and Radiation Oncology, University of Bari "Aldo Moro", Bari, Italy.
Sara GrecoInterdisciplinary Department of Medicine, Section of Radiology and Radiation Oncology, University of Bari "Aldo Moro", Bari, Italy.
Ilaria VillanovaInterdisciplinary Department of Medicine, Section of Radiology and Radiation Oncology, University of Bari "Aldo Moro", Bari, Italy.
Nicola Maria LucarelliInterdisciplinary Department of Medicine, Section of Radiology and Radiation Oncology, University of Bari "Aldo Moro", Bari, Italy.
Michele MarianoInterdisciplinary Department of Medicine, Section of Radiology and Radiation Oncology, University of Bari "Aldo Moro", Bari, Italy.
Amato Antonio Stabile Ianora *Interdisciplinary Department of Medicine, Section of Radiology and Radiation Oncology, University of Bari "Aldo Moro", Bari, Italy.
Nicola Maggialetti *Interdisciplinary Department of Medicine, Section of Radiology and Radiation Oncology, University of Bari "Aldo Moro", Bari, Italy.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesCoronary computed tomography angiography (CCTA) has become a cornerstone in non-invasive CAD diagnosis and risk stratification. To standardize reporting and improve clinical decision-making, the CAD-RADS 2.0 system was introduced. This study evaluates the performance of four LLMs, GPT-4o, Gemini 2.0 Flash, DeepSeek V, and Copilot in generating CAD-RADS 2.0-compliant conclusions from standardized CCTA reports. MATERIALS AND

methodsA total of 196 anonymized CCTA reports were retrospectively analyzed. Each LLM was prompted to provide CAD-RADS 2.0 classifications and follow-up recommendations. Ground truth labels were assigned by a senior radiologist. Performance metrics (accuracy, precision, recall, F1-score), execution times, and agreement (Cohen's kappa) with expert interpretation were computed. Interobserver agreement between junior and senior radiologists was also assessed.

resultsLLMs demonstrated good-to-excellent agreement with expert classifications: DeepSeek V (κ = 0.771), Copilot (κ = 0.761), GPT-4o (κ = 0.759), and Gemini 2.0 Flash (κ = 0.634). DeepSeek V achieved the highest accuracy (91.83%). Intra-model consistency was perfect (κ = 1). However, LLMs failed to assign CAD-RADS modifiers. ChatGPT-4o provided the most accurate follow-up recommendations (71.94%). All LLMs outperformed radiologists in execution time (3-9 s vs. 15-20 s; p < 0.05).

conclusionsGeneric LLMs demonstrate promising performance in automating CAD-RADS 2.0 classification from CCTA reports. However, limitations in modifier assignment and recommendation accuracy highlight areas for refinement before clinical integration. CRITICAL RELEVANCE STATEMENT: This study explores the potential of large language models to facilitate standardized CAD-RADS 2.0 reporting from coronary CT angiography, highlighting a possible avenue to support workflow efficiency and clinical decision-making in non-invasive coronary artery disease evaluation. KEY POINTS: LLMs demonstrated strong potential in automating CAD-RADS 2.0-compliant structured reporting for CCTA. LLMs could significantly enhance efficiency in radiological reporting. LLMs need further optimization before clinical integration.

Indexed as

Artificial intelligence (AI) in medical reportingCAD-RADS 2.0Coronary computed tomography angiography (CCTA)Large language models (LLMs)Structured reporting

Identifiers

PMID42018072
PMCPMC13103109

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.