Evidence map›Paper›PMID 39560483›Full record

Trial reportRadiology2024

Care to Explain? AI Explanation Types Differentially Impact Chest Radiograph Diagnostic Performance and Physician Trust in AI.

Drew Prinster, Amama Mahmood, Suchi Saria, Jean Jeudy, Cheng Ting Lin, Paul H Yi, Chien-Ming Huang

Abstract readMulticenter StudyRandomized Controlled Trial
In one paragraph

Trial report in Radiology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 25 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
25citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

25 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Review
  4. Article
  5. Article
  6. Beyond black-box AI: Comparing ChatGPT-4 interpretability and accuracy to CNNs in melanocytic lesions diagnosis.Journal der Deutschen Dermatologischen Gesellschaft = Journal of the German Society of Dermatology : JDDG · 2026
    Article
  7. Review
  8. Explainability in context: calibrating appropriate trust and reliance in artificial intelligence.Journal of the American Medical Informatics Association : JAMIA · 2026
    Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Intelligent Reasoning Cues: A Framework and Case Study of the Roles of AI Information in Complex Decisions.Proceedings of the SIGCHI conference on human factors in computing systems. CHI Conference · 2026
    Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Drew Prinster *From the Department of Computer Science, Johns Hopkins University, 3400 N Charles St, Baltimore, MD 21218 (D.P., A.M., S.S., C.M.H.); Bayesian Health, New York, NY (S.S.); Department of Diagnostic Radiology, University of Maryland School of Medicine, Baltimore, Md (J.J., P.H.Y.); Department of Radiology, St Jude Children's Research Hospital, Memphis, Tenn (P.H.Y.); and Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, Md (C.T.L.).ORCID 0000-0003-3607-4493
Amama Mahmood *From the Department of Computer Science, Johns Hopkins University, 3400 N Charles St, Baltimore, MD 21218 (D.P., A.M., S.S., C.M.H.); Bayesian Health, New York, NY (S.S.); Department of Diagnostic Radiology, University of Maryland School of Medicine, Baltimore, Md (J.J., P.H.Y.); Department of Radiology, St Jude Children's Research Hospital, Memphis, Tenn (P.H.Y.); and Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, Md (C.T.L.).ORCID 0000-0001-5044-1494
Suchi SariaFrom the Department of Computer Science, Johns Hopkins University, 3400 N Charles St, Baltimore, MD 21218 (D.P., A.M., S.S., C.M.H.); Bayesian Health, New York, NY (S.S.); Department of Diagnostic Radiology, University of Maryland School of Medicine, Baltimore, Md (J.J., P.H.Y.); Department of Radiology, St Jude Children's Research Hospital, Memphis, Tenn (P.H.Y.); and Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, Md (C.T.L.).
Jean JeudyFrom the Department of Computer Science, Johns Hopkins University, 3400 N Charles St, Baltimore, MD 21218 (D.P., A.M., S.S., C.M.H.); Bayesian Health, New York, NY (S.S.); Department of Diagnostic Radiology, University of Maryland School of Medicine, Baltimore, Md (J.J., P.H.Y.); Department of Radiology, St Jude Children's Research Hospital, Memphis, Tenn (P.H.Y.); and Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, Md (C.T.L.).ORCID 0000-0002-6028-459X
Cheng Ting LinFrom the Department of Computer Science, Johns Hopkins University, 3400 N Charles St, Baltimore, MD 21218 (D.P., A.M., S.S., C.M.H.); Bayesian Health, New York, NY (S.S.); Department of Diagnostic Radiology, University of Maryland School of Medicine, Baltimore, Md (J.J., P.H.Y.); Department of Radiology, St Jude Children's Research Hospital, Memphis, Tenn (P.H.Y.); and Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, Md (C.T.L.).ORCID 0000-0003-0275-8037
Paul H Yi *From the Department of Computer Science, Johns Hopkins University, 3400 N Charles St, Baltimore, MD 21218 (D.P., A.M., S.S., C.M.H.); Bayesian Health, New York, NY (S.S.); Department of Diagnostic Radiology, University of Maryland School of Medicine, Baltimore, Md (J.J., P.H.Y.); Department of Radiology, St Jude Children's Research Hospital, Memphis, Tenn (P.H.Y.); and Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, Md (C.T.L.).ORCID 0000-0001-9433-8093
Chien-Ming Huang *From the Department of Computer Science, Johns Hopkins University, 3400 N Charles St, Baltimore, MD 21218 (D.P., A.M., S.S., C.M.H.); Bayesian Health, New York, NY (S.S.); Department of Diagnostic Radiology, University of Maryland School of Medicine, Baltimore, Md (J.J., P.H.Y.); Department of Radiology, St Jude Children's Research Hospital, Memphis, Tenn (P.H.Y.); and Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, Md (C.T.L.).ORCID 0000-0002-6838-3701

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background It is unclear whether artificial intelligence (AI) explanations help or hurt radiologists and other physicians in AI-assisted radiologic diagnostic decision-making. Purpose To test whether the type of AI explanation and the correctness and confidence level of AI advice impact physician diagnostic performance, perception of AI advice usefulness, and trust in AI advice for chest radiograph diagnosis. Materials and Methods A multicenter, prospective randomized study was conducted from April 2022 to September 2022. Two types of AI explanations prevalent in medical imaging-local (feature-based) explanations and global (prototype-based) explanations-were a between-participant factor, while AI correctness and confidence were within-participant factors. Radiologists (task experts) and internal or emergency medicine physicians (task nonexperts) received a chest radiograph to read; then, simulated AI advice was presented. Generalized linear mixed-effects models were used to analyze the effects of the experimental variables on diagnostic accuracy, efficiency, physician perception of AI usefulness, and "simple trust" (ie, speed of alignment with or divergence from AI advice); the control variables included knowledge of AI, demographic characteristics, and task expertise. Holm-Sidak corrections were used to adjust for multiple comparisons. Results Data from 220 physicians (median age, 30 years [IQR, 28-32.75 years]; 146 male participants) were analyzed. Compared with global AI explanations, local AI explanations yielded better physician diagnostic accuracy when the AI advice was correct (β = 0.86;

Indexed as

Artificial IntelligenceRadiography, ThoracicTrustAdultClinical CompetenceClinical Decision-MakingFemaleHumansMaleMiddle AgedPhysiciansProspective Studies

Identifiers

PMID39560483
PMCPMC11605106

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.