Evidence map›Paper›PMID 37234618›Full record

ReviewHeliyon2023

Essential properties and explanation effectiveness of explainable artificial intelligence in healthcare: A systematic review.

Jinsun Jung, Hyungbok Lee, Hyunggu Jung, Hyeoneui Kim

Abstract readReview
In one paragraph

Review in Heliyon, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
26citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

26 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Review
  6. Review
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Review
  13. Article
  14. Human-centered explainability evaluation in clinical decision-making: a critical review of the literature.Journal of the American Medical Informatics Association : JAMIA · 2025
    Review
  15. Prognostic Models in Heart Failure: Hope or Hype?Journal of personalized medicine · 2025
    Review
  16. Article
  17. Review
  18. Article
  19. Article
  20. Explainable AI for Clinical Outcome Prediction: A Survey of Clinician Perceptions and Preferences.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2025
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Jinsun JungCollege of Nursing, Seoul National University, Seoul, Republic of Korea.
Hyungbok LeeCollege of Nursing, Seoul National University, Seoul, Republic of Korea.
Hyunggu JungDepartment of Computer Science and Engineering, University of Seoul, Seoul, Republic of Korea.
Hyeoneui KimCollege of Nursing, Seoul National University, Seoul, Republic of Korea.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: Significant advancements in the field of information technology have influenced the creation of trustworthy explainable artificial intelligence (XAI) in healthcare. Despite improved performance of XAI, XAI techniques have not yet been integrated into real-time patient care. Objective: The aim of this systematic review is to understand the trends and gaps in research on XAI through an assessment of the essential properties of XAI and an evaluation of explanation effectiveness in the healthcare field. Methods: A search of PubMed and Embase databases for relevant peer-reviewed articles on development of an XAI model using clinical data and evaluating explanation effectiveness published between January 1, 2011, and April 30, 2022, was conducted. All retrieved papers were screened independently by the two authors. Relevant papers were also reviewed for identification of the essential properties of XAI (e.g., stakeholders and objectives of XAI, quality of personalized explanations) and the measures of explanation effectiveness (e.g., mental model, user satisfaction, trust assessment, task performance, and correctability). Results: Six out of 882 articles met the criteria for eligibility. Artificial Intelligence (AI) users were the most frequently described stakeholders. XAI served various purposes, including evaluation, justification, improvement, and learning from AI. Evaluation of the quality of personalized explanations was based on fidelity, explanatory power, interpretability, and plausibility. User satisfaction was the most frequently used measure of explanation effectiveness, followed by trust assessment, correctability, and task performance. The methods of assessing these measures also varied. Conclusion: XAI research should address the lack of a comprehensive and agreed-upon framework for explaining XAI and standardized approaches for evaluating the effectiveness of the explanation that XAI provides to diverse AI stakeholders.

Indexed as

Essential properties of XAIEvaluation of explanation effectivenessExplainable artificial intelligenceInterpretable artificial intelligence

Identifiers

PMID37234618
PMCPMC10205582

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.