Evidence map›Paper›PMID 41767180›Full record

ArticleJAMIA open2026

Interpretability of an FDA-authorized AI/ML sepsis diagnostic tool improved by SHAP values.

Gregory L Watson, Grace Staples, Robin Carver, Akhil Bhargava, Carlos López-Espina, Lee Schmalz, Farhan Ali, Peter S Antkowiak, Saleem Azad, Ramona Berghea and 41 more

Abstract read
In one paragraph

Article in JAMIA open, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Review
  2. Article
  3. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

51 authors.

Gregory L WatsonPrenosis, Inc., Chicago, IL, 60616, United States.ORCID https://orcid.org/0000-0001-7597-7359
Grace StaplesPrenosis, Inc., Chicago, IL, 60616, United States.
Robin CarverPrenosis, Inc., Chicago, IL, 60616, United States.
Akhil BhargavaPrenosis, Inc., Chicago, IL, 60616, United States.ORCID https://orcid.org/0009-0006-9314-0863
Carlos López-EspinaPrenosis, Inc., Chicago, IL, 60616, United States.ORCID https://orcid.org/0009-0006-7160-9835
Lee SchmalzPrenosis, Inc., Chicago, IL, 60616, United States.ORCID https://orcid.org/0009-0005-3231-4930
Farhan AliLifebridge Sinai Hospital, Baltimore, MD, 21215, United States.ORCID https://orcid.org/0009-0005-4370-1899
Peter S AntkowiakDepartment of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, MA, 02215, United States.ORCID https://orcid.org/0000-0002-6857-8277
Saleem AzadMercy Hospital Jefferson, Festus, MO, 63028, United States.ORCID https://orcid.org/0009-0005-5537-5082
Ramona BergheaCorewell Health William Beaumont University Hospital, Royal Oak, MI, 48073, United States.ORCID https://orcid.org/0009-0001-8344-4680
Lavneet ChawlaOSF Saint Francis Medical Center, Peoria, IL, 61637, United States.ORCID https://orcid.org/0009-0008-5983-2182
Matthew CrispMercy Hospital Jefferson, Festus, MO, 63028, United States.ORCID https://orcid.org/0009-0000-1130-8172
Alon DaganDepartment of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, MA, 02215, United States.ORCID https://orcid.org/0000-0002-3404-9983
Francisco DavilaCorewell Health William Beaumont University Hospital, Royal Oak, MI, 48073, United States.ORCID https://orcid.org/0000-0002-2539-3379
Hugo DavilaCorewell Health William Beaumont University Hospital, Royal Oak, MI, 48073, United States.ORCID https://orcid.org/0009-0003-0903-7096
Carmen DeMarcoCorewell Health William Beaumont University Hospital, Royal Oak, MI, 48073, United States.ORCID https://orcid.org/0009-0007-3881-0630
Amanda DoodlesackDepartment of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, MA, 02215, United States.ORCID https://orcid.org/0009-0005-9883-607X
Aimee EspinosaCorewell Health William Beaumont University Hospital, Royal Oak, MI, 48073, United States.ORCID https://orcid.org/0009-0009-7711-0981
Neil S EvansDavis School of Medicine, University of California, Sacramento, CA, 95817, United States.ORCID https://orcid.org/0000-0001-5602-2370
Clinton EzekielMercy Hospital Jefferson, Festus, MO, 63028, United States.ORCID https://orcid.org/0000-0003-4619-4253
Andrew FriederichOSF Saint Francis Medical Center, Peoria, IL, 61637, United States.ORCID https://orcid.org/0009-0002-9578-0750
Falgun GosaiOSF Saint Francis Medical Center, Peoria, IL, 61637, United States.ORCID https://orcid.org/0000-0002-5588-9463
Alexandra HalalauCorewell Health William Beaumont University Hospital, Royal Oak, MI, 48073, United States.ORCID https://orcid.org/0000-0001-6118-0357
Karthik IyerMercy Hospital Jefferson, Festus, MO, 63028, United States.ORCID https://orcid.org/0009-0001-5048-3026
Max S KravitzDepartment of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, MA, 02215, United States.ORCID https://orcid.org/0009-0009-1834-2221
Niko KurtzmanEmory School of Medicine, Atlanta, GA, 30322, United States.ORCID https://orcid.org/0000-0003-2251-2405
John H LeeDepartment of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, MA, 02215, United States.ORCID https://orcid.org/0000-0002-5442-4648
Nicholas MaddensCorewell Health William Beaumont University Hospital, Royal Oak, MI, 48073, United States.ORCID https://orcid.org/0009-0006-9998-1743
Roneil MalkaniJesse Brown VA Medical Center, Chicago, IL, 60612, United States.ORCID https://orcid.org/0000-0002-6712-4003
Stockton MayerJesse Brown VA Medical Center, Chicago, IL, 60612, United States.ORCID https://orcid.org/0000-0002-9688-5469
Vikram OkeMercy Hospital Jefferson, Festus, MO, 63028, United States.ORCID https://orcid.org/0000-0003-0305-0268
Ashok V PalagiriMercy Hospital, St. Louis, MO, 63141, United States.ORCID https://orcid.org/0009-0009-8998-1469
Roshni PatelJesse Brown VA Medical Center, Chicago, IL, 60612, United States.ORCID https://orcid.org/0000-0003-1493-8844
Lekshminarayan RaghavakurupLifebridge Sinai Hospital, Baltimore, MD, 21215, United States.ORCID https://orcid.org/0009-0009-9789-5974
Samuel RaoufLifebridge Sinai Hospital, Baltimore, MD, 21215, United States.ORCID https://orcid.org/0009-0006-5807-5613
Eric ReselandDepartment of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, MA, 02215, United States.ORCID https://orcid.org/0009-0002-6217-3559
Farid SadakaMercy Hospital Jefferson, Festus, MO, 63028, United States.ORCID https://orcid.org/0000-0003-1387-2513
Deesha SarmaDepartment of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, MA, 02215, United States.ORCID https://orcid.org/0000-0003-1970-9290
Scott SmithCorewell Health William Beaumont University Hospital, Royal Oak, MI, 48073, United States.ORCID https://orcid.org/0009-0002-6880-2520
Tatyana ShvilkinaDepartment of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, MA, 02215, United States.ORCID https://orcid.org/0009-0000-9951-6071
Matthew D SimsCorewell Health William Beaumont University Hospital, Royal Oak, MI, 48073, United States.ORCID https://orcid.org/0000-0002-4427-6653
Sahib SinghLifebridge Sinai Hospital, Baltimore, MD, 21215, United States.ORCID https://orcid.org/0000-0001-5660-782X
Bryan A StensonDepartment of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, MA, 02215, United States.ORCID https://orcid.org/0000-0003-2212-164X
Anwaruddin SyedOSF Saint Francis Medical Center, Peoria, IL, 61637, United States.ORCID https://orcid.org/0000-0001-9134-7840
Muleta TafaLifebridge Sinai Hospital, Baltimore, MD, 21215, United States.ORCID https://orcid.org/0009-0008-2687-5549
Kurian ThomasJesse Brown VA Medical Center, Chicago, IL, 60612, United States.ORCID https://orcid.org/0009-0005-9786-364X
Sihai Dave ZhaoDepartment of Statistics, University of Illinois at Urbana-Champaign, Urbana, IL, 61820, United States.ORCID https://orcid.org/0000-0001-5980-5071
Ruoqing ZhuDepartment of Statistics, University of Illinois at Urbana-Champaign, Urbana, IL, 61820, United States.ORCID https://orcid.org/0000-0002-0753-5716
Rashid BashirDepartment of Bioengineering, University of Illinois at Urbana-Champaign, Urbana, IL, 61801, United States.ORCID https://orcid.org/0000-0002-7225-9180
Bobby ReddyPrenosis, Inc., Chicago, IL, 60616, United States.ORCID https://orcid.org/0009-0007-2171-3295
Nathan I ShapiroPrenosis, Inc., Chicago, IL, 60616, United States.ORCID https://orcid.org/0000-0003-3508-4390

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Objectives: To assess the interpretability and acceptance of Shapley values for making artificial intelligence/machine learning (AI/ML) tools more transparent, interpretable, and useful to clinicians. Materials and Methods: Structured assessments were conducted with 30 clinicians (15 providers; 15 nurses; 8 assessments per clinician) to evaluate their ability to understand interventional Shapley Additive exPlanations (SHAP) values, a type of Shapley value that provides individualized variable importance scores and ascertain their perspective on SHAP value utility for the use of an AI/ML sepsis diagnostic. Participants were shown the diagnostic interface for real clinical scenarios with de-identified patient data with and without SHAP values. The primary outcomes were clinician ability to correctly interpret SHAP values and clinician self-reported improvement in their understanding of how the AI/ML algorithm produced its result. Results: Participants correctly interpreted SHAP values in 235 of 240 assessments (98%; CI, 95%-99%) and reported SHAP values improved their understanding of how the algorithm produced its result in every case (240/240; 100%; CI, 99%-100%). Participants were unanimous (30/30) in preferring the interface with SHAP values over the interface without. Discussion: Clinician participants strongly preferred the device interface with SHAP values, were unanimous in reporting SHAP values improved their understanding of the AI/ML diagnostic, and scored nearly perfectly when asked to interpret SHAP values. Conclusion: These results suggest health care providers value transparency into AI/ML algorithms designed for clinical use, and that Shapley values are a useful approach to providing that transparency, which in turn may improve tool adoption and clinical utility.

Indexed as

artificial intelligencemachine learningprecision medicinesepsistransparency

Identifiers

PMID41767180
PMCPMC12936051

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.