Evidence map›Paper›PMID 39325508›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2024

Toward a responsible future: recommendations for AI-enabled clinical decision support.

Steven Labkoff, Bilikis Oladimeji, Joseph Kannry, Anthony Solomonides, Russell Leftwich, Eileen Koski, Amanda L Joseph, Monica Lopez-Gonzalez, Lee A Fleisher, Kimberly Nolen and 17 more

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 92 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
92citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

92 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Trial
  7. Trial
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Observational
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

32 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

27 authors.

Steven LabkoffQuantori, Boston, MA 02142, United States.ORCID 0000-0002-2337-5185
Bilikis OladimejiUnitedHealth Group, Minnetonka, MN, United States.ORCID 0000-0001-7349-3350
Joseph KannryDivision of General Internal Medicine, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States.ORCID 0000-0002-6089-1488
Anthony SolomonidesResearch Institute, Endeavor Health, Evanston, IL 60035, United States.ORCID 0000-0003-2117-2461
Russell LeftwichDepartment of Biomedical Informatics, Vanderbilt University, Nashville, TN, United States.ORCID 0009-0007-9722-5386
Eileen KoskiIBM Research, Yorktown Heights, NY, United States.ORCID 0000-0003-3621-9613
Amanda L JosephSchool of Health Information Science, University of Victoria, Victoria, BC, Canada.ORCID 0000-0002-5869-037X
Monica Lopez-GonzalezCognitive Insights for Artificial Intelligence, Baltimore, MD, United States.ORCID 0000-0001-9153-6852
Lee A FleisherAnesthesiology and Critical Care, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States.ORCID 0000-0003-2899-2294
Kimberly NolenPfizer Inc, New York, NY, United States.ORCID 0000-0001-8821-254X
Sayon DuttaDepartment of Emergency Medicine, Massachusetts General Hospital, Boston, MA, United States.ORCID 0000-0002-0381-6860
Deborah R LevyDepartment of Medicine, Pain Research Informatics Multimorbidities and Epidemiology (PRIME) Center, VA-Connecticut Healthcare System, West Haven, CT, United States.ORCID 0000-0002-7324-3455
Amy PriceThe Dartmouth Institute for Health Policy and Clinical Practice, Geisel School of Medicine at Dartmouth, Hanover, NH, United States.ORCID 0000-0002-5200-7322
Paul J BarrThe Dartmouth Institute for Health Policy and Clinical Practice, Geisel School of Medicine at Dartmouth, Hanover, NH, United States.ORCID 0000-0002-6868-7625
Jonathan D HronDepartment of Pediatrics, Division of General Pediatrics, Boston Children's Hospital, Boston, MA 02115, United States.ORCID 0000-0003-2198-6174
Baihan LinDepartments of AI, Psychiatry, and Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, United States.ORCID 0000-0002-7979-5509
Gyana SrivastavaDivision of Clinical Informatics, Department of Medicine, Beth Israel Deaconess Medical Center, Boston, MA 02215, United States.ORCID 0000-0002-7414-8062
Nuria PastorVitalera, Barcelona 08028, Spain.ORCID 0000-0003-3172-7459
Unai Sanchez LuqueVitalera, Barcelona 08028, Spain.ORCID 0000-0002-5262-8778
Tien Thi Thuy BuiMassachusetts College of Pharmacy and Health Sciences, Boston, MA, United States.ORCID 0009-0004-5283-8494
Reva SinghAmerican Medical Informatics Association, Washington, DC, United States.ORCID 0000-0002-1168-0983
Tayler WilliamsAmerican Medical Informatics Association, Washington, DC, United States.ORCID 0009-0008-4482-6556
Mark G WeinerDepartment of Population Health Sciences, Weill Cornell Medicine, New York, NY, United States.ORCID 0000-0001-5586-9940
Tristan NaumannMicrosoft Research, Redmond, WA, United States.ORCID 0000-0003-2150-1747
Dean F SittigDepartment of Clinical and Health Informatics, University of Texas Health Science Center, Houston, TX, United States.ORCID 0000-0001-5811-8915
Gretchen Purcell JacksonIntuitive Surgical, Nashville, TN, United States.ORCID 0000-0002-3242-8058
Yuri QuintanaDivision of Clinical Informatics, Department of Medicine, Beth Israel Deaconess Medical Center, Boston, MA 02215, United States.ORCID 0000-0001-6583-0257

Funding

Treatment Development & Evaluation CoreP30DA029926 · NIDA · DARTMOUTH COLLEGE · PI Lisa A. Marsch · 2011 to 2026
$21.5M
NIDA NIH HHS P30 DA029926
6 · The paper itself

Abstract

backgroundIntegrating artificial intelligence (AI) in healthcare settings has the potential to benefit clinical decision-making. Addressing challenges such as ensuring trustworthiness, mitigating bias, and maintaining safety is paramount. The lack of established methodologies for pre- and post-deployment evaluation of AI tools regarding crucial attributes such as transparency, performance monitoring, and adverse event reporting makes this situation challenging.

objectivesThis paper aims to make practical suggestions for creating methods, rules, and guidelines to ensure that the development, testing, supervision, and use of AI in clinical decision support (CDS) systems are done well and safely for patients. MATERIALS AND

methodsIn May 2023, the Division of Clinical Informatics at Beth Israel Deaconess Medical Center and the American Medical Informatics Association co-sponsored a working group on AI in healthcare. In August 2023, there were 4 webinars on AI topics and a 2-day workshop in September 2023 for consensus-building. The event included over 200 industry stakeholders, including clinicians, software developers, academics, ethicists, attorneys, government policy experts, scientists, and patients. The goal was to identify challenges associated with the trusted use of AI-enabled CDS in medical practice. Key issues were identified, and solutions were proposed through qualitative analysis and a 4-month iterative consensus process.

resultsOur work culminated in several key recommendations: (1) building safe and trustworthy systems; (2) developing validation, verification, and certification processes for AI-CDS systems; (3) providing a means of safety monitoring and reporting at the national level; and (4) ensuring that appropriate documentation and end-user training are provided. DISCUSSION: AI-enabled Clinical Decision Support (AI-CDS) systems promise to revolutionize healthcare decision-making, necessitating a comprehensive framework for their development, implementation, and regulation that emphasizes trustworthiness, transparency, and safety. This framework encompasses various aspects including model training, explainability, validation, certification, monitoring, and continuous evaluation, while also addressing challenges such as data privacy, fairness, and the need for regulatory oversight to ensure responsible integration of AI into clinical workflow.

conclusionsAchieving responsible AI-CDS systems requires a collective effort from many healthcare stakeholders. This involves implementing robust safety, monitoring, and transparency measures while fostering innovation. Future steps include testing and piloting proposed trust mechanisms, such as safety reporting protocols, and establishing best practice guidelines.

Indexed as

Artificial IntelligenceDecision Support Systems, ClinicalHumansalgorithmic transparencyartificial intelligenceclinical decision supportclinician AI competenciespatient safety

Identifiers

PMID39325508
PMCPMC11491642

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.