Evidence map›Paper›PMID 41798256›Full record

ReviewMayo Clinic proceedings. Digital health2026

State of the AI: Post-Deployment Monitoring of Radiology-Focused Internally Developed AI.

Cole J Cook, Jason R Klug, Blaize W Kandler, Abraham Baez-Suarez, Adam P Dachowicz, Daniel J Blezek, Andrew D Missert, Gian Marco Conte, Justin D Benfield, Amanda Mensing-Diggs and 14 more

Abstract readReview
In one paragraph

Review in Mayo Clinic proceedings. Digital health, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

24 authors.

Cole J CookDepartment of Radiology, Mayo Clinic, Rochester, MN.
Jason R KlugDepartment of Radiology, Mayo Clinic, Rochester, MN.
Blaize W KandlerDepartment of Radiology, Mayo Clinic, Rochester, MN.
Abraham Baez-SuarezDepartment of Radiology, Mayo Clinic, Rochester, MN.
Adam P DachowiczDepartment of Radiology, Mayo Clinic, Rochester, MN.
Daniel J BlezekDepartment of Radiology, Mayo Clinic, Rochester, MN.
Andrew D MissertDepartment of Radiology, Mayo Clinic, Rochester, MN.
Gian Marco ConteDepartment of Radiology, Mayo Clinic, Rochester, MN.
Justin D BenfieldInformation Technology, Mayo Clinic, Rochester, MN.
Amanda Mensing-DiggsDepartment of Radiology, Mayo Clinic, Rochester, MN.
Matthew T EdwardsDepartment of Radiology, Mayo Clinic, Rochester, MN.
Michele A PowellDepartment of Radiology, Mayo Clinic, Rochester, MN.
Emily N SheedyDepartment of Radiology, Mayo Clinic, Rochester, MN.
Holly M MeyerDepartment of Radiology, Mayo Clinic, Rochester, MN.
Joseph MelnickCenter for Digital Health, Mayo Clinic, Rochester, MN.
Bryce F FlorCenter for Digital Health, Mayo Clinic, Rochester, MN.
David E VidalCenter for Digital Health, Mayo Clinic, Rochester, MN.
Vera SorinDepartment of Radiology, Mayo Clinic, Rochester, MN.
B Selnur ErdalDepartment of Radiology, Mayo Clinic, Jacksonville, FL.
Steve G LangerDepartment of Radiology, Mayo Clinic, Rochester, MN.
Jeremy D CollinsDepartment of Radiology, Mayo Clinic, Rochester, MN.
Eric E WilliamsonDepartment of Radiology, Mayo Clinic, Rochester, MN.
Panagiotis KorfiatisDepartment of Radiology, Mayo Clinic, Rochester, MN.
Timothy L KlineDepartment of Radiology, Mayo Clinic, Rochester, MN.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Articles on the development of medical image artificial intelligence (AI) algorithms are numerous in the literature, but deployment to clinical practice is infrequently discussed. The Enterprise Radiology Framework for AI Software Technology Team at Mayo Clinic has been focused on bridging the gap in clinical translation of medical image AI algorithms since its inception in 2019. During this time, we have released 17 algorithms into our radiology clinical practice. Recently, we have placed an increased focus on monitoring these algorithms, as there are few reports with practical experience documented in the literature. Our increased monitoring efforts include daily, weekly, and yearly monitoring of utilization, failure modes, data drift, and end-user feedback through automated alerts, dedicated dashboards, and pointed investigations to enable optimal algorithmic processing. End-user feedback is elicited yearly during annual reviews to ensure clinical needs are still being met. Automated monitoring has enabled earlier identification of problems, such as images no longer routing through the orchestration engine to the appropriate algorithm, minimizing potential disruption to the clinical practice and ensuring continued algorithmic utilization. Monitoring has also reinforced the importance of key aspects of interdisciplinary research and translation, such as early discussions on clinical needs coupled with technological ability and proper training. By providing our experience in and continuing to improve monitoring methods as a community, we can all minimize risk and maximize the benefits of medical pixel-based AI.

Identifiers

PMID41798256
PMCPMC12962146

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.