Evidence map›Paper›PMID 36525289›Full record

ArticleJMIR medical informatics2022

Implementation of Machine Learning Pipelines for Clinical Practice: Development and Validation Study.

Lara J Kanbar, Benjamin Wissel, Yizhao Ni, Nathan Pajor, Tracy Glauser, John Pestian, Judith W Dexheimer

Open access · goldAbstract read
In one paragraph

Article in JMIR medical informatics, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 1 pooled it
1.4field-weighted citation impact, top 17% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 1 synthesis or guideline pooled it, 24 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Applying Artificial Intelligence in Pediatric Clinical Trials: Potential Impacts and Obstacles.The journal of pediatric pharmacology and therapeutics : JPPT : the official journal of PPAG · 2024
    Article
  18. Review
  19. Review
  20. Development & Deployment of a Real-time Healthcare Predictive Analytics Platform.Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 1 institution in 1 country.

Lara J KanbarDivision of Pulmonary Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, United States.ORCID https://orcid.org/0000-0003-0395-5841
Benjamin WisselDivision of Biomedical Informatics, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, United States.ORCID https://orcid.org/0000-0002-8967-9296
Yizhao NiDivision of Biomedical Informatics, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, United States.ORCID https://orcid.org/0000-0001-8599-454X
Nathan PajorDivision of Pulmonary Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, United States.ORCID https://orcid.org/0000-0002-1637-4942
Tracy GlauserDepartment of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, OH, United States.ORCID https://orcid.org/0000-0003-1520-2732
John PestianDivision of Biomedical Informatics, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, United States.ORCID https://orcid.org/0000-0001-5998-249X
Judith W DexheimerDivision of Biomedical Informatics, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, United States.ORCID https://orcid.org/0000-0002-4196-7846
Cincinnati Children's Hospital Medical Center · US

Funding

Multi-Institutional Pediatric Epilepsy Decision SupportR01LM011124 · NLM · CINCINNATI CHILDRENS HOSP MED CTR · PI PESTIAN, JOHN P · 2011 to 2013
$955k
Machine Learning Approach to Identify Candidates for Epilepsy SurgeryF31NS115447 · NINDS · CINCINNATI CHILDRENS HOSP MED CTR · PI WISSEL, BENJAMIN DAVID · 2020 to 2021
$58k
AHRQ HHS R21 HS024977NINDS NIH HHS F31 NS115447NLM NIH HHS R01 LM011124
6 · The paper itself

Abstract

backgroundArtificial intelligence (AI) technologies, such as machine learning and natural language processing, have the potential to provide new insights into complex health data. Although powerful, these algorithms rarely move from experimental studies to direct clinical care implementation.

objectiveWe aimed to describe the key components for successful development and integration of two AI technology-based research pipelines for clinical practice.

methodsWe summarized the approach, results, and key learnings from the implementation of the following two systems implemented at a large, tertiary care children's hospital: (1) epilepsy surgical candidate identification (or epilepsy ID) in an ambulatory neurology clinic; and (2) an automated clinical trial eligibility screener (ACTES) for the real-time identification of patients for research studies in a pediatric emergency department.

resultsThe epilepsy ID system performed as well as board-certified neurologists in identifying surgical candidates (with a sensitivity of 71% and positive predictive value of 77%). The ACTES system decreased coordinator screening time by 12.9%. The success of each project was largely dependent upon the collaboration between machine learning experts, research and operational information technology professionals, longitudinal support from clinical providers, and institutional leadership.

conclusionsThese projects showcase novel interactions between machine learning recommendations and providers during clinical care. Our deployment provides seamless, real-time integration of AI technology to provide decision support and improve patient care.

Indexed as

artificial intelligenceclinical decision supportelectronic health recordemergency medicineepilepsymachine learningnatural language processing

Identifiers

PMID36525289
PMCPMC9804095
OpenAlexW4296523277

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.