Evidence map›Paper›PMID 35990013›Full record

ArticleFrontiers in digital health2022

An integration engineering framework for machine learning in healthcare.

Azadeh Assadi, Peter C Laussen, Andrew J Goodwin, Sebastian Goodfellow, William Dixon, Robert W Greer, Anusha Jegatheeswaran, Devin Singh, Melissa McCradden, Sara N Gallant and 3 more

Abstract read
In one paragraph

Article in Frontiers in digital health, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Machine Learning Operations in Health Care: A Scoping Review.Mayo Clinic proceedings. Digital health · 2024
    Review
  6. Review
  7. Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework.Journal of the American Medical Informatics Association : JAMIA · 2023
    Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Azadeh AssadiDepartment of Critical Care Medicine, Hospital for Sick Children, Toronto, ON, Canada.
Peter C LaussenInstitute of Medical Sciences, University of Toronto, Toronto, ON, Canada.
Andrew J GoodwinDepartment of Critical Care Medicine, Hospital for Sick Children, Toronto, ON, Canada.
Sebastian GoodfellowDepartment of Civil and Mineral Engineering, Faculty of Applied Science and Engineering, University of Toronto, Toronto, ON, Canada.
William DixonDepartment of Critical Care Medicine, Hospital for Sick Children, Toronto, ON, Canada.
Robert W GreerDepartment of Critical Care Medicine, Hospital for Sick Children, Toronto, ON, Canada.
Anusha JegatheeswaranDepartment of Surgery, Division of Paediatric Cardiac Surgery, Hospital for Sick Children, Toronto, ON, Canada.
Devin SinghTranslational Medicine, Peter Gilgan Centre for Research & Learning, Toronto, ON, Canada.
Melissa McCraddenDepartment of Bioethics, The Hospital for Sick Children, Toronto, ON, Canada.
Sara N GallantDepartment of Critical Care Medicine, Hospital for Sick Children, Toronto, ON, Canada.
Anna GoldenbergGenetics & Genome Biology, Peter Gilgan Centre for Research & Learning, Toronto, ON, Canada.
Danny EytanDepartment of Critical Care Medicine, Hospital for Sick Children, Toronto, ON, Canada.
Mjaye L MazwiDepartment of Critical Care Medicine, Hospital for Sick Children, Toronto, ON, Canada.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background and Objectives: Machine Learning offers opportunities to improve patient outcomes, team performance, and reduce healthcare costs. Yet only a small fraction of all Machine Learning models for health care have been successfully integrated into the clinical space. There are no current guidelines for clinical model integration, leading to waste, unnecessary costs, patient harm, and decreases in efficiency when improperly implemented. Systems engineering is widely used in industry to achieve an integrated Methods: Applied systems engineering, software engineering and health care Machine Learning software development practices were reviewed and critically appraised to establish an understanding of limitations and challenges within these domains. Principles of systems engineering were used to develop solutions to address the identified problems. The framework was then harmonized with the Machine Learning software development process to create a systems engineering-based Machine Learning software development approach in the healthcare domain. Results: We present an integration framework for healthcare Artificial Intelligence that considers the entirety of this Conclusion: Clinical models are technical systems that need to be integrated into the existing

Indexed as

artificial intelligencedigital healthhealthcare (MeSH)human factors engineering (HFE)Integration engineeringmachine learningsystem of systems (SoS)

Identifiers

PMID35990013
PMCPMC9386122

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.