Evidence map›Paper›PMID 35393566›Full record

ArticleNature biomedical engineering2022

A cost-aware framework for the development of AI models for healthcare applications.

Gabriel Erion, Joseph D Janizek, Carly Hudelson, Richard B Utarnachitt, Andrew M McCoy, Michael R Sayre, Nathan J White, Su-In Lee

Abstract read
In one paragraph

Article in Nature biomedical engineering, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Review
  6. Review
  7. Article
  8. Review
  9. Review
  10. Article
  11. Review
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Gabriel ErionPaul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, USA.ORCID http://orcid.org/0000-0001-8741-131X
Joseph D JanizekPaul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, USA.
Carly HudelsonDivision of General Internal Medicine, University of Washington, Seattle, WA, USA.
Richard B UtarnachittDepartment of Emergency Medicine, University of Washington, Seattle, WA, USA.
Andrew M McCoyDepartment of Emergency Medicine, University of Washington, Seattle, WA, USA.
Michael R SayreDepartment of Emergency Medicine, University of Washington, Seattle, WA, USA.
Nathan J WhiteDepartment of Emergency Medicine, University of Washington, Seattle, WA, USA. whiten4@uw.edu.
Su-In LeePaul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, USA. suinlee@cs.washington.edu.ORCID http://orcid.org/0000-0001-5833-5215

Funding

University of Washington Medical Scientist Training Program: MD/PhDT32GM007266 · NIGMS · UNIVERSITY OF WASHINGTON · PI HORWITZ, MARSHALL S. · 1985 to 2023
$30.4M
Interpretable Machine Learning to Identify Alzheimer's Disease Therapeutic TargetsR01AG061132 · NIA · UNIVERSITY OF WASHINGTON · PI LEE, SU-IN · 2019 to 2023
$2.9M
Opening the Black Box of Machine Learning ModelsR35GM128638 · NIGMS · UNIVERSITY OF WASHINGTON · PI LEE, SU-IN · 2018 to 2022
$1.9M
CoAI: Cost-Aware Artificial Intelligence for Efficient Prehospital Diagnosis of Trauma PatientsF30HL151074 · NHLBI · UNIVERSITY OF WASHINGTON · PI ERION BARNER, GABRIEL · 2020 to 2022
$144k
NHLBI NIH HHS F30 HL151074NIA NIH HHS R01 AG061132NIGMS NIH HHS R35 GM128638NIGMS NIH HHS T32 GM007266
6 · The paper itself

Abstract

Accurate artificial intelligence (AI) for disease diagnosis could lower healthcare workloads. However, when time or financial resources for gathering input data are limited, as in emergency and critical-care medicine, developing accurate AI models, which typically require inputs for many clinical variables, may be impractical. Here we report a model-agnostic cost-aware AI (CoAI) framework for the development of predictive models that optimize the trade-off between prediction performance and feature cost. By using three datasets, each including thousands of patients, we show that relative to clinical risk scores, CoAI substantially reduces the cost and improves the accuracy of predicting acute traumatic coagulopathy in a pre-hospital setting, mortality in intensive-care patients and mortality in outpatient settings. We also show that CoAI outperforms state-of-the-art cost-aware prediction strategies in terms of predictive performance, model cost, training time and robustness to feature-cost perturbations. CoAI uses axiomatic feature-attribution methods for the estimation of feature importance and decouples feature selection from model training, thus allowing for a faster and more flexible adaptation of AI models to new feature costs and prediction budgets.

Indexed as

Artificial IntelligenceHumansRisk Factors

Identifiers

PMID35393566
PMCPMC9537352

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.