Evidence map›Paper›PMID 35390006›Full record

ArticlePloS one2022

Expert-augmented automated machine learning optimizes hemodynamic predictors of spinal cord injury outcome.

Austin Chou, Abel Torres-Espin, Nikos Kyritsis, J Russell Huie, Sarah Khatry, Jeremy Funk, Jennifer Hay, Andrew Lofgreen, Rajiv Shah, Chandler McCann and 11 more

Erratum issuedAbstract read
In one paragraph

Article in PloS one, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 11 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Article
  4. Review
  5. Review
  6. Review
  7. Article
  8. Review
  9. Article
  10. Article
  11. Review
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

21 authors.

Austin ChouWeill Institute for Neurosciences, Brain and Spinal Injury Center, University of California, San Francisco (UCSF), San Francisco, California, United States of America.ORCID 0000-0003-4328-5811
Abel Torres-EspinWeill Institute for Neurosciences, Brain and Spinal Injury Center, University of California, San Francisco (UCSF), San Francisco, California, United States of America.
Nikos KyritsisWeill Institute for Neurosciences, Brain and Spinal Injury Center, University of California, San Francisco (UCSF), San Francisco, California, United States of America.
J Russell HuieWeill Institute for Neurosciences, Brain and Spinal Injury Center, University of California, San Francisco (UCSF), San Francisco, California, United States of America.
Sarah KhatryDataRobot, Inc., Boston, Massachusetts, United States of America.
Jeremy FunkDataRobot, Inc., Boston, Massachusetts, United States of America.
Jennifer HayDataRobot, Inc., Boston, Massachusetts, United States of America.
Andrew LofgreenDataRobot, Inc., Boston, Massachusetts, United States of America.
Rajiv ShahDataRobot, Inc., Boston, Massachusetts, United States of America.
Chandler McCannDataRobot, Inc., Boston, Massachusetts, United States of America.
Lisa U PascualOrthopedic Trauma Institute, Department of Orthopedic Surgery, University of California, San Francisco (UCSF), San Francisco, California, United States of America.
Edilberto AmorimZuckerberg San Francisco General Hospital and Trauma Center, San Francisco, California, United States of America.
Philip R WeinsteinDepartment of Neurological Surgery, University of California, San Francisco (UCSF), San Francisco, California, United States of America.
Geoffrey T ManleyWeill Institute for Neurosciences, Brain and Spinal Injury Center, University of California, San Francisco (UCSF), San Francisco, California, United States of America.
Sanjay S DhallWeill Institute for Neurosciences, Brain and Spinal Injury Center, University of California, San Francisco (UCSF), San Francisco, California, United States of America.
Jonathan Z PanWeill Institute for Neurosciences, Brain and Spinal Injury Center, University of California, San Francisco (UCSF), San Francisco, California, United States of America.
Jacqueline C BresnahanWeill Institute for Neurosciences, Brain and Spinal Injury Center, University of California, San Francisco (UCSF), San Francisco, California, United States of America.
Michael S BeattieWeill Institute for Neurosciences, Brain and Spinal Injury Center, University of California, San Francisco (UCSF), San Francisco, California, United States of America.ORCID 0000-0001-9463-3631
William D WhetstoneDepartment of Emergency Medicine, University of California, San Francisco (UCSF), San Francisco, California, United States of America.
Adam R FergusonWeill Institute for Neurosciences, Brain and Spinal Injury Center, University of California, San Francisco (UCSF), San Francisco, California, United States of America.ORCID 0000-0001-7102-1608
TRACK-SCI Investigators

Funding

Tools for Common Data Element Adoption in the Pan-Neurotrauma Data Commons (PANORAUMA)U24NS122732 · NINDS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI ADAM R FERGUSON, Jeffrey S. Grethe · 2021 to 2026
$5.0M
Maladaptive Plasticity in Spinal Cord Injury: Cellular MechanismsR01NS122888 · NINDS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI FERGUSON, ADAM R · 2021 to 2025
$3.0M
Maladaptive Plasticity in Spinal Cord Injury: Cellular MechanismsR01NS088475 · NINDS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI FERGUSON, ADAM R · 2015 to 2019
$1.7M
Translational Outcomes Project: Visualizing Syndromic Information and Outcomes for Neurotrauma (TOP-VISION)UH3NS106899 · NINDS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI BEATTIE, MICHAEL S, BRESNAHAN, JACQUELINE C · 2020 to 2022
$1.2M
Leveraging Heterogeneity in Preclinical Traumatic Brain Injury to Drive Discovery and ReproducibilityF32NS117728 · NINDS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI CHOU, AUSTIN C · 2020 to 2021
$115k
SCI Consortium Study: Harnessing big-data for plasticity and rehabilitation in translational SCII01RX002245 · VA · VETERANS AFFAIRS MED CTR SAN FRANCISCO · PI ADAM R FERGUSON · 2017 to 2026
–
NINDS NIH HHS F32 NS117728NINDS NIH HHS R01 NS088475NINDS NIH HHS R01 NS122888NINDS NIH HHS UH3 NS106899RRD VA I01 RX002245
6 · The paper itself

Abstract

Artificial intelligence and machine learning (AI/ML) is becoming increasingly more accessible to biomedical researchers with significant potential to transform biomedicine through optimization of highly-accurate predictive models and enabling better understanding of disease biology. Automated machine learning (AutoML) in particular is positioned to democratize artificial intelligence (AI) by reducing the amount of human input and ML expertise needed. However, successful translation of AI/ML in biomedicine requires moving beyond optimizing only for prediction accuracy and towards establishing reproducible clinical and biological inferences. This is especially challenging for clinical studies on rare disorders where the smaller patient cohorts and corresponding sample size is an obstacle for reproducible modeling results. Here, we present a model-agnostic framework to reinforce AutoML using strategies and tools of explainable and reproducible AI, including novel metrics to assess model reproducibility. The framework enables clinicians to interpret AutoML-generated models for clinical and biological verifiability and consequently integrate domain expertise during model development. We applied the framework towards spinal cord injury prognostication to optimize the intraoperative hemodynamic range during injury-related surgery and additionally identified a strong detrimental relationship between intraoperative hypertension and patient outcome. Furthermore, our analysis captured how evolving clinical practices such as faster time-to-surgery and blood pressure management affect clinical model development. Altogether, we illustrate how expert-augmented AutoML improves inferential reproducibility for biomedical discovery and can ultimately build trust in AI processes towards effective clinical integration.

Indexed as

Artificial IntelligenceSpinal Cord InjuriesHemodynamicsHumansMachine LearningReproducibility of Results

Identifiers

PMID35390006
PMCPMC8989303

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.