Evidence map›Paper›PMID 33079589›Full record

ArticleCirculation. Cardiovascular quality and outcomes2020

Recommendations for Reporting Machine Learning Analyses in Clinical Research.

Laura M Stevens, Bobak J Mortazavi, Rahul C Deo, Lesley Curtis, David P Kao

Abstract read
In one paragraph

Article in Circulation. Cardiovascular quality and outcomes, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 150 papers, 11 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
150citing papers in PubMed, 11 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

150 citing papers in PubMed, 11 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Guideline
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Prognostic models for clinical outcomes in patients with venous leg ulcers: A systematic review.Journal of vascular surgery. Venous and lymphatic disorders · 2024
    Pooled it
  9. Pooled it
  10. Pooled it
  11. Pooled it
  12. Article
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

90 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

5 authors.

Laura M StevensDivision of Cardiology, University of Colorado School of Medicine, Aurora, CO (L.M.S., D.P.K.).
Bobak J MortazaviDepartment of Computer Science and Engineering, Texas A&M University, College Station, TX (B.J.M.).
Rahul C DeoDivision of Cardiovascular Medicine and One Brave Idea, Brigham and Women's Hospital, Boston, MA (R.C.D.).
Lesley CurtisDepartment of Population Health Sciences and Duke Clinical Research Institute, Duke University School of Medicine, Durham, NC (L.C.).
David P KaoDivision of Cardiology, University of Colorado School of Medicine, Aurora, CO (L.M.S., D.P.K.).

Funding

A Closed-Loop Integrated Framework for development of Novel Treatment Strategies in Heart Failure (CLIFFNOTES-HF)K08HL125725 · NHLBI · UNIVERSITY OF COLORADO DENVER · PI KAO, DAVID PETER · 2017 to 2021
$826k
NHLBI NIH HHS K08 HL125725NHLBI NIH HHS L30 HL110124
6 · The paper itself

Abstract

Use of machine learning (ML) in clinical research is growing steadily given the increasing availability of complex clinical data sets. ML presents important advantages in terms of predictive performance and identifying undiscovered subpopulations of patients with specific physiology and prognoses. Despite this popularity, many clinicians and researchers are not yet familiar with evaluating and interpreting ML analyses. Consequently, readers and peer-reviewers alike may either overestimate or underestimate the validity and credibility of an ML-based model. Conversely, ML experts without clinical experience may present details of the analysis that are too granular for a clinical readership to assess. Overwhelming evidence has shown poor reproducibility and reporting of ML models in clinical research suggesting the need for ML analyses to be presented in a clear, concise, and comprehensible manner to facilitate understanding and critical evaluation. We present a recommendation for transparent and structured reporting of ML analysis results specifically directed at clinical researchers. Furthermore, we provide a list of key reporting elements with examples that can be used as a template when preparing and submitting ML-based manuscripts for the same audience.

Indexed as

Biomedical ResearchMachine LearningPeriodicals as TopicResearch DesignData AccuracyData Interpretation, StatisticalEditorial PoliciesHumansbioinformaticsmachine learningprognosisreportreproducibilityresearch

Identifiers

PMID33079589
PMCPMC8320533

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.