Evidence map›Paper›PMID 27986644›Full record

GuidelineJournal of medical Internet research2016

Guidelines for Developing and Reporting Machine Learning Predictive Models in Biomedical Research: A Multidisciplinary View.

Wei Luo, Dinh Phung, Truyen Tran, Sunil Gupta, Santu Rana, Chandan Karmakar, Alistair Shilton, John Yearwood, Nevenka Dimitrova, Tu Bao Ho and 2 more

2 registry-linked trialsAbstract readGuideline
In one paragraph

Guideline in Journal of medical Internet research, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 2 registered trials, which are not on this map. Cited by 510 papers, 11 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
510citing papers in PubMed, 11 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05150548 unknown statusnot on this mapstarted 2021, after this paper: background citation

Development and Internal Validation of Models to Predict Time-to-event for Major Medical Complications Within 30-days After Planned Colectomy: a Retrospective Population Cohort Study

TypeobservationalSponsorUniversity of British ColumbiaRan2021 to 2022Enrolled130,000ConditionsColorectal Cancer, Inflammatory Bowel Diseases, Diverticulitis, ColectomyArmsNo Intervention
NCT06158542 completednot on this mapstarted 2023, after this paper: background citation

Development of an Artificial Intelligence Algorithm to Predict Hypotension Risk After Induction in Cesarean Sections With Spinal Anesthesia

TypeobservationalSponsorHacettepe UniversityRan2023 to 2023Enrolled370ConditionsSpinal Anesthesia Induced Hypotension, Caeserian SectionArmsSpinal Anesthesia, Blood Sampling
3 · Its place in the literature

Who cites it

510 citing papers in PubMed, 11 syntheses or guidelines pooled it.

  1. Pooled it
  2. Guideline
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Machine Learning for Predicting Stillbirth: A Systematic Review.Reproductive sciences (Thousand Oaks, Calif.) · 2025
    Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Pooled it
  11. Pooled it
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article

450 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Wei LuoCentre for Pattern Recognition and Data Analytics, School of Information Technology, Deakin University, Geelong, Australia.ORCID 0000-0002-4711-7543
Dinh PhungDeakin University, Geelong, Australia.ORCID 0000-0002-9977-8247
Truyen TranDeakin University, Geelong, Australia.ORCID 0000-0001-6531-8907
Sunil GuptaDeakin University, Geelong, Australia.ORCID 0000-0002-3308-1930
Santu RanaDeakin University, Geelong, Australia.ORCID 0000-0003-2247-850X
Chandan KarmakarDeakin University, Geelong, Australia.ORCID 0000-0003-1814-0856
Alistair ShiltonDeakin University, Geelong, Australia.ORCID 0000-0002-0849-3271
John YearwoodDeakin University, Geelong, Australia.ORCID 0000-0002-7562-6767
Nevenka DimitrovaPhilips Research, Briarcliff Manor, NY, United States.ORCID 0000-0003-4091-9233
Tu Bao HoJapan Advanced Institute of Science and Technology, Nomi, Japan.ORCID 0000-0001-5951-643X
Svetha VenkateshDeakin University, Geelong, Australia.ORCID 0000-0001-8675-6631
Michael BerkDeakin University, Geelong, Australia.ORCID 0000-0002-5554-6946

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundAs more and more researchers are turning to big data for new opportunities of biomedical discoveries, machine learning models, as the backbone of big data analysis, are mentioned more often in biomedical journals. However, owing to the inherent complexity of machine learning methods, they are prone to misuse. Because of the flexibility in specifying machine learning models, the results are often insufficiently reported in research articles, hindering reliable assessment of model validity and consistent interpretation of model outputs.

objectiveTo attain a set of guidelines on the use of machine learning predictive models within clinical settings to make sure the models are correctly applied and sufficiently reported so that true discoveries can be distinguished from random coincidence.

methodsA multidisciplinary panel of machine learning experts, clinicians, and traditional statisticians were interviewed, using an iterative process in accordance with the Delphi method.

resultsThe process produced a set of guidelines that consists of (1) a list of reporting items to be included in a research article and (2) a set of practical sequential steps for developing predictive models.

conclusionsA set of guidelines was generated to enable correct application of machine learning models and consistent reporting of model specifications and results in biomedical research. We believe that such guidelines will accelerate the adoption of big data analysis, particularly with machine learning methods, in the biomedical research community.

Indexed as

Data Interpretation, StatisticalMachine LearningBiomedical ResearchHumansInterdisciplinary StudiesModels, Biologicalclinical prediction ruleguidelinemachine learning

Identifiers

PMID27986644
PMCPMC5238707

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.