Evidence map›Paper›PMID 31651969›Full record

ArticleJAMA network open2019

Trends and Focus of Machine Learning Applications for Health Research.

Brett Beaulieu-Jones, Samuel G Finlayson, Corey Chivers, Irene Chen, Matthew McDermott, Jaz Kandola, Adrian V Dalca, Andrew Beam, Madalina Fiterau, Tristan Naumann

Abstract read
In one paragraph

Article in JAMA network open, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 32 papers.

0numbers the graph read from it
0cells of the map it votes in
32citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

32 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Observational
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2021
    Article
  19. Looking for clinician involvement under the wrong lamp post: The need for collaboration measures.Journal of the American Medical Informatics Association : JAMIA · 2021
    Article
  20. Evaluation of machine learning solutions in medicine.CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2021
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Brett Beaulieu-JonesDepartment of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts.
Samuel G FinlaysonHarvard Medical School, Boston, Massachusetts.
Corey ChiversPredictive Health Care Group, University of Pennsylvania Health System, Philadelphia.
Irene ChenMIT Computer Science and Artificial Intelligence Lab, Boston, Massachusetts.
Matthew McDermottMIT Computer Science and Artificial Intelligence Lab, Boston, Massachusetts.
Jaz KandolaDepartment of Medicine, Imperial College London, London, United Kingdom.
Adrian V DalcaDepartment of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts.
Andrew BeamDepartment of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts.
Madalina FiterauCollege of Information and Computer Sciences, University of Massachusetts, Amherst.
Tristan NaumannMicrosoft Research, Redmond, Washington.

Funding

Medical Scientist Training ProgramT32GM007753 · NIGMS · HARVARD UNIVERSITY (MEDICAL SCHOOL) · PI WALENSKY, LOREN DAVID · 1985 to 2021
$50.0M
RESEARCH TRAINING-MEDICAL INFORMATICS 90T15LM007092 · NLM · HARVARD UNIVERSITY (SCH OF PUBLIC HLTH) · PI Nils Gehlenborg · 1992 to 2026
$32.8M
Research ProjectP50MH106933 · NIMH · HARVARD MEDICAL SCHOOL · PI KOHANE, ISAAC S. · 2014 to 2018
$17.0M
Predicting Pulmonary and Cardiac Morbidity in Preterm Infants with Deep LearningK01HL141771 · NHLBI · HARVARD SCHOOL OF PUBLIC HEALTH · PI BEAM, ANDREW L. · 2019 to 2023
$832k
NHLBI NIH HHS K01 HL141771NIGMS NIH HHS T32 GM007753NIMH NIH HHS P50 MH106933NLM NIH HHS T15 LM007092
6 · The paper itself

Abstract

Importance: The use of machine learning applications related to health is rapidly increasing and may have the potential to profoundly affect the field of health care. Objective: To analyze submissions to a popular machine learning for health venue to assess the current state of research, including areas of methodologic and clinical focus, limitations, and underexplored areas. Design, Setting, and Participants: In this data-driven qualitative analysis, 166 accepted manuscript submissions to the Third Annual Machine Learning for Health workshop at the 32nd Conference on Neural Information Processing Systems on December 8, 2018, were analyzed to understand research focus, progress, and trends. Experts reviewed each submission against a rubric to identify key data points, statistical modeling and analysis of submitting authors was performed, and research topics were quantitatively modeled. Finally, an iterative discussion of topics common in submissions and invited speakers at the workshop was held to identify key trends. Main Outcomes and Measures: Frequency and statistical measures of methods, topics, goals, and author attributes were derived from an expert review of submissions guided by a rubric. Results: Of the 166 accepted submissions, 58 (34.9%) had clinician involvement and 83 submissions (50.0%) that focused on clinical practice included clinical collaborators. A total of 97 data sets (58.4%) used in submissions were publicly available or required a standard registration process. Clinical practice was the most common application area (70 manuscripts [42.2%]), with brain and mental health (25 [15.1%]), oncology (21 [12.7%]), and cardiovascular (19 [11.4%]) being the most common specialties. Conclusions and Relevance: Trends in machine learning for health research indicate the importance of well-annotated, easily accessed data and the benefit from greater clinician involvement in the development of translational applications.

Indexed as

Biomedical ResearchDelivery of Health CareHealth Services ResearchCongresses as TopicHumansMachine Learning

Identifiers

PMID31651969
PMCPMC6822089

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.