Evidence map›Paper›PMID 36394938›Full record

ArticleJMIR medical informatics2022

Perspective Toward Machine Learning Implementation in Pediatric Medicine: Mixed Methods Study.

Natasha Alexander, Catherine Aftandilian, Lin Lawrence Guo, Erin Plenert, Jose Posada, Jason Fries, Scott Fleming, Alistair Johnson, Nigam Shah, Lillian Sung

Abstract read
In one paragraph

Article in JMIR medical informatics, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Review
  3. Review
  4. Article
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Natasha AlexanderDivision of Haematology/Oncology, The Hospital for Sick Children, Toronto, ON, Canada.ORCID https://orcid.org/0000-0002-0151-7277
Catherine AftandilianDivision of Hematology/Oncology, Department of Pediatrics, Stanford University, Palo Alto, CA, United States.ORCID https://orcid.org/0000-0001-9775-2839
Lin Lawrence GuoProgram in Child Health Evaluative Sciences, Peter Gilgan Centre for Research and Learning, Toronto, ON, Canada.ORCID https://orcid.org/0000-0002-2965-8442
Erin PlenertProgram in Child Health Evaluative Sciences, Peter Gilgan Centre for Research and Learning, Toronto, ON, Canada.ORCID https://orcid.org/0000-0002-0675-882X
Jose PosadaDepartment of Systems Engineering and Computing, Universidad del Norte, Barranquilla, Colombia.ORCID https://orcid.org/0000-0003-3864-0241
Jason FriesStanford Center for Biomedical Informatics Research, Department of Biomedical Data Science, Stanford University, Palo Alto, CA, United States.ORCID https://orcid.org/0000-0001-9316-5768
Scott FlemingStanford Center for Biomedical Informatics Research, Department of Biomedical Data Science, Stanford University, Palo Alto, CA, United States.ORCID https://orcid.org/0000-0002-6047-7877
Alistair JohnsonProgram in Child Health Evaluative Sciences, Peter Gilgan Centre for Research and Learning, Toronto, ON, Canada.ORCID https://orcid.org/0000-0002-8735-3014
Nigam ShahStanford Center for Biomedical Informatics Research, Department of Biomedical Data Science, Stanford University, Palo Alto, CA, United States.ORCID https://orcid.org/0000-0001-9385-7158
Lillian SungDivision of Haematology/Oncology, The Hospital for Sick Children, Toronto, ON, Canada.ORCID https://orcid.org/0000-0003-0951-3091

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundGiven the costs of machine learning implementation, a systematic approach to prioritizing which models to implement into clinical practice may be valuable.

objectiveThe primary objective was to determine the health care attributes respondents at 2 pediatric institutions rate as important when prioritizing machine learning model implementation. The secondary objective was to describe their perspectives on implementation using a qualitative approach.

methodsIn this mixed methods study, we distributed a survey to health system leaders, physicians, and data scientists at 2 pediatric institutions. We asked respondents to rank the following 5 attributes in terms of implementation usefulness: the clinical problem was common, the clinical problem caused substantial morbidity and mortality, risk stratification led to different actions that could reasonably improve patient outcomes, reducing physician workload, and saving money. Important attributes were those ranked as first or second most important. Individual qualitative interviews were conducted with a subsample of respondents.

resultsAmong 613 eligible respondents, 275 (44.9%) responded. Qualitative interviews were conducted with 17 respondents. The most common important attributes were risk stratification leading to different actions (205/275, 74.5%) and clinical problem causing substantial morbidity or mortality (177/275, 64.4%). The attributes considered least important were reducing physician workload and saving money. Qualitative interviews consistently prioritized implementations that improved patient outcomes.

conclusionsRespondents prioritized machine learning model implementation where risk stratification would lead to different actions and clinical problems that caused substantial morbidity and mortality. Implementations that improved patient outcomes were prioritized. These results can help provide a framework for machine learning model implementation.

Indexed as

clinical utilizationmachine learningpreferencesqualitative interviews

Identifiers

PMID36394938
PMCPMC9716421

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.