Evidence map›Paper›PMID 39259967›Full record

ArticleInteractive journal of medical research2024

Improving Triage Accuracy in Prehospital Emergency Telemedicine: Scoping Review of Machine Learning-Enhanced Approaches.

Daniel Raff, Kurtis Stewart, Michelle Christie Yang, Jessie Shang, Sonya Cressman, Roger Tam, Jessica Wong, Martin C Tammemägi, Kendall Ho

Abstract readScoping Review
In one paragraph

Article in Interactive journal of medical research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Multi-method approach to the development of contextual telephone triage systems.African journal of emergency medicine : Revue africaine de la medecine d'urgence · 2026
    Article
  8. Article
  9. Observational
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Daniel RaffDepartment of Family Practice, Faculty of Medicine, The University of British Columbia, Vancouver, BC, Canada.ORCID https://orcid.org/0009-0000-0640-6886
Kurtis StewartDepartment of Emergency Medicine, Faculty of Medicine, The University of British Columbia, Vancouver, BC, Canada.ORCID https://orcid.org/0000-0003-3730-9733
Michelle Christie YangDepartment of Emergency Medicine, Faculty of Medicine, The University of British Columbia, Vancouver, BC, Canada.ORCID https://orcid.org/0000-0001-6158-882X
Jessie ShangDepartment of Emergency Medicine, Faculty of Medicine, The University of British Columbia, Vancouver, BC, Canada.ORCID https://orcid.org/0009-0006-6398-7780
Sonya CressmanDepartment of Emergency Medicine, Faculty of Medicine, The University of British Columbia, Vancouver, BC, Canada.ORCID https://orcid.org/0000-0003-4769-8082
Roger TamSchool of Biomedical Engineering, Faculty of Applied Science, The University of British Columbia, Vancouver, BC, Canada.ORCID https://orcid.org/0000-0002-4593-2587
Jessica WongComputer Science, Faculty of Science, The University of British Columbia, Vancouver, BC, Canada.ORCID https://orcid.org/0009-0007-1256-3491
Martin C TammemägiFaculty of Applied Health Sciences, Brock University, St. Catharines, ON, Canada.ORCID https://orcid.org/0000-0002-4989-5058
Kendall HoDepartment of Emergency Medicine, Faculty of Medicine, The University of British Columbia, Vancouver, BC, Canada.ORCID https://orcid.org/0000-0002-4936-9031

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundPrehospital telemedicine triage systems combined with machine learning (ML) methods have the potential to improve triage accuracy and safely redirect low-acuity patients from attending the emergency department. However, research in prehospital settings is limited but needed; emergency department overcrowding and adverse patient outcomes are increasingly common.

objectiveIn this scoping review, we sought to characterize the existing methods for ML-enhanced telemedicine emergency triage. In order to support future research, we aimed to delineate what data sources, predictors, labels, ML models, and performance metrics were used, and in which telemedicine triage systems these methods were applied.

methodsA scoping review was conducted, querying multiple databases (MEDLINE, PubMed, Scopus, and IEEE Xplore) through February 24, 2023, to identify potential ML-enhanced methods, and for those eligible, relevant study characteristics were extracted, including prehospital triage setting, types of predictors, ground truth labeling method, ML models used, and performance metrics. Inclusion criteria were restricted to the triage of emergency telemedicine services using ML methods on an undifferentiated (disease nonspecific) population. Only primary research studies in English were considered. Furthermore, only those studies using data collected remotely (as opposed to derived from physical assessments) were included. In order to limit bias, we exclusively included articles identified through our predefined search criteria and had 3 researchers (DR, JS, and KS) independently screen the resulting studies. We conducted a narrative synthesis of findings to establish a knowledge base in this domain and identify potential gaps to be addressed in forthcoming ML-enhanced methods.

resultsA total of 165 unique records were screened for eligibility and 15 were included in the review. Most studies applied ML methods during emergency medical dispatch (7/15, 47%) or used chatbot applications (5/15, 33%). Patient demographics and health status variables were the most common predictors, with a notable absence of social variables. Frequently used ML models included support vector machines and tree-based methods. ML-enhanced models typically outperformed conventional triage algorithms, and we found a wide range of methods used to establish ground truth labels.

conclusionsThis scoping review observed heterogeneity in dataset size, predictors, clinical setting (triage process), and reported performance metrics. Standard structured predictors, including age, sex, and comorbidities, across articles suggest the importance of these inputs; however, there was a notable absence of other potentially useful data, including medications, social variables, and health system exposure. Ground truth labeling practices should be reported in a standard fashion as the true model performance hinges on these labels. This review calls for future work to form a standardized framework, thereby supporting consistent reporting and performance comparisons across ML-enhanced prehospital triage systems.

Indexed as

artificial intelligencechatbotemergency medicinemachine learningprehospitalscoping reviewtelemedicinetriage

Identifiers

PMID39259967
PMCPMC11429666

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.