Evidence map›Paper›PMID 30688652›Full record

ArticleJMIR public health and surveillance2019

Evaluating the Usefulness of Translation Technologies for Emergency Response Communication: A Scenario-Based Study.

Anne M Turner, Yong K Choi, Kristin Dew, Ming-Tse Tsai, Alyssa L Bosold, Shuyang Wu, Donahue Smith, Hendrika Meischke

Abstract read
In one paragraph

Article in JMIR public health and surveillance, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Leveraging Cultural-Language Translation Apps to Support and Promote Equitable Older Adult Care: A Scoping Review.Journal of applied gerontology : the official journal of the Southern Gerontological Society · 2026
    Review
  4. MedCOD: Enhancing English-to-Spanish Medical Translation of Large Language Models Using Enriched Chain-of-Dictionary Framework.Findings of ACL. EMNLP. Conference on Empirical Methods in Natural Language Processing · 2025
    Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Uncovering communication strategies used in language-discordant consultations with people who are migrants: Qualitative interviews with healthcare providers.Health expectations : an international journal of public participation in health care and health policy · 2024
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Anne M TurnerSchool of Public Health, Department of Health Services, University of Washington, Seattle, WA, United States.ORCID http://orcid.org/0000-0002-1915-016X
Yong K ChoiSchool of Medicine, Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, WA, United States.ORCID http://orcid.org/0000-0001-7882-4358
Kristin DewCollege of Engineering, Department of Human Centered Design and Engineering, University of Washington, Seattle, WA, United States.ORCID http://orcid.org/0000-0001-6365-9708
Ming-Tse TsaiSchool of Medicine, Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, WA, United States.ORCID http://orcid.org/0000-0002-0466-6737
Alyssa L BosoldSchool of Public Health, Department of Health Services, University of Washington, Seattle, WA, United States.ORCID http://orcid.org/0000-0002-7105-2188
Shuyang WuSchool of Medicine, Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, WA, United States.ORCID http://orcid.org/0000-0003-2792-8063
Donahue SmithSchool of Medicine, Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, WA, United States.ORCID http://orcid.org/0000-0002-2718-3965
Hendrika MeischkeSchool of Public Health, Department of Health Services, University of Washington, Seattle, WA, United States.ORCID http://orcid.org/0000-0001-7195-0028

Funding

University of Washington Biomedical Informatics and Data Science Research Training ProgramT15LM007442 · NLM · UNIVERSITY OF WASHINGTON · PI JOHN H. GENNARI, Andrea L. Hartzler · 2002 to 2026
$19.6M
NLM NIH HHS T15 LM007442
6 · The paper itself

Abstract

backgroundIn the United States, language barriers pose challenges to communication in emergency response and impact emergency care delivery and quality for individuals who are limited English proficient (LEP). There is a growing interest among Emergency Medical Services (EMS) personnel in using automated translation tools to improve communications with LEP individuals in the field. However, little is known about whether automated translation software can be used successfully in EMS settings to improve communication with LEP individuals.

objectiveThe objective of this work is to use scenario-based methods with EMS providers and nonnative English-speaking users who identified themselves as LEP (henceforth referred to as LEP participants) to evaluate the potential of two automated translation technologies in improving emergency communication.

methodsWe developed mock emergency scenarios and enacted them in simulation sessions with EMS personnel and Spanish-speaking and Chinese-speaking (Mandarin) LEP participants using two automated language translation tools: an EMS domain-specific fixed-sentence translation tool (QuickSpeak) and a statistical machine translation tool (Google Translate). At the end of the sessions, we gathered feedback from both groups through a postsession questionnaire. EMS participants also completed the System Usability Scale (SUS).

resultsWe conducted a total of 5 group sessions (3 Chinese and 2 Spanish) with 12 Chinese-speaking LEP participants, 14 Spanish-speaking LEP participants, and 17 EMS personnel. Overall, communications between EMS and LEP participants remained limited, even with the use of the two translation tools. QuickSpeak had higher mean SUS scores than Google Translate (65.3 vs 48.4; P=.04). Although both tools were deemed less than satisfactory, LEP participants showed preference toward the domain-specific system with fixed questions (QuickSpeak) over the free-text translation tool (Google Translate) in terms of understanding the EMS personnel's questions (Chinese 11/12, 92% vs 3/12, 25%; Spanish 12/14, 86% vs 4/14, 29%). While both EMS and LEP participants appreciated the flexibility of the free-text tool, multiple translation errors and difficulty responding to questions limited its usefulness.

conclusionsTechnologies are emerging that have the potential to assist with language translation in emergency response; however, improvements in accuracy and usability are needed before these technologies can be used safely in the field.

Indexed as

ChineseEmergency Medical Servicesemergency responselanguage barrierslanguage translationlimited English proficientpublic health informaticsSpanishtranslation technologies

Identifiers

PMID30688652
PMCPMC6369422

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.