Evidence map›Paper›PMID 36066959›Full record

ArticleJMIR mental health2022

The Use of Automated Machine Translation to Translate Figurative Language in a Clinical Setting: Analysis of a Convenience Sample of Patients Drawn From a Randomized Controlled Trial.

Hailee Tougas, Steven Chan, Tara Shahrvini, Alvaro Gonzalez, Ruth Chun Reyes, Michelle Burke Parish, Peter Yellowlees

Registry-linked trialAbstract read
PubMed Full text at PMC Publisher
In one paragraph

Article in JMIR mental health, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03538860 (A Clinical Trial to Validate an Automated Online Language Interpreting Tool With Hispanic Patients Who Have Limited English Proficiency - Phase Two.), which is not on this map. Cited by 6 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03538860 nacompletednot on this map

A Clinical Trial to Validate an Automated Online Language Interpreting Tool With Hispanic Patients Who Have Limited English Proficiency - Phase Two.

TypeinterventionalSponsorUniversity of California, DavisRan2017 to 2021Enrolled114ConditionsMood Disorder, Anxiety Disorder, Substance Use Disorder, Chronic Medical ConditionArmsActive comparator: Human interpreter, Intervention: Asynchronous Telepsychiatry
3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Review
  5. Asynchronous Technologies in Mental Health Care and Education.Current treatment options in psychiatry · 2023
    Review
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Hailee Tougas *Department of Psychiatry and Behavioral Sciences, University of California, Davis, Sacramento, CA, United States.ORCID https://orcid.org/0000-0001-5890-8802
Steven ChanDepartment of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, United States.ORCID https://orcid.org/0000-0002-1696-3122
Tara ShahrviniDepartment of Psychiatry and Behavioral Sciences, University of California, Davis, Sacramento, CA, United States.ORCID https://orcid.org/0000-0003-2178-170X
Alvaro GonzalezDepartment of Psychiatry and Behavioral Sciences, University of California, Davis, Sacramento, CA, United States.ORCID https://orcid.org/0000-0002-3787-5623
Ruth Chun ReyesDepartment of Psychiatry and Behavioral Sciences, University of California, Davis, Sacramento, CA, United States.ORCID https://orcid.org/0000-0002-0175-0247
Michelle Burke ParishDepartment of Psychiatry and Behavioral Sciences, University of California, Davis, Sacramento, CA, United States.ORCID https://orcid.org/0000-0001-6523-3401
Peter YellowleesDepartment of Psychiatry and Behavioral Sciences, University of California, Davis, Sacramento, CA, United States.ORCID https://orcid.org/0000-0002-5238-7468

Funding

A clinical trial to validate an automated online language interpreting tool with Hispanic patients who have limited English proficiencyR01HS024949 · AHRQ · UNIVERSITY OF CALIFORNIA AT DAVIS · PI YELLOWLEES, PETER M · 2016 to 2020
$1.9M
AHRQ HHS R01 HS024949
6 · The paper itself

Abstract

backgroundPatients with limited English proficiency frequently receive substandard health care. Asynchronous telepsychiatry (ATP) has been established as a clinically valid method for psychiatric assessments. The addition of automated speech recognition (ASR) and automated machine translation (AMT) technologies to asynchronous telepsychiatry may be a viable artificial intelligence (AI)-language interpretation option.

objectiveThis project measures the frequency and accuracy of the translation of figurative language devices (FLDs) and patient word count per minute, in a subset of psychiatric interviews from a larger trial, as an approximation to patient speech complexity and quantity in clinical encounters that require interpretation.

methodsA total of 6 patients were selected from the original trial, where they had undergone 2 assessments, once by an English-speaking psychiatrist through a Spanish-speaking human interpreter and once in Spanish by a trained mental health interviewer-researcher with AI interpretation. 3 (50%) of the 6 selected patients were interviewed via videoconferencing because of the COVID-19 pandemic. Interview transcripts were created by automated speech recognition with manual corrections for transcriptional accuracy and assessment for translational accuracy of FLDs.

resultsAI-interpreted interviews were found to have a significant increase in the use of FLDs and patient word count per minute. Both human and AI-interpreted FLDs were frequently translated inaccurately, however FLD translation may be more accurate on videoconferencing.

conclusionsAI interpretation is currently not sufficiently accurate for use in clinical settings. However, this study suggests that alternatives to human interpretation are needed to circumvent modifications to patients' speech. While AI interpretation technologies are being further developed, using videoconferencing for human interpreting may be more accurate than in-person interpreting.

trial registrationClinicalTrials.gov NCT03538860; https://clinicaltrials.gov/ct2/show/NCT03538860.

Indexed as

AIAI interpretationAMTartificial intelligenceASRassessmentasynchronous telepsychiatryATPautomatedautomated machine translationautomated speech recognitionautomated translationfigurative language deviceFLDlanguage barrierslanguage concordantlanguage discordantLEPlimited English proficiencypsychiatryspeech recognitiontelepsychiatrytranslation

Identifiers

PMID36066959
PMCPMC9490520

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.