Evidence map›Paper›PMID 37085837›Full record

Observational studyBMC medical education2023

Do clinical interview transcripts generated by speech recognition software improve clinical reasoning performance in mock patient encounters? A prospective observational study.

Kiyoshi Shikino, Tomoko Tsukamoto, Kazutaka Noda, Yoshiyuki Ohira, Daiki Yokokawa, Yuta Hirose, Eri Sato, Tsutomu Mito, Takahiro Ota, Yota Katsuyama and 2 more

Abstract readObservational Study
In one paragraph

Observational study in BMC medical education, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Kiyoshi ShikinoDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba City, Chiba Pref, Japan. kshikino@gmail.com.
Tomoko TsukamotoDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba City, Chiba Pref, Japan.
Kazutaka NodaDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba City, Chiba Pref, Japan.
Yoshiyuki OhiraDivision of General Internal Medicine, Department of Internal Medicine, St. Marianna University School of Medicine Hospital, Kawasaki, Japan.
Daiki YokokawaDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba City, Chiba Pref, Japan.
Yuta HiroseDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba City, Chiba Pref, Japan.
Eri SatoDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba City, Chiba Pref, Japan.
Tsutomu MitoDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba City, Chiba Pref, Japan.
Takahiro OtaDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba City, Chiba Pref, Japan.
Yota KatsuyamaDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba City, Chiba Pref, Japan.
Takanori UeharaDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba City, Chiba Pref, Japan.
Masatomi IkusakaDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba City, Chiba Pref, Japan.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundTo investigate whether speech recognition software for generating interview transcripts can provide more specific and precise feedback for evaluating medical interviews.

methodsThe effects of the two feedback methods on student performance in medical interviews were compared using a prospective observational trial. Seventy-nine medical students in a clinical clerkship were assigned to receive either speech-recognition feedback (n = 39; SRS feedback group) or voice-recording feedback (n = 40; IC recorder feedback group). All students' medical interviewing skills during mock patient encounters were assessed twice, first using a mini-clinical evaluation exercise (mini-CEX) and then a checklist. Medical students then made the most appropriate diagnoses based on medical interviews. The diagnostic accuracy, mini-CEX, and checklist scores of the two groups were compared.

resultsAccording to the study results, the mean diagnostic accuracy rate (SRS feedback group:1st mock 51.3%, 2nd mock 89.7%; IC recorder feedback group, 57.5%-67.5%; F(1, 77) = 4.0; p = 0.049), mini-CEX scores for overall clinical competence (SRS feedback group: 1st mock 5.2 ± 1.1, 2nd mock 7.4 ± 0.9; IC recorder feedback group: 1st mock 5.6 ± 1.4, 2nd mock 6.1 ± 1.2; F(1, 77) = 35.7; p < 0.001), and checklist scores for clinical performance (SRS feedback group: 1st mock 12.2 ± 2.4, 2nd mock 16.1 ± 1.7; IC recorder feedback group: 1st mock 13.1 ± 2.5, 2nd mock 13.8 ± 2.6; F(1, 77) = 26.1; p < 0.001) were higher with speech recognition-based feedback.

conclusionsSpeech-recognition-based feedback leads to higher diagnostic accuracy rates and higher mini-CEX and checklist scores.

trial registrationThis study was registered in the Japan Registry of Clinical Trials on June 14, 2022. Due to our misunderstanding of the trial registration requirements, we registered the trial retrospectively. This study was registered in the Japan Registry of Clinical Trials on 7/7/2022 (Clinical trial registration number: jRCT1030220188).

Indexed as

Educational MeasurementStudents, MedicalClinical CompetenceHumansRetrospective StudiesSpeech Recognition SoftwareFeedbackMedical interviewMini-CEXSRS

Identifiers

PMID37085837
PMCPMC10120240

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.