Evidence map›Paper›PMID 39161978›Full record

ArticleMedical teacher2025

Utilizing natural language processing to analyze student narrative reflections for medical curriculum improvement.

Amy L Olex, Adam M Garber, Sally A Santen, Courtney Blondino, Stephanie Goldberg, Deborah DiazGranados

Abstract read
In one paragraph

Article in Medical teacher, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Amy L OlexC. Kenneth and Diane Wright Regional Center for Clinical and Translational Science, Virginia Commonwealth University, Richmond, Virginia, USA.ORCID 0000-0001-8064-521X
Adam M GarberDepartment of Internal Medicine, Virginia Commonwealth University School of Medicine, Richmond, Virginia, USA.ORCID 0000-0002-7296-2896
Sally A SantenDepartment of Emergency Medicine, Virginia Commonwealth University School of Medicine, Richmond, Virginia, USA.ORCID 0000-0002-8327-8002
Courtney BlondinoDepartment of Health Sciences, University of Richmond, Richmond, Virginia, USA.
Stephanie GoldbergDepartment of Surgery, Virginia Commonwealth University School of Medicine, Richmond, Virginia, USA.
Deborah DiazGranadosC. Kenneth and Diane Wright Regional Center for Clinical and Translational Science, Virginia Commonwealth University, Richmond, Virginia, USA.ORCID 0000-0002-0624-7093

Funding

Research Supplement to Promote Diversity in Health Related ResearchUL1TR002649 · NCATS · VIRGINIA COMMONWEALTH UNIVERSITY · PI MOELLER, FREDERICK GERARD · 2018 to 2022
$19.1M
Wright Regional Center for Clinical and Translational ScienceUM1TR004360 · NCATS · VIRGINIA COMMONWEALTH UNIVERSITY · PI FREDERICK Gerard MOELLER · 2023 to 2026
$16.3M
NCATS NIH HHS UL1 TR002649NCATS NIH HHS UM1 TR004360
6 · The paper itself

Abstract

motivationMedical curricula improvement is an ongoing process to keep material relevant and improve the student's learning experience to better prepare them for patient care. Many programs utilize end-of-year evaluations, but these frequently have low response rates and lack actionable feedback. We hypothesized that student reflections written during a fourth year Sub-Internship could be used retrospectively to mine additional information as feedback for future curriculum adjustments. However, reflections contain a large amount of narrative content that would require a cumbersome and essentially infeasible manual review process for busy medical education faculty.

methodsWe developed a Natural Language Processing (NLP) pipeline to automatically identify common themes and topics present in the set of reflective writings that could be used to improve the curriculum. The dataset contains required responses to a faculty issued question submitted between August 2016 and July 2018 about challenges experienced during the medical students fourth year Sub-Internship.

resultsEleven distinct topics were identified, with several being subsequently addressed in future iterations of the curriculum.

conclusionUtilizing NLP on reflective writings was able to identify areas of curriculum improvement, and the NLP results provided a quick and easy way to explore the main themes and challenges expressed by students.

Indexed as

CurriculumEducation, Medical, UndergraduateNarrationNatural Language ProcessingStudents, MedicalHumansWritingcurriculum assessment and evaluationNatural language processingstudent feedback

Identifiers

PMID39161978
PMCPMC11949084

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.