Evidence map›Paper›PMID 37195741›Full record

ArticleJournal of medical Internet research2023

Eliciting Insights From Chat Logs of the 25X5 Symposium to Reduce Documentation Burden: Novel Application of Topic Modeling.

Amanda J Moy, Jennifer Withall, Mollie Hobensack, Rachel Yeji Lee, Deborah R Levy, Sarah C Rossetti, S Trent Rosenbloom, Kevin Johnson, Kenrick Cato

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Amanda J MoyDepartment of Biomedical Informatics, Columbia University, New York, NY, United States.ORCID 0000-0003-2756-452X
Jennifer WithallSchool of Nursing, Columbia University, New York, NY, United States.ORCID 0000-0001-7984-6604
Mollie HobensackSchool of Nursing, Columbia University, New York, NY, United States.ORCID 0000-0003-2852-4175
Rachel Yeji LeeSchool of Nursing, Columbia University, New York, NY, United States.ORCID 0000-0002-0392-5848
Deborah R LevySchool of Medicine, Yale University, New Haven, CT, United States.ORCID 0000-0002-7324-3455
Sarah C RossettiDepartment of Biomedical Informatics, Columbia University, New York, NY, United States.ORCID 0000-0003-2632-8867
S Trent RosenbloomDepartment of Biomedical Informatics, Vanderbilt University, Nashville, TN, United States.ORCID 0000-0001-7455-2260
Kevin JohnsonDepartment of Biostatistics, Epidemiology and Informatics, University of Pennsylvania, Philadelphia, PA, United States.ORCID 0000-0003-1016-9363
Kenrick CatoSchool of Nursing, Columbia University, New York, NY, United States.ORCID 0000-0002-0704-3826

Funding

Training in Biomedical Informatics at Columbia UniversityT15LM007079 · NLM · COLUMBIA UNIV NEW YORK MORNINGSIDE · PI NOEMIE ELHADAD, GEORGE M HRIPCSAK · 1992 to 2026
$28.9M
Reducing Health Disparities Through Informatics - Genomics SupplementT32NR007969 · NINR · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI SUZANNE BAKKEN, Rebecca Schnall · 2002 to 2026
$7.9M
Communicating Narrative Concerns Entered by RNs (CONCERN)R01NR016941 · NINR · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI Kenrick Dwain Cato, Sarah Collins Rossetti · 2017 to 2026
$6.7M
Essential Nurse Documentation: Studying EHR Burden during COVID-19 (ENDBurden)R01HS028454 · AHRQ · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI ROSSETTI, SARAH COLLINS, YEN, PO-YIN · 2022 to 2025
$1.5M
25 by 5: Symposium to Reduce Documentation Burden on US Clinicians by 75% by 2025R13LM013581 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI ROSENBLOOM, S TRENT, ROSSETTI, SARAH COLLINS · 2020 to 2020
$18k
AHRQ HHS R01 HS028454NINR NIH HHS R01 NR016941NINR NIH HHS T32 NR007969NLM NIH HHS R13 LM013581NLM NIH HHS T15 LM007079
6 · The paper itself

Abstract

backgroundAddressing clinician documentation burden through "targeted solutions" is a growing priority for many organizations ranging from government and academia to industry. Between January and February 2021, the 25 by 5: Symposium to Reduce Documentation Burden on US Clinicians by 75% (25X5 Symposium) convened across 2 weekly 2-hour sessions among experts and stakeholders to generate actionable goals for reducing clinician documentation over the next 5 years. Throughout this web-based symposium, we passively collected attendees' contributions to a chat functionality-with their knowledge that the content would be deidentified and made publicly available. This presented a novel opportunity to synthesize and understand participants' perceptions and interests from chat messages. We performed a content analysis of 25X5 Symposium chat logs to identify themes about reducing clinician documentation burden.

objectiveThe objective of this study was to explore unstructured chat log content from the web-based 25X5 Symposium to elicit latent insights on clinician documentation burden among clinicians, health care leaders, and other stakeholders using topic modeling.

methodsAcross the 6 sessions, we captured 1787 messages among 167 unique chat participants cumulatively; 14 were private messages not included in the analysis. We implemented a latent Dirichlet allocation (LDA) topic model on the aggregated dataset to identify clinician documentation burden topics mentioned in the chat logs. Coherence scores and manual examination informed optimal model selection. Next, 5 domain experts independently and qualitatively assigned descriptive labels to model-identified topics and classified them into higher-level categories, which were finalized through a panel consensus.

resultsWe uncovered ten topics using the LDA model: (1) determining data and documentation needs (422/1773, 23.8%); (2) collectively reassessing documentation requirements in electronic health records (EHRs) (252/1773, 14.2%); (3) focusing documentation on patient narrative (162/1773, 9.1%); (4) documentation that adds value (147/1773, 8.3%); (5) regulatory impact on clinician burden (142/1773, 8%); (6) improved EHR user interface and design (128/1773, 7.2%); (7) addressing poor usability (122/1773, 6.9%); (8) sharing 25X5 Symposium resources (122/1773, 6.9%); (9) capturing data related to clinician practice (113/1773, 6.4%); and (10) the role of quality measures and technology in burnout (110/1773, 6.2%). Among these 10 topics, 5 high-level categories emerged: consensus building (821/1773, 46.3%), burden sources (365/1773, 20.6%), EHR design (250/1773, 14.1%), patient-centered care (162/1773, 9.1%), and symposium comments (122/1773, 6.9%).

conclusionsWe conducted a topic modeling analysis on 25X5 Symposium multiparticipant chat logs to explore the feasibility of this novel application and elicit additional insights on clinician documentation burden among attendees. Based on the results of our LDA analysis, consensus building, burden sources, EHR design, and patient-centered care may be important themes to consider when addressing clinician documentation burden. Our findings demonstrate the value of topic modeling in discovering topics associated with clinician documentation burden using unstructured textual content. Topic modeling may be a suitable approach to examine latent themes presented in web-based symposium chat logs.

Indexed as

Burnout, ProfessionalDelivery of Health CareDocumentationElectronic Health RecordsHumansburnoutchat botcontent analysisdocumentation burdennursesonline chatphysicianspolicysymposiumtopic modelingvirtual conference

Identifiers

PMID37195741
PMCPMC10233429

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.