Evidence map›Paper›PMID 33983124›Full record

Trial reportJournal of medical Internet research2021

Evaluating the Effectiveness of NoteAid in a Community Hospital Setting: Randomized Trial of Electronic Health Record Note Comprehension Interventions With Patients.

John P Lalor, Wen Hu, Matthew Tran, Hao Wu, Kathleen M Mazor, Hong Yu

Abstract readRandomized Controlled Trial
In one paragraph

Trial report in Journal of medical Internet research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Article
  4. README: Bridging Medical Jargon and Lay Understanding for Patient Education through Data-Centric NLP.Findings of ACL. EMNLP. Conference on Empirical Methods in Natural Language Processing · 2024
    Article
  5. Observational
  6. Article
  7. MedJEx: A Medical Jargon Extraction Model with Wiki's Hyperlink Span and Contextualized Masked Language Model Score.Proceedings of the Conference on Empirical Methods in Natural Language Processing. Conference on Empirical Methods in Natural Language Processing · 2022
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

John P LalorDepartment of Information Technology, Analytics, and Operations, Mendoza College of Business, University of Notre Dame, Notre Dame, IN, United States.ORCID 0000-0003-0848-4786
Wen HuDepartment of Computer Science, University of Massachusetts Lowell, Lowell, MA, United States.ORCID 0000-0002-4523-6610
Matthew TranDepartment of Computer Science, University of Massachusetts Lowell, Lowell, MA, United States.ORCID 0000-0002-8164-8700
Hao WuDepartment of Psychology and Human Development, Peabody College, Vanderbilt University, Nashville, TN, United States.ORCID 0000-0001-6471-1774
Kathleen M MazorMeyers Primary Care Institute, University of Massachusetts Medical School/Reliant Medical Group/Fallon Health, Worcester, MA, United States.ORCID 0000-0002-9491-9872
Hong YuDepartment of Computer Science, University of Massachusetts Lowell, Lowell, MA, United States.ORCID 0000-0001-9263-5035

Funding

Resource Curation and Evaluation for EHR Note ComprehensionR01LM012817 · NLM · UNIVERSITY OF MASSACHUSETTS LOWELL · PI YU, HONG · 2018 to 2020
$1.0M
Systems for Helping Veterans Comprehend Electronic Health Record NotesI01HX001457 · VA · NORTHAMPTON VA MEDICAL CENTER · PI YU, HONG · 2015 to 2020
–
HSRD VA I01 HX001457NLM NIH HHS R01 LM012817
6 · The paper itself

Abstract

backgroundInterventions to define medical jargon have been shown to improve electronic health record (EHR) note comprehension among crowdsourced participants on Amazon Mechanical Turk (AMT). However, AMT participants may not be representative of the general population or patients who are most at-risk for low health literacy.

objectiveIn this work, we assessed the efficacy of an intervention (NoteAid) for EHR note comprehension among participants in a community hospital setting.

methodsParticipants were recruited from Lowell General Hospital (LGH), a community hospital in Massachusetts, to take the ComprehENotes test, a web-based test of EHR note comprehension. Participants were randomly assigned to control (n=85) or intervention (n=89) groups to take the test without or with NoteAid, respectively. For comparison, we used a sample of 200 participants recruited from AMT to take the ComprehENotes test (100 in the control group and 100 in the intervention group).

resultsA total of 174 participants were recruited from LGH, and 200 participants were recruited from AMT. Participants in both intervention groups (community hospital and AMT) scored significantly higher than participants in the control groups (P<.001). The average score for the community hospital participants was significantly lower than the average score for the AMT participants (P<.001), consistent with the lower education levels in the community hospital sample. Education level had a significant effect on scores for the community hospital participants (P<.001).

conclusionsUse of NoteAid was associated with significantly improved EHR note comprehension in both community hospital and AMT samples. Our results demonstrate the generalizability of ComprehENotes as a test of EHR note comprehension and the effectiveness of NoteAid for improving EHR note comprehension.

Indexed as

ComprehensionElectronic Health RecordsHospitals, CommunityHumanscomprehensioncrowdsourcingefficacyelectronic health recordhealth literacyinformation storage and retrievalinterventionliteracynatural language processingpsychometrics

Identifiers

PMID33983124
PMCPMC8160802

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.