Evidence map›Paper›PMID 29358159›Full record

ArticleJournal of medical Internet research2018

A Natural Language Processing System That Links Medical Terms in Electronic Health Record Notes to Lay Definitions: System Development Using Physician Reviews.

Jinying Chen, Emily Druhl, Balaji Polepalli Ramesh, Thomas K Houston, Cynthia A Brandt, Donna M Zulman, Varsha G Vimalananda, Samir Malkani, Hong Yu

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
26citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

26 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Trial
  5. Article
  6. Article
  7. Article
  8. Article
  9. README: Bridging Medical Jargon and Lay Understanding for Patient Education through Data-Centric NLP.Findings of ACL. EMNLP. Conference on Empirical Methods in Natural Language Processing · 2024
    Article
  10. Observational
  11. Article
  12. Article
  13. Article
  14. Article
  15. MedJEx: A Medical Jargon Extraction Model with Wiki's Hyperlink Span and Contextualized Masked Language Model Score.Proceedings of the Conference on Empirical Methods in Natural Language Processing. Conference on Empirical Methods in Natural Language Processing · 2022
    Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Jinying ChenDepartment of Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA, United States.ORCID 0000-0001-7259-4301
Emily DruhlBedford Veterans Affairs Medical Center, Center for Healthcare Organization and Implementation Research, Bedford, MA, United States.ORCID 0000-0003-3547-5359
Balaji Polepalli RameshOptum, Boston, MA, United States.ORCID 0000-0003-2885-9194
Thomas K HoustonDepartment of Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA, United States.ORCID 0000-0002-2909-4018
Cynthia A BrandtVeterans Affairs Connecticut Health Care System, West Haven, CT, United States.ORCID 0000-0001-8179-1796
Donna M ZulmanDivision of Primary Care and Population Health, Stanford University School of Medicine, Stanford, CA, United States.ORCID 0000-0001-8904-2810
Varsha G VimalanandaBedford Veterans Affairs Medical Center, Center for Healthcare Organization and Implementation Research, Bedford, MA, United States.ORCID 0000-0003-0738-672X
Samir MalkaniDiabetes Center of Excellence, University of Massachusetts Medical School, Worcester, MA, United States.ORCID 0000-0001-9076-4327
Hong YuDepartment of Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA, United States.ORCID 0000-0001-9263-5035

Funding

Yale Clinical and Translational Science Award (U Component)UL1TR001863 · NCATS · YALE UNIVERSITY · PI John H. Krystal, LUCILA OHNO-MACHADO · 2016 to 2026
$102.9M
Transdisciplinary Training In Cardiovascular ResearchT32HL120823 · NHLBI · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI DONAHUE, J KEVIN, KIEFE, CATARINA I. · 2014 to 2025
$3.9M
Resource Curation and Evaluation for EHR Note ComprehensionR01LM012817 · NLM · UNIVERSITY OF MASSACHUSETTS LOWELL · PI YU, HONG · 2018 to 2020
$1.0M
Systems for Helping Veterans Comprehend Electronic Health Record NotesI01HX001457 · VA · NORTHAMPTON VA MEDICAL CENTER · PI YU, HONG · 2015 to 2020
–
HSRD VA I01 HX001457NCATS NIH HHS UL1 TR001863NHLBI NIH HHS T32 HL120823NLM NIH HHS R01 LM012817
6 · The paper itself

Abstract

backgroundMany health care systems now allow patients to access their electronic health record (EHR) notes online through patient portals. Medical jargon in EHR notes can confuse patients, which may interfere with potential benefits of patient access to EHR notes.

objectiveThe aim of this study was to develop and evaluate the usability and content quality of NoteAid, a Web-based natural language processing system that links medical terms in EHR notes to lay definitions, that is, definitions easily understood by lay people.

methodsNoteAid incorporates two core components: CoDeMed, a lexical resource of lay definitions for medical terms, and MedLink, a computational unit that links medical terms to lay definitions. We developed innovative computational methods, including an adapted distant supervision algorithm to prioritize medical terms important for EHR comprehension to facilitate the effort of building CoDeMed. Ten physician domain experts evaluated the user interface and content quality of NoteAid. The evaluation protocol included a cognitive walkthrough session and a postsession questionnaire. Physician feedback sessions were audio-recorded. We used standard content analysis methods to analyze qualitative data from these sessions.

resultsPhysician feedback was mixed. Positive feedback on NoteAid included (1) Easy to use, (2) Good visual display, (3) Satisfactory system speed, and (4) Adequate lay definitions. Opportunities for improvement arising from evaluation sessions and feedback included (1) improving the display of definitions for partially matched terms, (2) including more medical terms in CoDeMed, (3) improving the handling of terms whose definitions vary depending on different contexts, and (4) standardizing the scope of definitions for medicines. On the basis of these results, we have improved NoteAid's user interface and a number of definitions, and added 4502 more definitions in CoDeMed.

conclusionsPhysician evaluation yielded useful feedback for content validation and refinement of this innovative tool that has the potential to improve patient EHR comprehension and experience using patient portals. Future ongoing work will develop algorithms to handle ambiguous medical terms and test and evaluate NoteAid with patients.

Indexed as

Electronic Health RecordsHumansNatural Language ProcessingPhysiciansPubMedUnified Medical Language Systemcomputer softwareconsumer health informaticselectronic health recordsnatural language processingusability testing

Identifiers

PMID29358159
PMCPMC5799720

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.