Evidence map›Paper›PMID 37054961›Full record

ArticleJournal of biomedical informatics2023

A hybrid system to understand the relations between assessments and plans in progress notes.

Jifan Gao, Shilu He, Junjie Hu, Guanhua Chen

Abstract read
In one paragraph

Article in Journal of biomedical informatics, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Clinical natural language processing for secondary uses.Journal of biomedical informatics · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Jifan GaoDepartment of Biostatistics and Medical Informatics, University of Wisconsin-Madison, 610 Walnut St, Madison, 53726, WI, USA.
Shilu HeDepartment of Mathematics, University of Wisconsin-Madison, 480 Lincoln Dr, Madison, 53706, WI, USA.
Junjie HuDepartment of Biostatistics and Medical Informatics, University of Wisconsin-Madison, 610 Walnut St, Madison, 53726, WI, USA. Electronic address: junjie.hu@wisc.edu.
Guanhua ChenDepartment of Biostatistics and Medical Informatics, University of Wisconsin-Madison, 610 Walnut St, Madison, 53726, WI, USA. Electronic address: gchen25@wisc.edu.

Funding

University of Wisconsin Institute for Clinical and Translational ResearchUL1TR002373 · NCATS · UNIVERSITY OF WISCONSIN-MADISON · PI ELIZABETH S BURNSIDE, Allan R. Brasier · 2017 to 2026
$75.9M
NCATS NIH HHS UL1 TR002373
6 · The paper itself

Abstract

objectiveThe paper presents a novel solution to the 2022 National NLP Clinical Challenges (n2c2) Track 3, which aims to predict the relations between assessment and plan subsections in progress notes.

methodsOur approach goes beyond standard transformer models and incorporates external information such as medical ontology and order information to comprehend the semantics of progress notes. We fine-tuned transformers to understand the textual data and incorporated medical ontology concepts and their relationships to enhance the model's accuracy. We also captured order information that regular transformers cannot by taking into account the position of the assessment and plan subsections in progress notes.

resultsOur submission earned third place in the challenge phase with a macro-F1 score of 0.811. After refining our pipeline further, we achieved a macro-F1 of 0.826, outperforming the top-performing system during the challenge phase.

conclusionOur approach, which combines fine-tuned transformers, medical ontology, and order information, outperformed other systems in predicting the relationships between assessment and plan subsections in progress notes. This highlights the importance of incorporating external information beyond textual data in natural language processing (NLP) tasks related to medical documentation. Our work could potentially improve the efficiency and accuracy of progress note analysis.

Indexed as

Electronic Health RecordsSemanticsDocumentationNatural Language ProcessingRecordsCombinerMedical ontologyOrder informationProgress noteTransformers

Identifiers

PMID37054961
PMCPMC11449588

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.