ArticleLREC ... International Conference on Language Resources & Evaluation : [proceedings]. International Conference on Language Resources & Evaluation2022
Hierarchical Annotation for Building A Suite of Clinical Natural Language Processing Tasks: Progress Note Understanding.
Article in LREC ... International Conference on Language Resources & Evaluation : [proceedings]. International Conference on Language Resources & Evaluation, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
14 citing papers in PubMed.
- Proposed Context-of-Use Evaluation Framework for Medication Management Tasks Completed by Generative Artificial Intelligence.medRxiv : the preprint server for health sciences · 2026Article
- Dynamic few-shot prompting for clinical note section classification using lightweight, open-source large language models.Journal of the American Medical Informatics Association : JAMIA · 2025Article
- Twenty-first century management of diabetes with shared telemedicine appointments.Journal of telemedicine and telecare · 2025Review
- Current and future state of evaluation of large language models for medical summarization tasks.npj health systems · 2025Article
- Article
- Improving model transferability for clinical note section classification models using continued pretraining.Journal of the American Medical Informatics Association : JAMIA · 2023Article
- Overview of the Problem List Summarization (ProbSum) 2023 Shared Task on Summarizing Patients' Active Diagnoses and Problems from Electronic Health Record Progress Notes.Proceedings of the conference. Association for Computational Linguistics. Meeting · 2023Article
- Multi-Task Training with In-Domain Language Models for Diagnostic Reasoning.Proceedings of the conference. Association for Computational Linguistics. Meeting · 2023Article
- Improving the Transferability of Clinical Note Section Classification Models with BERT and Large Language Model Ensembles.Proceedings of the conference. Association for Computational Linguistics. Meeting · 2023Article
- Progress Note Understanding - Assessment and Plan Reasoning: Overview of the 2022 N2C2 Track 3 shared task.Journal of biomedical informatics · 2023Article
- A hybrid system to understand the relations between assessments and plans in progress notes.Journal of biomedical informatics · 2023Article
- Predicting relations between SOAP note sections: The value of incorporating a clinical information model.Journal of biomedical informatics · 2023Article
- Improving Model Transferability for Clinical Note Section Classification Models Using Continued Pretraining.medRxiv : the preprint server for health sciences · 2023Article
- DR.BENCH: Diagnostic Reasoning Benchmark for Clinical Natural Language Processing.Journal of biomedical informatics · 2023Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
7 authors.
Funding
Abstract
Applying methods in natural language processing on electronic health records (EHR) data is a growing field. Existing corpus and annotation focus on modeling textual features and relation prediction. However, there is a paucity of annotated corpus built to model clinical diagnostic thinking, a process involving text understanding, domain knowledge abstraction and reasoning. This work introduces a hierarchical annotation schema with three stages to address clinical text understanding, clinical reasoning, and summarization. We created an annotated corpus based on an extensive collection of publicly available daily progress notes, a type of EHR documentation that is collected in time series in a problem-oriented format. The conventional format for a progress note follows a Subjective, Objective, Assessment and Plan heading (SOAP). We also define a new suite of tasks, Progress Note Understanding, with three tasks utilizing the three annotation stages. The novel suite of tasks was designed to train and evaluate future NLP models for clinical text understanding, clinical knowledge representation, inference, and summarization.
Indexed as
Identifiers
35939277PMC9354726What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.