Evidence map›Paper›PMID 36624385›Full record

ArticleBMC bioinformatics2023

Negation detection in Dutch clinical texts: an evaluation of rule-based and machine learning methods.

Bram van Es, Leon C Reteig, Sander C Tan, Marijn Schraagen, Myrthe M Hemker, Sebastiaan R S Arends, Miguel A R Rios, Saskia Haitjema

Abstract read
In one paragraph

Article in BMC bioinformatics, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. A Large Language Model to Detect Negated Expressions in Radiology Reports.Journal of imaging informatics in medicine · 2025
    Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. The added value of text from Dutch general practitioner notes in predictive modeling.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Bram van EsCentral Diagnostic Laboratory, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands. b.vanes-3@umcutrecht.nl.
Leon C ReteigCenter for Translational Immunology, University Medical Center Utrecht, Utrecht, The Netherlands.
Sander C TanDepartment for Research & Data Technology, University Medical Center Utrecht, Utrecht, The Netherlands.
Marijn SchraagenInstitute for Information and Computing Sciences, Utrecht University, Utrecht, The Netherlands.
Myrthe M HemkerUtrecht Institute of Linguistics OTS & Department of Languages, Literature and Communication, Utrecht University, Utrecht, The Netherlands.
Sebastiaan R S ArendsDepartment of Medical Informatics, University of Amsterdam, Amsterdam, The Netherlands.
Miguel A R RiosCentre for Translation Studies, University of Vienna, Vienna, Austria.
Saskia HaitjemaCentral Diagnostic Laboratory, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

When developing models for clinical information retrieval and decision support systems, the discrete outcomes required for training are often missing. These labels need to be extracted from free text in electronic health records. For this extraction process one of the most important contextual properties in clinical text is negation, which indicates the absence of findings. We aimed to improve large scale extraction of labels by comparing three methods for negation detection in Dutch clinical notes. We used the Erasmus Medical Center Dutch Clinical Corpus to compare a rule-based method based on ContextD, a biLSTM model using MedCAT and (finetuned) RoBERTa-based models. We found that both the biLSTM and RoBERTa models consistently outperform the rule-based model in terms of F1 score, precision and recall. In addition, we systematically categorized the classification errors for each model, which can be used to further improve model performance in particular applications. Combining the three models naively was not beneficial in terms of performance. We conclude that the biLSTM and RoBERTa-based models in particular are highly accurate accurate in detecting clinical negations, but that ultimately all three approaches can be viable depending on the use case at hand.

Indexed as

Electronic Health RecordsMachine LearningInformation Storage and RetrievalNatural Language ProcessingNatural language processingNegation detectionText mining

Identifiers

PMID36624385
PMCPMC9830789

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.