Evidence map›Paper›PMID 35179507›Full record

ArticleJMIR medical informatics2022

Evaluation of Natural Language Processing for the Identification of Crohn Disease-Related Variables in Spanish Electronic Health Records: A Validation Study for the PREMONITION-CD Project.

Carmen Montoto, Javier P Gisbert, Iván Guerra, Rocío Plaza, Ramón Pajares Villarroya, Luis Moreno Almazán, María Del Carmen López Martín, Mercedes Domínguez Antonaya, Isabel Vera Mendoza, Jesús Aparicio and 7 more

Open access · goldAbstract read
In one paragraph

Article in JMIR medical informatics, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed, 2 pooled it
2.5field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 2 syntheses or guidelines pooled it, 18 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Observational
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

17 authors at 10 institutions in 1 country.

Carmen MontotoTakeda Farmacéutica España S.A., Madrid, Spain.ORCID 0000-0003-3877-9462
Javier P GisbertHospital Universitario de La Princesa, Madrid, Spain.ORCID 0000-0003-2090-3445
Iván GuerraHospital Universitario de Fuenlabrada, Madrid, Spain.ORCID 0000-0002-5175-2515
Rocío PlazaHospital Universitario Infanta Leonor, Madrid, Spain.ORCID 0000-0003-0893-4599
Ramón Pajares VillarroyaHospital Universitario Infanta Sofía, Madrid, Spain.ORCID 0000-0003-0549-6036
Luis Moreno AlmazánHospital Universitario HM Montepríncipe, Madrid, Spain.ORCID 0000-0002-4914-0296
María Del Carmen López MartínHospital Universitario Infanta Elena, Madrid, Spain.ORCID 0000-0002-0517-8110
Mercedes Domínguez AntonayaHospital Universitario Rey Juan Carlos, Madrid, Spain.ORCID 0000-0002-0549-3495
Isabel Vera MendozaHospital Universitario Puerta de Hierro Majadahonda, Madrid, Spain.ORCID 0000-0002-3021-2413
Jesús AparicioTakeda Farmacéutica España S.A., Madrid, Spain.ORCID 0000-0002-4736-7999
Vicente MartínezTakeda Farmacéutica España S.A., Madrid, Spain.
Ignacio TagarroTakeda Farmacéutica España S.A., Madrid, Spain.ORCID 0000-0001-8975-0657
Alonso Fernandez-NistalTakeda Farmacéutica España S.A., Madrid, Spain.ORCID 0000-0002-5097-4474
Lea CanalesDepartment of Software and Computing System, University of Alicante, Alicante, Spain.ORCID 0000-0001-5018-5400
Sebastian MenkeMedSavana SL, Madrid, Spain.ORCID 0000-0002-2588-6405
Fernando GomollónHospital Clínico Universitario Lozano Blesa, Zaragoza, Spain.ORCID 0000-0003-0076-3529
PREMONITION-CD Study GroupSee Acknowledgements, .
Hospital Universitario Infanta Leonor · ESHospital Universitario de Fuenlabrada · ESHospital Universitario de La Princesa · ESHospital Universitario HM Madrid · ESHospital Universitario Infanta Sofía · ESHospital Universitario Puerta de Hierro Majadahonda · ESHospital Universitario Rey Juan Carlos · ESIE University · ESUniversidad de Zaragoza · ESUniversity of Alicante · ES

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe exploration of clinically relevant information in the free text of electronic health records (EHRs) holds the potential to positively impact clinical practice as well as knowledge regarding Crohn disease (CD), an inflammatory bowel disease that may affect any segment of the gastrointestinal tract. The EHRead technology, a clinical natural language processing (cNLP) system, was designed to detect and extract clinical information from narratives in the clinical notes contained in EHRs.

objectiveThe aim of this study is to validate the performance of the EHRead technology in identifying information of patients with CD.

methodsWe used the EHRead technology to explore and extract CD-related clinical information from EHRs. To validate this tool, we compared the output of the EHRead technology with a manually curated gold standard to assess the quality of our cNLP system in detecting records containing any reference to CD and its related variables.

resultsThe validation metrics for the main variable (CD) were a precision of 0.88, a recall of 0.98, and an F1 score of 0.93. Regarding the secondary variables, we obtained a precision of 0.91, a recall of 0.71, and an F1 score of 0.80 for CD flare, while for the variable vedolizumab (treatment), a precision, recall, and F1 score of 0.86, 0.94, and 0.90 were obtained, respectively.

conclusionsThis evaluation demonstrates the ability of the EHRead technology to identify patients with CD and their related variables from the free text of EHRs. To the best of our knowledge, this study is the first to use a cNLP system for the identification of CD in EHRs written in Spanish.

Indexed as

artificial intelligenceCrohn diseaseelectronic health recordsinflammatory bowel diseaselinguistic validationnatural language processing

Identifiers

PMID35179507
PMCPMC8900906
OpenAlexW4213157973

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.