Evidence map›Paper›PMID 38002431›Full record

ArticleBioengineering (Basel, Switzerland)2023

Development and Evaluation of a Natural Language Processing System for Curating a Trans-Thoracic Echocardiogram (TTE) Database.

Tim Dong, Nicholas Sunderland, Angus Nightingale, Daniel P Fudulu, Jeremy Chan, Ben Zhai, Alberto Freitas, Massimo Caputo, Arnaldo Dimagli, Stuart Mires and 3 more

Open access · goldAbstract read
In one paragraph

Article in Bioengineering (Basel, Switzerland), 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed, 1 pooled it
3.1field-weighted citation impact, top 7% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed, 1 synthesis or guideline pooled it, 18 citations in OpenAlex.

  1. Guideline
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors at 4 institutions in 2 countries.

Tim DongBristol Heart Institute, Translational Health Sciences, University of Bristol, Bristol BS2 8HW, UK.ORCID 0000-0003-1953-0063
Nicholas SunderlandBristol Heart Institute, Translational Health Sciences, University of Bristol, Bristol BS2 8HW, UK.
Angus NightingaleBristol Heart Institute, Translational Health Sciences, University of Bristol, Bristol BS2 8HW, UK.ORCID 0000-0001-9435-726X
Daniel P FuduluBristol Heart Institute, Translational Health Sciences, University of Bristol, Bristol BS2 8HW, UK.
Jeremy ChanBristol Heart Institute, Translational Health Sciences, University of Bristol, Bristol BS2 8HW, UK.
Ben ZhaiSchool of Computing Science, Northumbria University, Newcastle upon Tyne NE1 8ST, UK.
Alberto FreitasFaculty of Medicine, University of Porto, 4100 Porto, Portugal.ORCID 0000-0003-2113-9653
Massimo CaputoBristol Heart Institute, Translational Health Sciences, University of Bristol, Bristol BS2 8HW, UK.
Arnaldo DimagliBristol Heart Institute, Translational Health Sciences, University of Bristol, Bristol BS2 8HW, UK.
Stuart MiresBristol Heart Institute, Translational Health Sciences, University of Bristol, Bristol BS2 8HW, UK.
Mike WyattUniversity Hospitals Bristol and Weston, Marlborough St, Bristol BS1 3NU, UK.
Umberto BenedettoBristol Heart Institute, Translational Health Sciences, University of Bristol, Bristol BS2 8HW, UK.
Gianni D AngeliniBristol Heart Institute, Translational Health Sciences, University of Bristol, Bristol BS2 8HW, UK.
University of Bristol · GBNorthumbria University · GBUniversidade do Porto · PTUniversity Hospitals Bristol NHS Foundation Trust · GB

Funding

British Heart Foundation CH/17/1/32804
6 · The paper itself

Abstract

backgroundAlthough electronic health records (EHR) provide useful insights into disease patterns and patient treatment optimisation, their reliance on unstructured data presents a difficulty. Echocardiography reports, which provide extensive pathology information for cardiovascular patients, are particularly challenging to extract and analyse, because of their narrative structure. Although natural language processing (NLP) has been utilised successfully in a variety of medical fields, it is not commonly used in echocardiography analysis.

objectivesTo develop an NLP-based approach for extracting and categorising data from echocardiography reports by accurately converting continuous (e.g., LVOT VTI, AV VTI and TR Vmax) and discrete (e.g., regurgitation severity) outcomes in a semi-structured narrative format into a structured and categorised format, allowing for future research or clinical use.

methods135,062 Trans-Thoracic Echocardiogram (TTE) reports were derived from 146967 baseline echocardiogram reports and split into three cohorts: Training and Validation (n = 1075), Test Dataset (n = 98) and Application Dataset (n = 133,889). The NLP system was developed and was iteratively refined using medical expert knowledge. The system was used to curate a moderate-fidelity database from extractions of 133,889 reports. A hold-out validation set of 98 reports was blindly annotated and extracted by two clinicians for comparison with the NLP extraction. Agreement, discrimination, accuracy and calibration of outcome measure extractions were evaluated.

resultsContinuous outcomes including LVOT VTI, AV VTI and TR Vmax exhibited perfect inter-rater reliability using intra-class correlation scores (ICC = 1.00,

conclusionsThe NLP-based technique yielded good results when it came to extracting and categorising data from echocardiography reports. The system demonstrated a high degree of agreement and concordance with clinician extractions. This study contributes to the effective use of semi-structured data by providing a useful tool for converting semi-structured text to a structured echo report that can be used for data management. Additional validation and implementation in healthcare settings can improve data availability and support research and clinical decision-making.

Indexed as

Big Datadata extractionechocardiography analysisecho reportelectronic health records (EHR)natural language processing (NLP)unstructured datavalidation

Identifiers

PMID38002431
PMCPMC10669818
OpenAlexW4388633644

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.