Evidence map›Paper›PMID 35436226›Full record

ArticleJMIR medical informatics2022

Natural Language Processing for Assessing Quality Indicators in Free-Text Colonoscopy and Pathology Reports: Development and Usability Study.

Jung Ho Bae, Hyun Wook Han, Sun Young Yang, Gyuseon Song, Soonok Sa, Goh Eun Chung, Ji Yeon Seo, Eun Hyo Jin, Heecheon Kim, DongUk An

Abstract read
In one paragraph

Article in JMIR medical informatics, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Review
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Key quality indicators in colonoscopy.Gastroenterology report · 2023
    Review
  15. Article
  16. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Jung Ho BaeDepartment of Biomedical Informatics, CHA University School of Medicine, CHA University, Seongnam, Republic of Korea.ORCID https://orcid.org/0000-0001-7669-1213
Hyun Wook Han *Department of Biomedical Informatics, CHA University School of Medicine, CHA University, Seongnam, Republic of Korea.ORCID https://orcid.org/0000-0002-6918-5694
Sun Young Yang *Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0003-4766-3752
Gyuseon SongDepartment of Biomedical Informatics, CHA University School of Medicine, CHA University, Seongnam, Republic of Korea.ORCID https://orcid.org/0000-0003-2816-9177
Soonok SaDepartment of Biomedical Informatics, CHA University School of Medicine, CHA University, Seongnam, Republic of Korea.ORCID https://orcid.org/0000-0002-5736-8813
Goh Eun ChungDepartment of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0001-8344-7737
Ji Yeon SeoDepartment of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0003-3692-8807
Eun Hyo JinDepartment of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0002-2126-3315
Heecheon KimMiso Info Tech Co, Ltd, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0002-2683-2484
DongUk AnMiso Info Tech Co, Ltd, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0002-2491-2288

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundManual data extraction of colonoscopy quality indicators is time and labor intensive. Natural language processing (NLP), a computer-based linguistics technique, can automate the extraction of important clinical information, such as adverse events, from unstructured free-text reports. NLP information extraction can facilitate the optimization of clinical work by helping to improve quality control and patient management.

objectiveWe developed an NLP pipeline to analyze free-text colonoscopy and pathology reports and evaluated its ability to automatically assess adenoma detection rate (ADR), sessile serrated lesion detection rate (SDR), and postcolonoscopy surveillance intervals.

methodsThe NLP tool for extracting colonoscopy quality indicators was developed using a data set of 2000 screening colonoscopy reports from a single health care system, with an associated 1425 pathology reports. The NLP system was then tested on a data set of 1000 colonoscopy reports and its performance was compared with that of 5 human annotators. Additionally, data from 54,562 colonoscopies performed between 2010 and 2019 were analyzed using the NLP pipeline.

resultsThe NLP pipeline achieved an overall accuracy of 0.99-1.00 for identifying polyp subtypes, 0.99-1.00 for identifying the anatomical location of polyps, and 0.98 for counting the number of neoplastic polyps. The NLP pipeline achieved performance similar to clinical experts for assessing ADR, SDR, and surveillance intervals. NLP analysis of a 10-year colonoscopy data set identified great individual variance in colonoscopy quality indicators among 25 endoscopists.

conclusionsThe NLP pipeline could accurately extract information from colonoscopy and pathology reports and demonstrated clinical efficacy for assessing ADR, SDR, and surveillance intervals in these reports. Implementation of the system enabled automated analysis and feedback on quality indicators, which could motivate endoscopists to improve the quality of their performance and improve clinical decision-making in colorectal cancer screening programs.

Indexed as

adenomacolonoscopyendoscopynatural language processing

Identifiers

PMID35436226
PMCPMC9055472

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.