Evidence map›Paper›PMID 39197747›Full record

ArticleEndocrine practice : official journal of the American College of Endocrinology and the American Association of Clinical Endocrinologists2024

Use of Natural Language Processing to Extract and Classify Papillary Thyroid Cancer Features From Surgical Pathology Reports.

Ricardo Loor-Torres, Yuqi Wu, Esteban Cabezas, Mariana Borras-Osorio, David Toro-Tobon, Mayra Duran, Misk Al Zahidy, Maria Mateo Chavez, Cristian Soto Jacome, Jungwei W Fan and 3 more

Abstract read
In one paragraph

Article in Endocrine practice : official journal of the American College of Endocrinology and the American Association of Clinical Endocrinologists, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Ricardo Loor-TorresKnowledge and Evaluation Research Unit, Division of Endocrinology, Diabetes, Metabolism, and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota.
Yuqi WuDepartment of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, Minnesota.
Esteban CabezasKnowledge and Evaluation Research Unit, Division of Endocrinology, Diabetes, Metabolism, and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota.
Mariana Borras-OsorioKnowledge and Evaluation Research Unit, Division of Endocrinology, Diabetes, Metabolism, and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota.
David Toro-TobonDivision of Endocrinology, Diabetes, Metabolism, and Nutrition, Mayo Clinic, Rochester, Minnesota.
Mayra DuranKnowledge and Evaluation Research Unit, Division of Endocrinology, Diabetes, Metabolism, and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota.
Misk Al ZahidyKnowledge and Evaluation Research Unit, Division of Endocrinology, Diabetes, Metabolism, and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota.
Maria Mateo ChavezKnowledge and Evaluation Research Unit, Division of Endocrinology, Diabetes, Metabolism, and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota.
Cristian Soto JacomeKnowledge and Evaluation Research Unit, Division of Endocrinology, Diabetes, Metabolism, and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota.
Jungwei W FanDepartment of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, Minnesota.
Naykky M Singh OspinaDivision of Endocrinology, Department of Medicine, University of Florida, Gainesville, Florida.
Yonghui WuDepartment of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, Florida.
Juan P BritoKnowledge and Evaluation Research Unit, Division of Endocrinology, Diabetes, Metabolism, and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota; Division of Endocrinology, Diabetes, Metabolism, and Nutrition, Mayo Clinic, Rochester, Minnesota.

Funding

De-implementation of inappropriate thyroid ultrasoundR37CA272473 · NCI · MAYO CLINIC ROCHESTER · PI Juan P Brito Campana · 2022 to 2026
$2.6M
Advancing Drug Repositioning for Alzheimer’s Disease using Real-world DataR56AG069880 · NIA · UNIVERSITY OF FLORIDA · PI BIAN, JIANG, CHEN, YONG · 2021 to 2022
$1.6M
Adequate selection of patients for thyroid biopsy: evaluation of a shared decision making conversation aidK08CA248972 · NCI · UNIVERSITY OF FLORIDA · PI SINGH OSPINA, NAYKKY · 2020 to 2024
$1.1M
NCI NIH HHS K08 CA248972NCI NIH HHS R37 CA272473NIA NIH HHS R56 AG069880
6 · The paper itself

Abstract

backgroundWe aim to use Natural Language Processing to automate the extraction and classification of thyroid cancer risk factors from pathology reports.

methodsWe analyzed 1410 surgical pathology reports from adult papillary thyroid cancer patients from 2010 to 2019. Structured and nonstructured reports were used to create a consensus-based ground truth dictionary and categorized them into modified recurrence risk levels. Nonstructured reports were narrative, while structured reports followed standardized formats. We developed ThyroPath, a rule-based Natural Language Processing pipeline, to extract and classify thyroid cancer features into risk categories. Training involved 225 reports (150 structured, 75 unstructured), with testing on 170 reports (120 structured, 50 unstructured) for evaluation. The pipeline's performance was assessed using both strict and lenient criteria for accuracy, precision, recall, and F1-score; a metric that combines precision and recall evaluation.

resultsIn extraction tasks, ThyroPath achieved overall strict F-1 scores of 93% for structured reports and 90% for unstructured reports, covering 18 thyroid cancer pathology features. In classification tasks, ThyroPath-extracted information demonstrated an overall accuracy of 93% in categorizing reports based on their corresponding guideline-based risk of recurrence: 76.9% for high-risk, 86.8% for intermediate risk, and 100% for both low and very low-risk cases. However, ThyroPath achieved 100% accuracy across all risk categories with human extracted pathology information.

conclusionsThyroPath shows promise in automating the extraction and risk recurrence classification of thyroid pathology reports at large scale. It offers a solution to laborious manual reviews and advancing virtual registries. However, it requires further validation before implementation.

Indexed as

Natural Language ProcessingThyroid Cancer, PapillaryThyroid NeoplasmsAdultHumansNeoplasm Recurrence, LocalPathology, SurgicalRisk Factorsartificial intelligenceNatural Language Processingthyroid cancer

Identifiers

PMID39197747
PMCPMC11531997

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.