Evidence map›Paper›PMID 38938930›Full record

ArticleMayo Clinic proceedings. Digital health2024

A Systematic Review of Natural Language Processing Methods and Applications in Thyroidology.

Ricardo Loor-Torres, Mayra Duran, David Toro-Tobon, Maria Mateo Chavez, Oscar Ponce, Cristian Soto Jacome, Danny Segura Torres, Sandra Algarin Perneth, Victor Montori, Elizabeth Golembiewski and 5 more

Abstract read
In one paragraph

Article in Mayo Clinic proceedings. Digital health, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Use of Natural Language Processing to Extract and Classify Papillary Thyroid Cancer Features From Surgical Pathology Reports.Endocrine practice : official journal of the American College of Endocrinology and the American Association of Clinical Endocrinologists · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Ricardo Loor-TorresKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).
Mayra DuranKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).
David Toro-TobonKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).
Maria Mateo ChavezKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).
Oscar PonceKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).
Cristian Soto JacomeKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).
Danny Segura TorresKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).
Sandra Algarin PernethKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).
Victor MontoriKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).
Elizabeth GolembiewskiKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).
Mariana Borras OsorioKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).
Jungwei W FanKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).
Naykky Singh OspinaKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).
Yonghui WuKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).
Juan P BritoKnowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.).

Funding

De-implementation of inappropriate thyroid ultrasoundR37CA272473 · NCI · MAYO CLINIC ROCHESTER · PI Juan P Brito Campana · 2022 to 2026
$2.6M
Advancing Drug Repositioning for Alzheimer’s Disease using Real-world DataR56AG069880 · NIA · UNIVERSITY OF FLORIDA · PI BIAN, JIANG, CHEN, YONG · 2021 to 2022
$1.6M
Adequate selection of patients for thyroid biopsy: evaluation of a shared decision making conversation aidK08CA248972 · NCI · UNIVERSITY OF FLORIDA · PI SINGH OSPINA, NAYKKY · 2020 to 2024
$1.1M
NCI NIH HHS K08 CA248972NCI NIH HHS R37 CA272473NIA NIH HHS R56 AG069880
6 · The paper itself

Abstract

This study aimed to review the application of natural language processing (NLP) in thyroid-related conditions and to summarize current challenges and potential future directions. We performed a systematic search of databases for studies describing NLP applications in thyroid conditions published in English between January 1, 2012 and November 4, 2022. In addition, we used a snowballing technique to identify studies missed in the initial search or published after our search timeline until April 1, 2023. For included studies, we extracted the NLP method (eg, rule-based, machine learning, deep learning, or hybrid), NLP application (eg, identification, classification, and automation), thyroid condition (eg, thyroid cancer, thyroid nodule, and functional or autoimmune disease), data source (eg, electronic health records, health forums, medical literature databases, or genomic databases), performance metrics, and stages of development. We identified 24 eligible NLP studies focusing on thyroid-related conditions. Deep learning-based methods were the most common (38%), followed by rule-based (21%), and traditional machine learning (21%) methods. Thyroid nodules (54%) and thyroid cancer (29%) were the primary conditions under investigation. Electronic health records were the dominant data source (17/24, 71%), with imaging reports being the most frequently used (15/17, 88%). There is increasing interest in NLP applications for thyroid-related studies, mostly addressing thyroid nodules and using deep learning-based methodologies with limited external validation. However, none of the reviewed NLP applications have reached clinical practice. Several limitations, including inconsistent clinical documentation and model portability, need to be addressed to promote the evaluation and implementation of NLP applications to support patient care in thyroidology.

Identifiers

PMID38938930
PMCPMC11210322

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.