Evidence map›Paper›PMID 30943952›Full record

ArticleBMC medical informatics and decision making2019

Natural language processing of radiology reports for identification of skeletal site-specific fractures.

Yanshan Wang, Saeed Mehrabi, Sunghwan Sohn, Elizabeth J Atkinson, Shreyasee Amin, Hongfang Liu

Open access · goldAbstract read
In one paragraph

Article in BMC medical informatics and decision making, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 20 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
20citing papers in PubMed, 1 pooled it
3.9field-weighted citation impact, top 7% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

20 citing papers in PubMed, 1 synthesis or guideline pooled it, 42 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Advances in Artificial Intelligence for Wrist Joint Injury Diagnosis.International journal of medical sciences · 2026
    Review
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Review
  11. Approach to the Patient With Bone Fracture: Making the First Fracture the Last.The Journal of clinical endocrinology and metabolism · 2023
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Electronic search programs are effective in identifying patients with minimal trauma fractures.Osteoporosis international : a journal established as result of cooperation between the European Foundation for Osteoporosis and the National Osteoporosis Foundation of the USA · 2022
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 2 institutions in 1 country.

Yanshan WangDivision of Biomedical Statistics and Informatics, Department of Health Sciences Research, Mayo Clinic, 200 1st ST SW, Rochester, MN, USA. wang.yanshan@mayo.edu.
Saeed MehrabiDivision of Biomedical Statistics and Informatics, Department of Health Sciences Research, Mayo Clinic, 200 1st ST SW, Rochester, MN, USA.
Sunghwan SohnDivision of Biomedical Statistics and Informatics, Department of Health Sciences Research, Mayo Clinic, 200 1st ST SW, Rochester, MN, USA.
Elizabeth J AtkinsonDivision of Biomedical Statistics and Informatics, Department of Health Sciences Research, Mayo Clinic, 200 1st ST SW, Rochester, MN, USA.
Shreyasee AminDivision of Rheumatology, Department of Medicine, Mayo Clinic, 200 1st ST SW, MN, Rochester, USA.
Hongfang LiuDivision of Biomedical Statistics and Informatics, Department of Health Sciences Research, Mayo Clinic, 200 1st ST SW, Rochester, MN, USA.
Mayo Clinic in Florida · USMayo Clinic · US

Funding

SEX STEROIDS, GROWTH FACTORS, &BONE CELL FUNCTIONP01AG004875 · NIA · MAYO CLINIC ROCHESTER · PI KHOSLA, SUNDEEP · 1985 to 2019
$30.8M
Rochester Epidemiology ProjectR01AG034676 · NIA · MAYO CLINIC ROCHESTER · PI ROCCA, WALTER A, ST SAUVER, JENNIFER LYNN · 2010 to 2019
$9.5M
Open Health Natural Language Processing CollaboratoryU01TR002062 · NCATS · MAYO CLINIC ROCHESTER · PI JIANG, XIAOQIAN, LIU, HONGFANG · 2017 to 2021
$7.6M
Semi-structured Information Retrieval in Clinical Text for Cohort IdentificationR01LM011934 · NLM · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI HERSH, WILLIAM R, LIU, HONGFANG · 2014 to 2025
$5.1M
Secondary use of EMRs for surgical complication surveillanceR01EB019403 · NIBIB · MAYO CLINIC ROCHESTER · PI LIU, HONGFANG, STORLIE, CURTIS · 2015 to 2022
$3.8M
Patient Medical History Representation, Extraction, and Inference from EHR DataR01LM011829 · NLM · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI TAO, CUI · 2014 to 2018
$1.7M
NCATS NIH HHS U01 TR002062NIA NIH HHS P01 AG004875NIA NIH HHS R01 AG034676NIBIB NIH HHS R01 EB019403NLM NIH HHS R01 LM011829NLM NIH HHS R01 LM011934
6 · The paper itself

Abstract

backgroundOsteoporosis has become an important public health issue. Most of the population, particularly elderly people, are at some degree of risk of osteoporosis-related fractures. Accurate identification and surveillance of patient populations with fractures has a significant impact on reduction of cost of care by preventing future fractures and its corresponding complications.

methodsIn this study, we developed a rule-based natural language processing (NLP) algorithm for identification of twenty skeletal site-specific fractures from radiology reports. The rule-based NLP algorithm was based on regular expressions developed using MedTagger, an NLP tool of the Apache Unstructured Information Management Architecture (UIMA) pipeline to facilitate information extraction from clinical narratives. Radiology notes were retrieved from the Mayo Clinic electronic health records data warehouse. We developed rules for identifying each fracture type according to physicians' knowledge and experience, and refined these rules via verification with physicians. This study was approved by the institutional review board (IRB) for human subject research.

resultsWe validated the NLP algorithm using the radiology reports of a community-based cohort at Mayo Clinic with the gold standard constructed by medical experts. The micro-averaged results of sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and F1-score of the proposed NLP algorithm are 0.930, 1.0, 1.0, 0.941, 0.961, respectively. The F1-score is 1.0 for 8 fractures, and above 0.9 for a total of 17 out of 20 fractures (85%).

conclusionsThe results verified the effectiveness of the proposed rule-based NLP algorithm in automatic identification of osteoporosis-related skeletal site-specific fractures from radiology reports. The NLP algorithm could be utilized to accurately identify the patients with fractures and those who are also at high risk of future fractures due to osteoporosis. Appropriate care interventions to those patients, not only the most at-risk patients but also those with emerging risk, would significantly reduce future fractures.

Indexed as

Natural Language ProcessingRadiologyAgedAlgorithmsCohort StudiesElectronic Health RecordsFemaleFractures, BoneHumansInformation Storage and RetrievalElectronic health recordsFracture identificationNatural language processingRadiology reports

Identifiers

PMID30943952
PMCPMC6448178
OpenAlexW2926850261

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.