Evidence map›Paper›PMID 31535693›Full record

ArticleRheumatology (Oxford, England)2020

Incorporating natural language processing to improve classification of axial spondyloarthritis using electronic health records.

Sizheng Steven Zhao, Chuan Hong, Tianrun Cai, Chang Xu, Jie Huang, Joerg Ermann, Nicola J Goodson, Daniel H Solomon, Tianxi Cai, Katherine P Liao

Abstract readMulticenter Study
In one paragraph

Article in Rheumatology (Oxford, England), 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers.

0numbers the graph read from it
0cells of the map it votes in
24citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

24 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Review
  5. Large language models and rheumatology: are we there yet?Rheumatology advances in practice · 2025
    Review
  6. Review
  7. Review
  8. Review
  9. Article
  10. Article
  11. Observational
  12. Article
  13. Review
  14. Article
  15. Review
  16. Review
  17. Article
  18. Artificial Intelligence and Deep Learning for Rheumatologists.Arthritis & rheumatology (Hoboken, N.J.) · 2022
    Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Sizheng Steven ZhaoInstitute of Ageing and Chronic Disease, University of Liverpool.
Chuan HongHarvard Medical School.
Tianrun CaiDivision of Rheumatology, Immunology and Allergy, Brigham and Women's Hospital.
Chang XuDivision of Rheumatology, Immunology and Allergy, Brigham and Women's Hospital.
Jie HuangDivision of Rheumatology, Immunology and Allergy, Brigham and Women's Hospital.
Joerg ErmannDivision of Rheumatology, Immunology and Allergy, Brigham and Women's Hospital.
Nicola J GoodsonInstitute of Ageing and Chronic Disease, University of Liverpool.
Daniel H SolomonDivision of Rheumatology, Immunology and Allergy, Brigham and Women's Hospital.
Tianxi CaiHarvard Medical School.
Katherine P LiaoDivision of Rheumatology, Immunology and Allergy, Brigham and Women's Hospital.

Funding

VERITY: Value and Evidence in Rheumatology using bioInformaTics, and advanced analYticsP30AR072577 · NIAMS · BRIGHAM AND WOMEN'S HOSPITAL · PI Daniel Hal Solomon · 2017 to 2026
$9.8M
Patient Centered Outcomes Research in RheumatologyK24AR055989 · NIAMS · BRIGHAM AND WOMEN'S HOSPITAL · PI SOLOMON, DANIEL HAL · 2008 to 2017
$1.5M
NIAMS NIH HHS K24 AR055989NIAMS NIH HHS P30 AR072577
6 · The paper itself

Abstract

objectivesTo develop classification algorithms that accurately identify axial SpA (axSpA) patients in electronic health records, and compare the performance of algorithms incorporating free-text data against approaches using only International Classification of Diseases (ICD) codes.

methodsAn enriched cohort of 7853 eligible patients was created from electronic health records of two large hospitals using automated searches (⩾1 ICD codes combined with simple text searches). Key disease concepts from free-text data were extracted using NLP and combined with ICD codes to develop algorithms. We created both supervised regression-based algorithms-on a training set of 127 axSpA cases and 423 non-cases-and unsupervised algorithms to identify patients with high probability of having axSpA from the enriched cohort. Their performance was compared against classifications using ICD codes only.

resultsNLP extracted four disease concepts of high predictive value: ankylosing spondylitis, sacroiliitis, HLA-B27 and spondylitis. The unsupervised algorithm, incorporating both the NLP concept and ICD code for AS, identified the greatest number of patients. By setting the probability threshold to attain 80% positive predictive value, it identified 1509 axSpA patients (mean age 53 years, 71% male). Sensitivity was 0.78, specificity 0.94 and area under the curve 0.93. The two supervised algorithms performed similarly but identified fewer patients. All three outperformed traditional approaches using ICD codes alone (area under the curve 0.80-0.87).

conclusionAlgorithms incorporating free-text data can accurately identify axSpA patients in electronic health records. Large cohorts identified using these novel methods offer exciting opportunities for future clinical research.

Indexed as

Natural Language ProcessingQuality ImprovementAgedAlgorithmsArea Under CurveCohort StudiesElectronic Health RecordsFemaleHumansInternational Classification of DiseasesMaleMiddle AgedSensitivity and SpecificitySpondylarthritisSpondylitis, Ankylosingankylosing spondylitisaxial spondyloarthritisclassificationelectronic health recordsfree-textICD codemachine learningnatural language processingphenotyping

Identifiers

PMID31535693
PMCPMC7850056

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.