Evidence map›Paper›PMID 25344930›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2015

Automatic identification of methotrexate-induced liver toxicity in patients with rheumatoid arthritis from the electronic medical record.

Chen Lin, Elizabeth W Karlson, Dmitriy Dligach, Monica P Ramirez, Timothy A Miller, Huan Mo, Natalie S Braggs, Andrew Cagan, Vivian Gainer, Joshua C Denny and 1 more

Open access · bronzeAbstract readValidation Study
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 43 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
43citing papers in PubMed, 2 pooled it
3.9field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

43 citing papers in PubMed, 2 syntheses or guidelines pooled it, 78 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Review
  5. Review
  6. Review
  7. Large language models and rheumatology: are we there yet?Rheumatology advances in practice · 2025
    Review
  8. Review
  9. Article
  10. The SMART Text2FHIR Pipeline.medRxiv : the preprint server for health sciences · 2023
    Article
  11. Article
  12. The SMART Text2FHIR Pipeline.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2023
    Article
  13. Review
  14. Article
  15. Article
  16. Machine Learning in Rheumatic Diseases.Clinical reviews in allergy & immunology · 2021
    Review
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 5 institutions in 1 country.

Chen LinBoston Children's Hospital, Informatics Program, Boston, Massachusetts, USA *CL, EWK and DD are co-first authors.
Elizabeth W KarlsonDivision of Rheumatology, Immunology and Allergy, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA Harvard Medical School, Boston, Massachusetts, USA *CL, EWK and DD are co-first authors.
Dmitriy DligachBoston Children's Hospital, Informatics Program, Boston, Massachusetts, USA Harvard Medical School, Boston, Massachusetts, USA *CL, EWK and DD are co-first authors.
Monica P RamirezDivision of Rheumatology, Immunology and Allergy, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA.
Timothy A MillerBoston Children's Hospital, Informatics Program, Boston, Massachusetts, USA Harvard Medical School, Boston, Massachusetts, USA.
Huan MoDepartment of Biomedical Informatics, Vanderbilt University, Nashville, Tennessee, USA.
Natalie S BraggsDepartment of Medicine, Vanderbilt University, Nashville, Tennessee, USA.
Andrew CaganResearch Computing, Partners HealthCare, Boston, Massachusetts, USA.
Vivian GainerResearch Computing, Partners HealthCare, Boston, Massachusetts, USA.
Joshua C DennyDepartment of Biomedical Informatics, Vanderbilt University, Nashville, Tennessee, USA Department of Medicine, Vanderbilt University, Nashville, Tennessee, USA.
Guergana K SavovaBoston Children's Hospital, Informatics Program, Boston, Massachusetts, USA Harvard Medical School, Boston, Massachusetts, USA.
Boston Children's Hospital · USVanderbilt University · USHarvard University · USMass General Brigham · USBrigham and Women's Hospital · US

Funding

Informatics for Integrating Biology/ the Bedside (RMI)U54LM008748 · NLM · BRIGHAM AND WOMEN'S HOSPITAL · PI KOHANE, ISAAC S. · 2004 to 2013
$39.0M
Trial of risk mangement for prevention of accelerated atherosclerosis in SLEP60AR047782 · NIAMS · BRIGHAM AND WOMEN'S HOSPITAL · PI KARLSON, ELIZABETH W · 2001 to 2016
$18.8M
Pharmacogenomics of Arrhythmia TherapyU19HL065962 · NHLBI · VANDERBILT UNIVERSITY MEDICAL CENTER · PI RODEN, DAN M · 2010 to 2014
$17.4M
Novel Biomarkers and Prediction Models for Rheumatoid ArthritisR01AR049880 · NIAMS · BRIGHAM AND WOMEN'S HOSPITAL · PI COSTENBADER, KAREN H, KARLSON, ELIZABETH W · 2003 to 2018
$8.7M
Genetic predictors of response to anti-TNF therapy in rheumatoid arthritisU01GM092691 · NIGMS · BRIGHAM AND WOMEN'S HOSPITAL · PI BRENNER, MICHAEL B., RAYCHAUDHURI, SOUMYA · 2010 to 2014
$7.5M
Temporal relation discovery for clinical textR01LM010090 · NLM · BOSTON CHILDREN'S HOSPITAL · PI MARTIN, JAMES H., SAVOVA, GUERGANA K. · 2010 to 2022
$7.1M
Informatics Tools for Pharmacogenomic Discovery using Practice-based DataR01GM103859 · NIGMS · VANDERBILT UNIVERSITY MEDICAL CENTER · PI DENNY, JOSHUA C., PATHAK, JYOTISHMAN · 2014 to 2017
$2.4M
Genetic Predictors of Early Atherosclerosis in SLEK24AR052403 · NIAMS · BRIGHAM AND WOMEN'S HOSPITAL · PI KARLSON, ELIZABETH W · 2005 to 2014
$1.5M
NHLBI NIH HHS U19 HL065962NIAMS NIH HHS AR047782NIAMS NIH HHS AR049880NIAMS NIH HHS AR052403NIGMS NIH HHS 1R01GM103859-01A1NIGMS NIH HHS R01 GM103859NIGMS NIH HHS U01 GM092691NLM NIH HHS R01LM010090NLM NIH HHS U54LM008748
6 · The paper itself

Abstract

objectivesTo improve the accuracy of mining structured and unstructured components of the electronic medical record (EMR) by adding temporal features to automatically identify patients with rheumatoid arthritis (RA) with methotrexate-induced liver transaminase abnormalities. MATERIALS AND

methodsCodified information and a string-matching algorithm were applied to a RA cohort of 5903 patients from Partners HealthCare to select 1130 patients with potential liver toxicity. Supervised machine learning was applied as our key method. For features, Apache clinical Text Analysis and Knowledge Extraction System (cTAKES) was used to extract standard vocabulary from relevant sections of the unstructured clinical narrative. Temporal features were further extracted to assess the temporal relevance of event mentions with regard to the date of transaminase abnormality. All features were encapsulated in a 3-month-long episode for classification. Results were summarized at patient level in a training set (N=480 patients) and evaluated against a test set (N=120 patients).

resultsThe system achieved positive predictive value (PPV) 0.756, sensitivity 0.919, F1 score 0.829 on the test set, which was significantly better than the best baseline system (PPV 0.590, sensitivity 0.703, F1 score 0.642). Our innovations, which included framing the phenotype problem as an episode-level classification task, and adding temporal information, all proved highly effective.

conclusionsAutomated methotrexate-induced liver toxicity phenotype discovery for patients with RA based on structured and unstructured information in the EMR shows accurate results. Our work demonstrates that adding temporal features significantly improved classification results.

Indexed as

AlgorithmsElectronic Health RecordsArthritis, RheumatoidChemical and Drug Induced Liver InjuryHumansImmunosuppressive AgentsLiverMethotrexateImmunosuppressive AgentsMethotrexateelectronic medical recordliver toxicitymethotrexatenatural language processingpharmacogeneticrheumatoid arthritis

Identifiers

PMID25344930
PMCPMC5901122
OpenAlexW2169704124

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.