Evidence map›Paper›PMID 31162134›Full record

ArticleJMIR public health and surveillance2019

Early Detection of Adverse Drug Reactions in Social Health Networks: A Natural Language Processing Pipeline for Signal Detection.

Azadeh Nikfarjam, Julia D Ransohoff, Alison Callahan, Erik Jones, Brian Loew, Bernice Y Kwong, Kavita Y Sarin, Nigam H Shah

Open access · goldAbstract read
In one paragraph

Article in JMIR public health and surveillance, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed
3.2field-weighted citation impact, top 8% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed, 40 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. [Utilizing social media data in post-market safety surveillance].Beijing da xue xue bao. Yi xue ban = Journal of Peking University. Health sciences · 2021
    Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Review
  15. Article
  16. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 3 institutions in 1 country.

Azadeh Nikfarjam *Stanford Center for Biomedical Informatics Research, Stanford Department of Medicine, Stanford, CA, United States.ORCID http://orcid.org/0000-0002-8430-9026
Julia D Ransohoff *Stanford Center for Biomedical Informatics Research, Stanford Department of Medicine, Stanford, CA, United States.ORCID http://orcid.org/0000-0003-3433-3076
Alison Callahan *Stanford Center for Biomedical Informatics Research, Stanford Department of Medicine, Stanford, CA, United States.ORCID http://orcid.org/0000-0001-5163-380X
Erik JonesInspire, Arlington, VA, United States.ORCID http://orcid.org/0000-0001-8670-1577
Brian LoewInspire, Arlington, VA, United States.ORCID http://orcid.org/0000-0002-5968-2267
Bernice Y KwongDepartment of Dermatology, Stanford University School of Medicine, Stanford, CA, United States.ORCID http://orcid.org/0000-0002-9677-9332
Kavita Y SarinDepartment of Dermatology, Stanford University School of Medicine, Stanford, CA, United States.ORCID http://orcid.org/0000-0001-5363-3053
Nigam H ShahStanford Center for Biomedical Informatics Research, Stanford Department of Medicine, Stanford, CA, United States.ORCID http://orcid.org/0000-0001-9385-7158
Stanford Medicine · USInspire Institute · USStanford University · US

Funding

Methods for generalized ontology terms enrichment analysisR01LM011369 · NLM · STANFORD UNIVERSITY · PI SHAH, NIGAM H · 2013 to 2020
$5.0M
NLM NIH HHS R01 LM011369
6 · The paper itself

Abstract

backgroundAdverse drug reactions (ADRs) occur in nearly all patients on chemotherapy, causing morbidity and therapy disruptions. Detection of such ADRs is limited in clinical trials, which are underpowered to detect rare events. Early recognition of ADRs in the postmarketing phase could substantially reduce morbidity and decrease societal costs. Internet community health forums provide a mechanism for individuals to discuss real-time health concerns and can enable computational detection of ADRs.

objectiveThe goal of this study is to identify cutaneous ADR signals in social health networks and compare the frequency and timing of these ADRs to clinical reports in the literature.

methodsWe present a natural language processing-based, ADR signal-generation pipeline based on patient posts on Internet social health networks. We identified user posts from the Inspire health forums related to two chemotherapy classes: erlotinib, an epidermal growth factor receptor inhibitor, and nivolumab and pembrolizumab, immune checkpoint inhibitors. We extracted mentions of ADRs from unstructured content of patient posts. We then performed population-level association analyses and time-to-detection analyses.

resultsOur system detected cutaneous ADRs from patient reports with high precision (0.90) and at frequencies comparable to those documented in the literature but an average of 7 months ahead of their literature reporting. Known ADRs were associated with higher proportional reporting ratios compared to negative controls, demonstrating the robustness of our analyses. Our named entity recognition system achieved a 0.738 microaveraged F-measure in detecting ADR entities, not limited to cutaneous ADRs, in health forum posts. Additionally, we discovered the novel ADR of hypohidrosis reported by 23 patients in erlotinib-related posts; this ADR was absent from 15 years of literature on this medication and we recently reported the finding in a clinical oncology journal.

conclusionsSeveral hundred million patients report health concerns in social health networks, yet this information is markedly underutilized for pharmacosurveillance. We demonstrated the ability of a natural language processing-based signal-generation pipeline to accurately detect patient reports of ADRs months in advance of literature reporting and the robustness of statistical analyses to validate system detections. Our findings suggest the important contributions that social health network data can play in contributing to more comprehensive and timely pharmacovigilance.

Indexed as

adverse drug reactionsantineoplastic agentsdrug-related side effectsmachine learningmedical oncologynatural language processingsignal detectionsocial media

Identifiers

PMID31162134
PMCPMC6684218
OpenAlexW2927462243

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.