Evidence map›Paper›PMID 24777653›Full record

ArticleDrug safety2014

Digital drug safety surveillance: monitoring pharmaceutical products in twitter.

Clark C Freifeld, John S Brownstein, Christopher M Menone, Wenjie Bao, Ross Filice, Taha Kass-Hout, Nabarun Dasgupta

Erratum issuedAbstract read
In one paragraph

Article in Drug safety, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 123 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
123citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

123 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Medication-indication knowledge bases: a systematic review and critical appraisal.Journal of the American Medical Informatics Association : JAMIA · 2015
    Pooled it
  4. Pooled it
  5. Article
  6. Article
  7. Pharmacovigilance in the digital age: gaining insight from social media data.Experimental biology and medicine (Maywood, N.J.) · 2025
    Review
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Self-reported adverse events associated with ∆Journal of cannabis research · 2023
    Article
  16. Review
  17. Article
  18. Artificial Intelligent Context-Aware Machine-Learning Tool to Detect Adverse Drug Events from Social Media Platforms.Journal of medical toxicology : official journal of the American College of Medical Toxicology · 2022
    Article
  19. Article
  20. Article

63 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

  • Erratum issued
5 · Who and what money

Authors and funding

7 authors.

Clark C FreifeldDepartment of Biomedical Engineering, Boston University, Boston, USA.
John S Brownstein
Christopher M Menone
Wenjie Bao
Ross Filice
Taha Kass-Hout
Nabarun Dasgupta

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundTraditional adverse event (AE) reporting systems have been slow in adapting to online AE reporting from patients, relying instead on gatekeepers, such as clinicians and drug safety groups, to verify each potential event. In the meantime, increasing numbers of patients have turned to social media to share their experiences with drugs, medical devices, and vaccines.

objectiveThe aim of the study was to evaluate the level of concordance between Twitter posts mentioning AE-like reactions and spontaneous reports received by a regulatory agency.

methodsWe collected public English-language Twitter posts mentioning 23 medical products from 1 November 2012 through 31 May 2013. Data were filtered using a semi-automated process to identify posts with resemblance to AEs (Proto-AEs). A dictionary was developed to translate Internet vernacular to a standardized regulatory ontology for analysis (MedDRA(®)). Aggregated frequency of identified product-event pairs was then compared with data from the public FDA Adverse Event Reporting System (FAERS) by System Organ Class (SOC).

resultsOf the 6.9 million Twitter posts collected, 4,401 Proto-AEs were identified out of 60,000 examined. Automated, dictionary-based symptom classification had 86 % recall and 72 % precision [corrected]. Similar overall distribution profiles were observed, with Spearman rank correlation rho of 0.75 (p < 0.0001) between Proto-AEs reported in Twitter and FAERS by SOC.

conclusionPatients reporting AEs on Twitter showed a range of sophistication when describing their experience. Despite the public availability of these data, their appropriate role in pharmacovigilance has not been established. Additional work is needed to improve data acquisition and automation.

Indexed as

Adverse Drug Reaction Reporting SystemsDrug-Related Side Effects and Adverse ReactionsInternetPharmacovigilanceHumansNonprescription DrugsPrescription DrugsUnited StatesUnited States Food and Drug AdministrationNonprescription DrugsPrescription Drugs

Identifiers

PMID24777653
PMCPMC4013443

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.