Evidence map›Paper›PMID 26879560›Full record

ArticleDrug safety2016

Evidence of Misclassification of Drug-Event Associations Classified as Gold Standard 'Negative Controls' by the Observational Medical Outcomes Partnership (OMOP).

Manfred Hauben, Jeffrey K Aronson, Robin E Ferner

Abstract read
PubMed Publisher
In one paragraph

Article in Drug safety, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed.

  1. Negative controls and how to use them: a guidance paper.International journal of epidemiology · 2026
    Article
  2. Article
  3. Article
  4. Review
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Toward multimodal signal detection of adverse drug reactions.Journal of biomedical informatics · 2017
    Article
  16. Article
  17. Article
  18. Review
  19. Data-Driven Prediction of Beneficial Drug Combinations in Spontaneous Reporting Systems.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2016
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Manfred HaubenDepartment of Medicine, Division of Clinical Pharmacology, New York University School of Medicine, New York, NY, USA. manfred.hauben@Pfizer.com.
Jeffrey K AronsonCentre for Evidence Based Medicine, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK.
Robin E FernerWest Midlands Centre for Adverse Drug Reactions, City Hospital, Birmingham, UK.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

introductionPharmacovigilance includes analysis of large databases of information on drugs and events using algorithms that detect disproportional frequencies of associations. In order to test such algorithms, attempts have been made to provide canonical reference lists of so-called 'positive controls' and 'negative controls'. Reference sets with even modest levels of misclassification may result in under- or overstatement of the performance of algorithms.

aimWe sought to determine the extent to which 'negative control' drug-event pairs in the Observational Medical Outcomes Partnership (OMOP) database are misclassified

methodsWe searched the medical literature for evidence of associations between drugs and events listed by OMOP as negative controls.

resultsThe criteria used in OMOP to classify positive and negative controls are asymmetric; drug-event associations published only as case series or case reports are classified as positive controls if they are cited in Drug-Induced Diseases by Tisdale and Miller, but as negative controls if case series or case reports exist but are not cited in Tisdale and Miller. Of 233 drug-event pairs classified in the 2013 version of OMOP as negative controls, 21 failed to meet pre-specified OMOP adjudication criteria; in another 19 cases we found case reports, case series, or observational evidence that the drug and event are associated. Overall, OMOP misclassified, or may have misclassified, 40 (17 %) of all 'negative controls.'

conclusionsResults from studies of the performance of signal-detection algorithms based on the OMOP gold standard should be viewed with circumspection, because imperfect gold standards may lead to under/overstatement of absolute and relative signal detection algorithm performance. Improvements to OMOP would include omitting misclassified drug-event pairs, assigning more specific event labels, and using more extensive sources of information.

Indexed as

AlgorithmsDatabases, FactualDrug-Related Side Effects and Adverse ReactionsHumansPharmaceutical PreparationsPharmacovigilancePharmaceutical Preparations

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.