Evidence map›Paper›PMID 24166230›Full record

ArticleDrug safety2013

Empirical performance of LGPS and LEOPARD: lessons for developing a risk identification and analysis system.

Martijn J Schuemie, David Madigan, Patrick B Ryan

Abstract read
PubMed Publisher
In one paragraph

Article in Drug safety, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Article
  5. Article
  6. Pharmacovigilance via Baseline Regularization with Large-Scale Longitudinal Observational Data.KDD : proceedings. International Conference on Knowledge Discovery & Data Mining · 2017
    Article
  7. Similarity-based modeling applied to signal detection in pharmacovigilance.CPT: pharmacometrics & systems pharmacology · 2014
    Article
  8. Article
  9. Review
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Martijn J SchuemieDepartment of Medical Informatics, Erasmus University Medical Center Rotterdam, P.O. Box 2040, 3000 CA, Rotterdam, The Netherlands, m.schuemie@erasmusmc.nl.
David Madigan
Patrick B Ryan

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe availability of large-scale observational healthcare data allows for the active monitoring of safety of drugs, but research is needed to determine which statistical methods are best suited for this task. Recently, the Longitudinal Gamma Poisson Shrinker (LGPS) and Longitudinal Evaluation of Observational Profiles of Adverse events Related to Drugs (LEOPARD) methods were developed specifically for this task. LGPS applies Bayesian shrinkage to an estimated incidence rate ratio, and LEOPARD aims to detect and discard associations due to protopathic bias. The operating characteristics of these methods still need to be determined.

objectiveEstablish the operating characteristics of LGPS and LEOPARD for large scale observational analysis in drug safety. RESEARCH

designWe empirically evaluated LGPS and LEOPARD in five real observational healthcare databases and six simulated datasets. We retrospectively studied the predictive accuracy of the methods when applied to a collection of 165 positive control and 234 negative control drug-outcome pairs across four outcomes: acute liver injury, acute myocardial infarction, acute kidney injury, and upper gastrointestinal bleeding.

resultsIn contrast to earlier findings, we found that LGPS and LEOPARD provide weak discrimination between positive and negative controls, although the use of LEOPARD does lead to higher performance in this respect. Furthermore, the methods produce biased estimates and confidence intervals that have poor coverage properties.

conclusionsFor the four outcomes we examined, LGPS and LEOPARD may not be the designs of choice for risk identification.

Indexed as

Research DesignArea Under CurveBiasDatabases, FactualDrug-Related Side Effects and Adverse ReactionsHumansProbabilityRetrospective StudiesRisk Assessment

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.