Evidence map›Paper›PMID 37773567›Full record

ArticleDrug safety2023

Development and Application of a Data-Driven Signal Detection Method for Surveillance of Adverse Event Variability Across Manufacturing Lots of Biologics.

Joshua T Wilde, Stacy Springs, Jacqueline M Wolfrum, Retsef Levi

Abstract read
PubMed Publisher
In one paragraph

Article in Drug safety, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Joshua T WildeMassachusetts Institute of Technology, Operations Research Center, Cambridge, MA, USA.ORCID http://orcid.org/0000-0002-3251-0211
Stacy SpringsMassachusetts Institute of Technology, Center for Biomedical Innovation, Cambridge, MA, USA.ORCID http://orcid.org/0000-0003-2133-5689
Jacqueline M WolfrumMassachusetts Institute of Technology, Center for Biomedical Innovation, Cambridge, MA, USA.ORCID http://orcid.org/0000-0002-9125-828X
Retsef LeviMassachusetts Institute of Technology, Sloan School of Management, Building E62, 100 Main Street, Cambridge, MA, 02142, USA. retsef@mit.edu.ORCID http://orcid.org/0000-0002-1994-4875

Funding

Smart Data Analytics for Risk Based Regulatory Science and Bioprocessing DecisionsU01FD006483 · FDA · MASSACHUSETTS INSTITUTE OF TECHNOLOGY · PI BRAATZ, RICHARD DEAN, LEVI, RETSEF · 2018 to 2020
$5.0M
FDA HHS U01 FD006483
6 · The paper itself

Abstract

introductionPostmarketing drug safety surveillance research has focused on the product-patient interaction as the primary source of variability in clinical outcomes. However, the inherent complexity of pharmaceutical manufacturing and distribution, especially of biologic drugs, also underscores the importance of risks related to variability in manufacturing and supply chain conditions that could potentially impact clinical outcomes. We propose a data-driven signal detection method called HMMScan to monitor for manufacturing lot-dependent changes in adverse event (AE) rates, and herein apply it to a biologic drug.

methodsThe HMMScan method chooses the best-fitting candidate from a family of probabilistic Hidden Markov Models to detect temporal correlations in per lot AE rates that could signal clinically relevant variability in manufacturing and supply chain conditions. Additionally, HMMScan indicates the particular lots most likely to be related to risky states of the manufacturing or supply chain condition. The HMMScan method was validated on extensive simulated data and applied to three actual lot sequences of a major biologic drug by combining lot metadata from the manufacturer with AE reports from the US FDA Adverse Event Reporting System (FAERS).

resultsExtensive method validation on simulated data indicated that HMMScan is able to correctly detect the presence or absence of variable manufacturing and supply chain conditions for contiguous sequences of 100 lots or more when changes in these conditions have a meaningful impact on AE rates. Applying the HMMScan method to FAERS data, two of the three actual lot sequences examined exhibited evidence of potential manufacturing or supply chain-related variability.

conclusionsHMMScan could be utilized by both manufacturers and regulators to automate lot variability monitoring and inform targeted root-cause analysis. Broad application of HMMScan would rely on a well-developed data input pipeline. The proposed method is implemented in an open-source GitHub repository.

Indexed as

Biological ProductsDrug-Related Side Effects and Adverse ReactionsAdverse Drug Reaction Reporting SystemsHumansProduct Surveillance, PostmarketingResearch DesignUnited StatesUnited States Food and Drug AdministrationBiological Products

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.