Evidence map›Paper›PMID 38183608›Full record

ArticleDrug safety2024

Validation of a Novel Method to Assess the Clinical Quality of Information in Pregnancy-Related Pharmacovigilance Case Reports: A ConcePTION Project.

Yrea R J van Rijt-Weetink, Toine C G Egberts, Florence P A M van Hunsel, David J Lewis, Laura M Yates, Ursula Winterfeld, Eugène P van Puijenbroek

Abstract read
In one paragraph

Article in Drug safety, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Yrea R J van Rijt-WeetinkPharmacovigilance Centre Lareb, Goudsbloemvallei 7, 5237 MH, s-Hertogenbosch, The Netherlands.ORCID http://orcid.org/0000-0002-5997-3718
Toine C G EgbertsDivision of Pharmacoepidemiology and Clinical Pharmacology, Department of Pharmaceutical Sciences, Faculty of Science, Utrecht University, Utrecht, The Netherlands.ORCID http://orcid.org/0000-0003-1758-7779
Florence P A M van HunselPharmacovigilance Centre Lareb, Goudsbloemvallei 7, 5237 MH, s-Hertogenbosch, The Netherlands.ORCID http://orcid.org/0000-0001-8965-3224
David J LewisGlobal Drug Development, Novartis Pharma GmbH, Wehr, Germany.ORCID http://orcid.org/0000-0001-9576-3489
Laura M YatesUniversity of Kwazulu-Natal, KRISP, Durban, South Africa.ORCID http://orcid.org/0000-0002-7963-625X
Ursula WinterfeldSwiss Teratogen Information Service and Clinical Pharmacology Service, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne, Lausanne, Switzerland.ORCID http://orcid.org/0000-0002-9926-7164
Eugène P van PuijenbroekPharmacovigilance Centre Lareb, Goudsbloemvallei 7, 5237 MH, s-Hertogenbosch, The Netherlands. e.vanpuijenbroek@lareb.nl.ORCID http://orcid.org/0000-0002-2236-1398

Funding

Innovative Medicines Initiative 2 821520
6 · The paper itself

Abstract

backgroundTo assess the causal relationship between a medicinal product and a reported event, relevant information needs to be present. Information elements for assessing cases of exposure to medicinal products during pregnancy were predefined and used in a new tool to assess the quality of information. However, the extent in which the presence or absence of these predefined information elements is associated with the overall clinical quality of these cases, as evaluated by pharmacovigilance experts, remains uncertain.

objectiveWe aimed to validate a novel method to assess the clinical quality of information in real-world pregnancy pharmacovigilance case reports.

methodsThe clinical quality of case reports regarding medicinal product exposure and pregnancy-related outcomes was appraised from spontaneous reports, literature, Teratology Information Services (UK and Switzerland), The Dutch Pregnancy Drug Register, the Gilenya pregnancy registry and the Enhanced PV programme of Novartis. Assessment was done by means of the novel standardised tool based on the presence and relevance of information, and by expert judgement. The novel tool was validated compared to the expert assessment as the gold standard expressed as the area under the receiver operating characteristic curves, after which the sensitivity and specificity were calculated using cross-tabulations. Inter-rater variability was determined by means of weighted Cohen's kappa.

resultsOne hundred and eighty-six case reports were included. The clinical quality score as assessed by the novel method was divided into three categories with cut-off values of 45% (poor to intermediate) and 65% (intermediate to excellent). Sensitivity was 0.93 and 0.96 for poor to intermediate and intermediate to excellent, respectively. Specificity was respectively 0.52 and 0.73. Inter-rater variability was 0.65 (95% confidence interval 0.53-0.78) for the newly developed approach, and 0.40 (95% confidence interval 0.28-0.52) for the gold standard assessment.

conclusionsThe tool described in this study using the presence and relevance of elements of information is the first designed, validated and standardised method for the assessment of the quality of information of case reports in pregnancy pharmacovigilance data. This method confers less inter-rater variability compared with a quality assessment by experts of pregnancy-related pharmacovigilance data.

Indexed as

Drug-Related Side Effects and Adverse ReactionsAdverse Drug Reaction Reporting SystemsCausalityFemaleHumansJudgmentPharmacovigilancePregnancy

Identifiers

PMID38183608
PMCPMC10874330

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.