Evidence map›Paper›PMID 39789545›Full record

ArticleHealth research policy and systems2025

Investigating the trustworthiness of research evidence used to inform public health policy: a qualitative interview study on the use of predatory journal citations in policy documents.

Marc A Albert, Manoj M Lalu, Agnes Grudniewicz

Abstract read
In one paragraph

Article in Health research policy and systems, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Marc A AlbertTelfer School of Management, University of Ottawa, 55 Laurier Ave E, Ottawa, ON, K1N 6N5, Canada.ORCID http://orcid.org/0000-0002-1858-9808
Manoj M LaluBlueprint Translational Research Group, Ottawa Hospital Research Institute, Ottawa, ON, Canada.ORCID http://orcid.org/0000-0002-0322-382X
Agnes GrudniewiczTelfer School of Management, University of Ottawa, 55 Laurier Ave E, Ottawa, ON, K1N 6N5, Canada. grudniewicz@telfer.uottawa.ca.ORCID http://orcid.org/0000-0003-2960-8178

Funding

Social Sciences and Humanities Research Council Canada Graduate Scholarship SSHRC CGS M
6 · The paper itself

Abstract

Evidence-based policymaking has increased policymakers' capacity to make scientifically informed health policy decisions. However, reaping the benefits of this approach requires avoiding untrustworthy research - potential sources of which are predatory journals. In this study, we sought to understand how research cited in policy documents is sourced and evaluated, and identify factors that may be contributing to the citation of predatory journals or other less trustworthy evidence. To this end, we conducted semi-structured interviews with individuals who have prepared public health policy documents. These interviews were thematically analysed, and five key overarching themes were generated regarding the process of deciding how to develop policy documents (e.g. which individuals to involve) and how this may impact which information is included; obstacles such as limited evidence that may hinder policy document development; and concerns around transparency throughout the development process. Our findings highlight that in many cases, information cited in policy documents is sourced and evaluated with variable rigour. This may contribute to the citation of untrustworthy research in policy documents. Certain steps can be taken to help minimize any potential negative impact of relying on such sources (e.g. improving transparency), but a better understanding of policymakers' perspectives regarding how taking these steps would impact their decision-making process may be required to ensure successful implementation.

Indexed as

Health PolicyPeriodicals as TopicPolicy MakingPublic HealthQualitative ResearchTrustAdministrative PersonnelDecision MakingHumansInterviews as TopicEvidence-based policyHealth policyKnowledge translationPredatory journalsTrustworthiness of research

Identifiers

PMID39789545
PMCPMC11715994

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.