Evidence map›Paper›PMID 34412643›Full record

ArticleEnvironmental health : a global access science source2021

Toolkit for detecting misused epidemiological methods.

Colin L Soskolne, Shira Kramer, Juan Pablo Ramos-Bonilla, Daniele Mandrioli, Jennifer Sass, Michael Gochfeld, Carl F Cranor, Shailesh Advani, Lisa A Bero

Erratum issuedAbstract read
In one paragraph

Article in Environmental health : a global access science source, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 12 papers.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Correction: Toolkit for detecting misused epidemiological methods.Environmental health : a global access science source · 2022
    Article
  10. Response to Toshihide Tsuda, Yumiko Miyano and Eiji Yamamoto [1].Environmental health : a global access science source · 2022
    Article
  11. Review
  12. Environmental epidemiology in a crossfire.Environmental health : a global access science source · 2021
    Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

9 authors.

Colin L SoskolneSchool of Public Health, University of Alberta, Edmonton, AB, Canada. colin.soskolne@ualberta.ca.ORCID http://orcid.org/0000-0001-9950-9197
Shira KramerEpidemiology International, Hunt Valley, MD, USA.ORCID http://orcid.org/0000-0003-2186-0651
Juan Pablo Ramos-BonillaDepartment of Civil and Environmental Engineering, Universidad de Los Andes, Bogotá, Colombia.ORCID http://orcid.org/0000-0002-5256-9587
Daniele MandrioliCesare Maltoni Cancer Research Centre, Ramazzini Institute, Bologna, Italy.ORCID http://orcid.org/0000-0001-6156-6516
Jennifer SassNatural Resources Defense Council, Washington, DC, USA.ORCID http://orcid.org/0000-0003-1279-9510
Michael GochfeldEnvironmental and Occupational Health Sciences Institute, Rutgers Biomedical and Health Sciences, Newark, NJ, USA.ORCID http://orcid.org/0000-0001-9813-3132
Carl F CranorDepartments of Philosophy and Environmental Toxicology, University of California, Riverside, CA, USA.
Shailesh AdvaniTerasaki Institute of Biomedical Innovation, Los Angeles, CA, USA.ORCID http://orcid.org/0000-0002-1446-969X
Lisa A BeroCenter for Bioethics and Humanities, University of Colorado Anschutz Medical Campus, Aurora, CO, USA.ORCID http://orcid.org/0000-0003-1893-6651

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundCritical knowledge of what we know about health and disease, risk factors, causation, prevention, and treatment, derives from epidemiology. Unfortunately, its methods and language can be misused and improperly applied. A repertoire of methods, techniques, arguments, and tactics are used by some people to manipulate science, usually in the service of powerful interests, and particularly those with a financial stake related to toxic agents. Such interests work to foment uncertainty, cast doubt, and mislead decision makers by seeding confusion about cause-and-effect relating to population health. We have compiled a toolkit of the methods used by those whose interests are not aligned with the public health sciences. Professional epidemiologists, as well as those who rely on their work, will thereby be more readily equipped to detect bias and flaws resulting from financial conflict-of-interest, improper study design, data collection, analysis, or interpretation, bringing greater clarity-not only to the advancement of knowledge, but, more immediately, to policy debates.

methodsThe summary of techniques used to manipulate epidemiological findings, compiled as part of the 2020 Position Statement of the International Network for Epidemiology in Policy (INEP) entitled Conflict-of-Interest and Disclosure in Epidemiology, has been expanded and further elucidated in this commentary.

resultsSome level of uncertainty is inherent in science. However, corrupted and incomplete literature contributes to confuse, foment further uncertainty, and cast doubt about the evidence under consideration. Confusion delays scientific advancement and leads to the inability of policymakers to make changes that, if enacted, would-supported by the body of valid evidence-protect, maintain, and improve public health. An accessible toolkit is provided that brings attention to the misuse of the methods of epidemiology. Its usefulness is as a compendium of what those trained in epidemiology, as well as those reviewing epidemiological studies, should identify methodologically when assessing the transparency and validity of any epidemiological inquiry, evaluation, or argument. The problems resulting from financial conflicting interests and the misuse of scientific methods, in conjunction with the strategies that can be used to safeguard public health against them, apply not only to epidemiologists, but also to other public health professionals.

conclusionsThis novel toolkit is for use in protecting the public. It is provided to assist public health professionals as gatekeepers of their respective specialty and subspecialty disciplines whose mission includes protecting, maintaining, and improving the public's health. It is intended to serve our roles as educators, reviewers, and researchers.

Indexed as

Epidemiologic MethodsConflict of InterestResearch DesignUncertaintyDisinformationEthicsFlawed scienceManufactured scientific controversyObfuscationPartialityPublic policyResearch integrityScientific misconductUndue influence

Identifiers

PMID34412643
PMCPMC8375462

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.