Evidence map›Paper›PMID 28902887›Full record

SynthesisPloS one2017

A checklist is associated with increased quality of reporting preclinical biomedical research: A systematic review.

SeungHye Han, Tolani F Olonisakin, John P Pribis, Jill Zupetic, Joo Heung Yoon, Kyle M Holleran, Kwonho Jeong, Nader Shaikh, Doris M Rubio, Janet S Lee

Abstract readSystematic Review
In one paragraph

Synthesis in PloS one, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 72 papers, 10 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
72citing papers in PubMed, 10 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

72 citing papers in PubMed, 10 syntheses or guidelines pooled it.

  1. Guideline
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Guideline
  10. Pooled it
  11. Article
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review

12 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

SeungHye HanDivision of Pulmonary, Allergy, and Critical Care Medicine, Department of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America.ORCID http://orcid.org/0000-0001-5625-6337
Tolani F OlonisakinDivision of Pulmonary, Allergy, and Critical Care Medicine, Department of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America.
John P PribisIntegrative Molecular and Biomedical Sciences Graduate Program, Baylor College of Medicine, Houston, Texas, United States of America.
Jill ZupeticDivision of Pulmonary, Allergy, and Critical Care Medicine, Department of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America.
Joo Heung YoonDivision of Pulmonary, Allergy, and Critical Care Medicine, Department of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America.
Kyle M HolleranCenter for Research on Health Care Data Center, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America.
Kwonho JeongCenter for Research on Health Care Data Center, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America.
Nader ShaikhDepartment of Pediatrics, Children's Hospital of Pittsburgh, Pittsburgh, Pennsylvania, United States of America.
Doris M RubioCenter for Research on Health Care Data Center, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America.
Janet S LeeDivision of Pulmonary, Allergy, and Critical Care Medicine, Department of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America.

Funding

University of Pittsburgh Clinical and Translational Science InstituteUL1TR001857 · NCATS · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI REIS, STEVEN E · 2016 to 2025
$129.3M
Mechanisms of host protection against pathogen-secreted proteases in acute lung injuryR01HL136143 · NHLBI · WASHINGTON UNIVERSITY · PI LEE, JANET SOJUNG · 2017 to 2024
$4.4M
Red Cell Tranfusion: Modifier of Lung and Systemic Inflammatory ResponsesR01HL086884 · NHLBI · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI LEE, JANET SOJUNG · 2007 to 2017
$4.0M
The role of ACOD1 in immunomodulation in intrapulmonary Klebsiella pneumoniae infectionR01HL142084 · NHLBI · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI CHEN, KONG · 2018 to 2021
$2.4M
Enhancing Neutrophil Responses to Counter MDR Gram Negative Bacterial PneumoniaR21AI119042 · NIAID · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI LEE, JANET SOJUNG · 2015 to 2016
$429k
NCATS NIH HHS UL1 TR001857NHLBI NIH HHS R01 HL086884NHLBI NIH HHS R01 HL136143NHLBI NIH HHS R01 HL142084NIAID NIH HHS R21 AI119042
6 · The paper itself

Abstract

Irreproducibility of preclinical biomedical research has gained recent attention. It is suggested that requiring authors to complete a checklist at the time of manuscript submission would improve the quality and transparency of scientific reporting, and ultimately enhance reproducibility. Whether a checklist enhances quality and transparency in reporting preclinical animal studies, however, has not been empirically studied. Here we searched two highly cited life science journals, one that requires a checklist at submission (Nature) and one that does not (Cell), to identify in vivo animal studies. After screening 943 articles, a total of 80 articles were identified in 2013 (pre-checklist) and 2015 (post-checklist), and included for the detailed evaluation of reporting methodological and analytical information. We compared the quality of reporting preclinical animal studies between the two journals, accounting for differences between journals and changes over time in reporting. We find that reporting of randomization, blinding, and sample-size estimation significantly improved when comparing Nature to Cell from 2013 to 2015, likely due to implementation of a checklist. Specifically, improvement in reporting of the three methodological information was at least three times greater when a mandatory checklist was implemented than when it was not. Reporting the sex of animals and the number of independent experiments performed also improved from 2013 to 2015, likely from factors not related to a checklist. Our study demonstrates that completing a checklist at manuscript submission is associated with improved reporting of key methodological information in preclinical animal studies.

Indexed as

ChecklistData AccuracyAnimalsBiomedical ResearchDrug Evaluation, PreclinicalHumansModels, AnimalPublicationsReproducibility of ResultsResearch Design

Identifiers

PMID28902887
PMCPMC5597130

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.