Evidence map›Paper›PMID 29357292›Full record

ReviewNeuroscience and biobehavioral reviews2018

Reproducibility and replicability of rodent phenotyping in preclinical studies.

Neri Kafkafi, Joseph Agassi, Elissa J Chesler, John C Crabbe, Wim E Crusio, David Eilam, Robert Gerlai, Ilan Golani, Alex Gomez-Marin, Ruth Heller and 16 more

Abstract readReview
In one paragraph

Review in Neuroscience and biobehavioral reviews, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 99 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
99citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

99 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Mechanisms underlying end-organ injury in sleep apnoea.The European respiratory journal · 2026
    Review
  5. Article
  6. Article
  7. Review
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Article
  16. Article
  17. Review
  18. A new module in the drug development process: preclinical multi-center randomized controlled trial of R-ketamine on alcohol relapse.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2025
    Article
  19. Article
  20. Article

39 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

26 authors.

Neri KafkafiTel Aviv University, Israel. Electronic address: nkafkafi@post.tau.ac.il.
Joseph AgassiTel Aviv University, Israel.
Elissa J CheslerThe Jackson Laboratory, United States.
John C CrabbeOregon Health & Science University, and VA Portland Health Care System, United States.
Wim E CrusioINCIA, Université de Bordeaux and CNRS, France.
David EilamTel Aviv University, Israel.
Robert GerlaiUniversity of Toronto, Canada.
Ilan GolaniTel Aviv University, Israel.
Alex Gomez-MarinInstituto de Neurociencias CSIC-UMH, Alicante, Spain.
Ruth HellerTel Aviv University, Israel.
Fuad IraqiTel Aviv University, Israel.
Iman JaljuliTel Aviv University, Israel.
Natasha A KarpDiscovery Sciences, IMED Biotech Unit, AstraZeneca, Cambridge, UK.
Hugh MorganHarwell Research Center, UK.
George NicholsonUniversity of Oxford, UK.
Donald W PfaffRockefeller University, United States.
S Helene RichterUniversity of Müenster, Germany.
Philip B StarkUniversity of California, Berkeley, United States.
Oliver StiedlVU University Amsterdam, Netherlands.
Victoria StoddenUniversity of Illinois at Urbana-Champaign, United States.
Lisa M TarantinoUniversity of North Carolina at Chapel Hill, United States.
Valter TucciIstituto Italiano di Tecnologia, Italy.
William ValdarUniversity of North Carolina at Chapel Hill, United States.
Robert W WilliamsUniversity of Tennessee Health Science Center, United States.
Hanno WürbelUniversity of Bern, Switzerland.
Yoav BenjaminiTel Aviv University, Israel.

Funding

Translational measures of risk for excessive alcohol consumptionP60AA010760 · NIAAA · OREGON HEALTH & SCIENCE UNIVERSITY · PI TAMARA J. PHILLIPS · 2006 to 2026
$34.5M
Selective Breeding for Drinking in the Circadian DarkU01AA013519 · NIAAA · OREGON HEALTH & SCIENCE UNIVERSITY · PI Angela Renee Ozburn · 2001 to 2026
$10.9M
TIM Project NIDA P30 CenterP30DA044223 · NIDA · UNIVERSITY OF TENNESSEE HEALTH SCI CTR · PI WILLIAMS, ROBERT W. · 2017 to 2021
$3.9M
Data Structures, Algorithms and Tools for Ontological DiscoveryR01AA018776 · NIAAA · JACKSON LABORATORY · PI CHESLER, ELISSA J · 2010 to 2019
$3.9M
Statistical Modeling of Complex Traits in Genetic Reference Super-PopulationsR01GM104125 · NIGMS · UNIV OF NORTH CAROLINA CHAPEL HILL · PI VALDAR, WILLIAM · 2012 to 2016
$1.2M
CRCNS: Computational Approach to Assess Replicability of Neurobehavior Phenotypes R01DA045401 · NIDA · JACKSON LABORATORY · PI BOGUE, MOLLY A · 2017 to 2019
$760k
NIAAA NIH HHS P60 AA010760NIAAA NIH HHS R01 AA018776NIAAA NIH HHS U01 AA013519NIDA NIH HHS P30 DA044223NIDA NIH HHS R01 DA045401NIGMS NIH HHS R01 GM104125
6 · The paper itself

Abstract

The scientific community is increasingly concerned with the proportion of published "discoveries" that are not replicated in subsequent studies. The field of rodent behavioral phenotyping was one of the first to raise this concern, and to relate it to other methodological issues: the complex interaction between genotype and environment; the definitions of behavioral constructs; and the use of laboratory mice and rats as model species for investigating human health and disease mechanisms. In January 2015, researchers from various disciplines gathered at Tel Aviv University to discuss these issues. The general consensus was that the issue is prevalent and of concern, and should be addressed at the statistical, methodological and policy levels, but is not so severe as to call into question the validity and the usefulness of model organisms as a whole. Well-organized community efforts, coupled with improved data and metadata sharing, have a key role in identifying specific problems and promoting effective solutions. Replicability is closely related to validity, may affect generalizability and translation of findings, and has important ethical implications.

Indexed as

Behavior, AnimalAnimal ExperimentationAnimalsInformation DisseminationModels, AnimalPhenotypeReproducibility of ResultsResearchResearch DesignRodentiaData sharingFalse discoveriesGxE interactionHeterogenizationReplicabilityReproducibilityValidity

Identifiers

PMID29357292
PMCPMC6071910

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.