Evidence map›Paper›PMID 38689008›Full record

ArticleArchives of toxicology2024

Avoiding a reproducibility crisis in regulatory toxicology-on the fundamental role of ring trials.

Miriam N Jacobs, Sebastian Hoffmann, Heli M Hollnagel, Petra Kern, Susanne N Kolle, Andreas Natsch, Robert Landsiedel

Abstract read
In one paragraph

Article in Archives of toxicology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Article
  2. Article
  3. Readiness of theFrontiers in toxicology · 2026
    Article
  4. Review
  5. Article
  6. Review
  7. Article
  8. Article
  9. Review
  10. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Miriam N JacobsRadiation, Chemical and Environmental Hazards (RCE), Department of Toxicology, UK Health Security Agency (UKHSA), Harwell Science and Innovation Campus, Chilton, OX11 0RQ, UK.ORCID 0000-0002-4858-0118
Sebastian HoffmannSeh Consulting + Services, Paderborn, Germany.ORCID 0000-0002-3214-7678
Heli M HollnagelDow Europe GmbH, Horgen, Switzerland.ORCID 0000-0002-4648-4886
Petra KernProcter & Gamble Services Company NV, Strombeek-Bever, Belgium.
Susanne N KolleBASF SE, Experimental Toxicology and Ecology, Ludwigshafen am Rhein, Germany.ORCID 0000-0002-3502-1034
Andreas NatschGivaudan Suisse SA, 8310, Kemptthal, Switzerland.ORCID 0000-0003-2231-2489
Robert LandsiedelBASF SE, Experimental Toxicology and Ecology, Ludwigshafen am Rhein, Germany. robert.landsiedel@fu-berlin.de.ORCID 0000-0003-3756-1904

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

The ongoing transition from chemical hazard and risk assessment based on animal studies to assessment relying mostly on non-animal data, requires a multitude of novel experimental methods, and this means that guidance on the validation and standardisation of test methods intended for international applicability and acceptance, needs to be updated. These so-called new approach methodologies (NAMs) must be applicable to the chemical regulatory domain and provide reliable data which are relevant to hazard and risk assessment. Confidence in and use of NAMs will depend on their reliability and relevance, and both are thoroughly assessed by validation. Validation is, however, a time- and resource-demanding process. As updates on validation guidance are conducted, the valuable components must be kept: Reliable data are and will remain fundamental. In 2016, the scientific community was made aware of the general crisis in scientific reproducibility-validated methods must not fall into this. In this commentary, we emphasize the central importance of ring trials in the validation of experimental methods. Ring trials are sometimes considered to be a major hold-up with little value added to the validation. Here, we clarify that ring trials are indispensable to demonstrate the robustness and reproducibility of a new method. Further, that methods do fail in method transfer and ring trials due to different stumbling blocks, but these provide learnings to ensure the robustness of new methods. At the same time, we identify what it would take to perform ring trials more efficiently, and how ring trials fit into the much-needed update to the guidance on the validation of NAMs.

Indexed as

ToxicologyAnimalsAnimal Testing AlternativesHumansReproducibility of ResultsResearch DesignRisk AssessmentToxicity TestsValidation Studies as TopicOECD Test GuidelinesReliabilityRing trialsRobustnessValidation

Identifiers

PMID38689008
PMCPMC11169035

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.