Evidence map›Paper›PMID 34233495›Full record

ReviewAlternatives to laboratory animals : ATLA2021

Curated Data In - Trustworthy

Vinicius M Alves, Scott S Auerbach, Nicole Kleinstreuer, John P Rooney, Eugene N Muratov, Ivan Rusyn, Alexander Tropsha, Charles Schmitt

Abstract readReview
In one paragraph

Review in Alternatives to laboratory animals : ATLA, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 23 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
23citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

23 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Review
  4. Article
  5. Article
  6. Review
  7. Review
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Review
  14. Review
  15. Review
  16. Article
  17. PreS/MD: Predictor of Sensitization Hazard for Chemical Substances Released From Medical Devices.Toxicological sciences : an official journal of the Society of Toxicology · 2022
    Article
  18. STopTox: AnEnvironmental health perspectives · 2022
    Article
  19. Clean and Safe Drinking Water SystemsFrontiers in microbiology · 2022
    Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Vinicius M AlvesOffice of Data Science, Division of the National Toxicology Program (DNTP), 6857National Institute of Environmental Health Sciences (NIEHS), Durham, NC, USA.ORCID https://orcid.org/0000-0002-6182-1748
Scott S AuerbachToxinformatics Group, Predictive Toxicology Branch, DNTP, NIEHS, Durham, NC, USA.
Nicole KleinstreuerNational Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, Scientific Director's Office, DNTP, NIEHS, Durham, NC, USA.
John P RooneyIntegrated Laboratory Systems, LLC, Morrisville, NC, USA.
Eugene N MuratovLaboratory for Molecular Modeling, UNC Eshelman School of Pharmacy, 2331The University of North Carolina at Chapel Hill, NC, USA.
Ivan RusynDepartment of Veterinary Integrative Biosciences, College of Veterinary Medicine and Biomedical Sciences, Texas A&M University, College Station, TX, USA.
Alexander TropshaLaboratory for Molecular Modeling, UNC Eshelman School of Pharmacy, 2331The University of North Carolina at Chapel Hill, NC, USA.
Charles SchmittOffice of Data Science, Division of the National Toxicology Program (DNTP), 6857National Institute of Environmental Health Sciences (NIEHS), Durham, NC, USA.

Funding

Single cell, multi-parametric high throughput platform to classify endocrine disruptor potential of mixturesP42ES027704 · NIEHS · TEXAS A&M UNIVERSITY · PI Weihsueh A Chiu · 2017 to 2026
$21.2M
Development of Data Science MethodsZIAES103364 · NIEHS · NATIONAL INSTITUTE OF ENVIRONMENTAL HEALTH SCIENCES · PI SCHMITT, CHARLES · 2021 to 2025
$1.6M
NIEHS NIH HHS P42 ES027704
6 · The paper itself

Abstract

New Approach Methodologies (NAMs) that employ artificial intelligence (AI) for predicting adverse effects of chemicals have generated optimistic expectations as alternatives to animal testing. However, the major underappreciated challenge in developing robust and predictive AI models is the impact of the quality of the input data on the model accuracy. Indeed, poor data reproducibility and quality have been frequently cited as factors contributing to the crisis in biomedical research, as well as similar shortcomings in the fields of toxicology and chemistry. In this article, we review the most recent efforts to improve confidence in the robustness of toxicological data and investigate the impact that data curation has on the confidence in model predictions. We also present two case studies demonstrating the effect of data curation on the performance of AI models for predicting skin sensitisation and skin irritation. We show that, whereas models generated with uncurated data had a 7-24% higher correct classification rate (CCR), the perceived performance was, in fact, inflated owing to the high number of duplicates in the training set. We assert that data curation is a critical step in building computational models, to help ensure that reliable predictions of chemical toxicity are achieved through use of the models.

Indexed as

Animal Testing AlternativesArtificial IntelligenceAnimalsComputer SimulationData AccuracyReproducibility of Resultsartificial intelligencedata curationdata qualitydata reproducibilityQSAR

Identifiers

PMID34233495
PMCPMC8609471

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.