Evidence map›Paper›PMID 33057217›Full record

ArticleNature2020

Transparency and reproducibility in artificial intelligence.

Benjamin Haibe-Kains, George Alexandru Adam, Ahmed Hosny, Farnoosh Khodakarami, Massive Analysis Quality Control (MAQC) Society Board of Directors, Levi Waldron, Bo Wang, Chris McIntosh, Anna Goldenberg, Anshul Kundaje and 13 more

Abstract readLetterComment
In one paragraph

Article in Nature, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 175 papers, 11 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
175citing papers in PubMed, 11 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

175 citing papers in PubMed, 11 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Pooled it
  11. Pooled it
  12. Review
  13. Review
  14. Review
  15. Article
  16. Review
  17. Article
  18. Review
  19. Article
  20. Review

115 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

23 authors.

Benjamin Haibe-KainsPrincess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada. bhaibeka@uhnresearch.ca.ORCID http://orcid.org/0000-0002-7684-0079
George Alexandru AdamDepartment of Computer Science, University of Toronto, Toronto, Ontario, Canada.
Ahmed HosnyArtificial Intelligence in Medicine (AIM) Program, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA.
Farnoosh KhodakaramiPrincess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada.
Massive Analysis Quality Control (MAQC) Society Board of Directors
Levi WaldronDepartment of Epidemiology and Biostatistics and Institute for Implementation Science in Population Health, CUNY Graduate School of Public Health and Health Policy, New York, NY, USA.
Bo WangDepartment of Medical Biophysics, University of Toronto, Toronto, Ontario, Canada.
Chris McIntoshDepartment of Medical Biophysics, University of Toronto, Toronto, Ontario, Canada.
Anna GoldenbergDepartment of Computer Science, University of Toronto, Toronto, Ontario, Canada.
Anshul KundajeDepartment of Genetics, Stanford University School of Medicine, Stanford, CA, USA.ORCID http://orcid.org/0000-0003-3084-2287
Casey S GreeneDept. of Systems Pharmacology and Translational Therapeutics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.ORCID http://orcid.org/0000-0001-8713-9213
Tamara BroderickDepartment of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA, USA.
Michael M HoffmanPrincess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada.ORCID http://orcid.org/0000-0002-4517-1562
Jeffrey T LeekDepartment of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA.
Keegan KorthauerDepartment of Statistics, University of British Columbia, Vancouver, British Columbia, Canada.
Wolfgang HuberEuropean Molecular Biology Laboratory, Genome Biology Unit, Heidelberg, Germany.ORCID http://orcid.org/0000-0002-0474-2218
Alvis BrazmaEuropean Molecular Biology Laboratory, European Bioinformatics Institute, EMBL-EBI, Hinxton, UK.ORCID http://orcid.org/0000-0001-5988-7409
Joelle PineauMcGill University, Montreal, Quebec, Canada.ORCID http://orcid.org/0000-0003-0747-7250
Robert TibshiraniDepartment of Statistics, Stanford University School of Humanities and Sciences, Stanford, CA, USA.
Trevor HastieDepartment of Statistics, Stanford University School of Humanities and Sciences, Stanford, CA, USA.
John P A IoannidisDepartment of Statistics, Stanford University School of Humanities and Sciences, Stanford, CA, USA.
John QuackenbushDepartment of Biostatistics, Harvard T.H Chan School of Public Health, Boston, MA, USA.ORCID http://orcid.org/0000-0002-2702-5879
Hugo J W L AertsArtificial Intelligence in Medicine (AIM) Program, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA.

Funding

Cancer Genomics:Integrative and Scalable Solutions in R / BioconductorU24CA180996 · NCI · ROSWELL PARK CANCER INSTITUTE CORP · PI MORGAN, MARTIN T, WALDRON, LEVI · 2014 to 2023
$6.9M
Characterization of high-grade serous ovarian cancer subtypes via single-cell profilingR01CA237170 · NCI · UNIVERSITY OF PENNSYLVANIA · PI DOHERTY, JENNIFER A., GREENE, CASEY S · 2019 to 2024
$3.0M
Deep learning frameworks for regulatory genomics.DP2GM123485 · NIGMS · STANFORD UNIVERSITY · PI KUNDAJE, ANSHUL · 2016 to 2016
$2.4M
Biotechnology and Biological Sciences Research Council BB/E025080/1NCI NIH HHS R01 CA237170NCI NIH HHS U24 CA180996NIGMS NIH HHS DP2 GM123485
6 · The paper itself

Abstract

PubMed holds no abstract for this paper.

Indexed as

AlgorithmsArtificial IntelligenceReproducibility of Results

Identifiers

PMID33057217
PMCPMC8144864

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.