Evidence map›Paper›PMID 25984700›Full record

ArticleNature methods2015

Combining tumor genome simulation with crowdsourcing to benchmark somatic single-nucleotide-variant detection.

Adam D Ewing, Kathleen E Houlahan, Yin Hu, Kyle Ellrott, Cristian Caloian, Takafumi N Yamaguchi, J Christopher Bare, Christine P'ng, Daryl Waggott, Veronica Y Sabelnykova and 9 more

Abstract read
In one paragraph

Article in Nature methods, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 204 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
204citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

204 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Trial
  6. Trial
  7. Article
  8. Review
  9. Article
  10. Article
  11. A complete human pancreatic cancer genome.bioRxiv : the preprint server for biology · 2026
    Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
  18. Scalable and comprehensive mosaic variant calling using DRAGEN.medRxiv : the preprint server for health sciences · 2026
    Article
  19. Article
  20. Article

144 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

19 authors.

Adam D Ewing1] Department of Biomolecular Engineering, University of California, Santa Cruz, Santa Cruz, California, USA. [2] Mater Research Institute, University of Queensland, Woolloongabba, Queensland, Australia.
Kathleen E HoulahanInformatics and Biocomputing Program, Ontario Institute for Cancer Research, Toronto, Ontario, Canada.
Yin HuSage Bionetworks, Seattle, Washington, USA.
Kyle EllrottDepartment of Biomolecular Engineering, University of California, Santa Cruz, Santa Cruz, California, USA.
Cristian CaloianInformatics and Biocomputing Program, Ontario Institute for Cancer Research, Toronto, Ontario, Canada.
Takafumi N YamaguchiInformatics and Biocomputing Program, Ontario Institute for Cancer Research, Toronto, Ontario, Canada.ORCID 0000000310823871
J Christopher BareSage Bionetworks, Seattle, Washington, USA.ORCID 0000000310061491
Christine P'ngInformatics and Biocomputing Program, Ontario Institute for Cancer Research, Toronto, Ontario, Canada.
Daryl WaggottInformatics and Biocomputing Program, Ontario Institute for Cancer Research, Toronto, Ontario, Canada.
Veronica Y SabelnykovaInformatics and Biocomputing Program, Ontario Institute for Cancer Research, Toronto, Ontario, Canada.
ICGC-TCGA DREAM Somatic Mutation Calling Challenge participants
Michael R KellenSage Bionetworks, Seattle, Washington, USA.ORCID 0000000240967078
Thea C NormanSage Bionetworks, Seattle, Washington, USA.
David HausslerDepartment of Biomolecular Engineering, University of California, Santa Cruz, Santa Cruz, California, USA.
Stephen H FriendSage Bionetworks, Seattle, Washington, USA.
Gustavo StolovitzkyIBM Computational Biology Center, T.J. Watson Research Center, Yorktown Heights, New York, USA.
Adam A Margolin1] Sage Bionetworks, Seattle, Washington, USA. [2] Computational Biology Program, Oregon Health &Science University, Portland, Oregon, USA. [3] Department of Biomedical Engineering, Oregon Health &Science University, Portland, Oregon, USA.
Joshua M StuartDepartment of Biomolecular Engineering, University of California, Santa Cruz, Santa Cruz, California, USA.
Paul C Boutros1] Informatics and Biocomputing Program, Ontario Institute for Cancer Research, Toronto, Ontario, Canada. [2] Department of Medical Biophysics, University of Toronto, Toronto, Ontario, Canada. [3] Department of Pharmacology &Toxicology, University of Toronto, Toronto, Ontario, Canada.ORCID 0000000305537520

Funding

Tumor Evolution and Metastasis ProgramP30CA016672 · NCI · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI Scott Kopetz · 1985 to 2026
$290.8M
Comparative Genomics Unit ResearchZIAHG200330 · NHGRI · NATIONAL HUMAN GENOME RESEARCH INSTITUTE · PI MULLIKIN, JAMES C · 2009 to 2022
$17.9M
Training SubprojectU54HG007990 · NHGRI · UNIVERSITY OF CALIFORNIA SANTA CRUZ · PI HAUSSLER, DAVID H, PATTERSON, DAVID · 2014 to 2018
$14.8M
UCSC-Buck Inst. Genome Data Analysis Center for TCGA Research Network (GDAC)U24CA143858 · NCI · UNIVERSITY OF CALIFORNIA SANTA CRUZ · PI BENZ, CHRISTOPHER, HAUSSLER, DAVID H · 2009 to 2016
$8.9M
An integrated computational and functional genomics discovery engine for precliniU01CA176303 · NCI · FRED HUTCHINSON CANCER RESEARCH CENTER · PI KEMP, CHRISTOPHER J · 2013 to 2016
$4.1M
BIGDATA: Mid-Scale DCM: DA: ESCE: Discovering Molecular ProcessesR01CA180778 · NCI · UNIVERSITY OF CALIFORNIA SANTA CRUZ · PI STUART, JOSHUA MICHAEL · 2013 to 2017
$3.5M
Statistical methods for genomic analysis of heterogeneous tumorsR01CA183793 · NCI · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI WANG, WENYI · 2014 to 2018
$1.7M
Canadian Institutes of Health ResearchNCI NIH HHS P30 CA016672NCI NIH HHS R01 CA180778NCI NIH HHS R01-CA180778NCI NIH HHS R01 CA183793NCI NIH HHS U01 CA176303NCI NIH HHS U01-CA176303NCI NIH HHS U24 CA143858NCI NIH HHS U24-CA143858NHGRI NIH HHS U54 HG007990
6 · The paper itself

Abstract

The detection of somatic mutations from cancer genome sequences is key to understanding the genetic basis of disease progression, patient survival and response to therapy. Benchmarking is needed for tool assessment and improvement but is complicated by a lack of gold standards, by extensive resource requirements and by difficulties in sharing personal genomic information. To resolve these issues, we launched the ICGC-TCGA DREAM Somatic Mutation Calling Challenge, a crowdsourced benchmark of somatic mutation detection algorithms. Here we report the BAMSurgeon tool for simulating cancer genomes and the results of 248 analyses of three in silico tumors created with it. Different algorithms exhibit characteristic error profiles, and, intriguingly, false positives show a trinucleotide profile very similar to one found in human tumors. Although the three simulated tumors differ in sequence contamination (deviation from normal cell sequence) and in subclonality, an ensemble of pipelines outperforms the best individual pipeline in all cases. BAMSurgeon is available at https://github.com/adamewing/bamsurgeon/.

Indexed as

BenchmarkingCrowdsourcingGenomePolymorphism, Single NucleotideAlgorithmsHumansNeoplasms

Identifiers

PMID25984700
PMCPMC4856034

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-SA
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.