Evidence map›Paper›PMID 23070592›Full record

ArticleStatistical methods in medical research2016

The limitations of simple gene set enrichment analysis assuming gene independence.

Pablo Tamayo, George Steinhardt, Arthur Liberzon, Jill P Mesirov

Abstract read
In one paragraph

Article in Statistical methods in medical research, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 71 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
71citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

71 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. TGFB1 Induces Fetal Reprogramming and Enhances Intestinal Regeneration.bioRxiv : the preprint server for biology · 2023
    Article
  20. Article

11 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Pablo TamayoThe Eli and Edythe L. Broad Institute of Massachusetts Institute of Technology and Harvard University, Cambridge, MA, USA tamayo@broadinstitute.org.
George SteinhardtBoston University Bioinformatics Program, Boston University, Boston, MA, USA.
Arthur LiberzonThe Eli and Edythe L. Broad Institute of Massachusetts Institute of Technology and Harvard University, Cambridge, MA, USA.
Jill P MesirovThe Eli and Edythe L. Broad Institute of Massachusetts Institute of Technology and Harvard University, Cambridge, MA, USA Boston University Bioinformatics Program, Boston University, Boston, MA, USA.

Funding

VIRAL MALIGNANCYP30CA023100 · NCI · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI DIANE M SIMEONE · 1985 to 2026
$124.9M
GENOMIC ANALYSIS OF MEDULLOBLASTOMASR01CA109467 · NCI · CHILDREN'S HOSPITAL BOSTON · PI MESIROV, JILL P., POMEROY, SCOTT LOREN · 2004 to 2015
$7.3M
Mouse Neurodevelopmental Behavior CoreU54HD090255 · NICHD · BOSTON CHILDREN'S HOSPITAL · PI WOOLF, CLIFFORD J · 2016 to 2020
$5.2M
Knowledge-based Gene Expression Analysis for Biomedical and Cancer ResearchR01CA121941 · NCI · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI MESIROV, JILL P. · 2006 to 2016
$5.1M
GenePattern Notebooks for Cancer ResearchU24CA194107 · NCI · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI MESIROV, JILL P. · 2015 to 2019
$2.8M
NCI NIH HHS P30 CA023100NCI NIH HHS R01 CA109467NCI NIH HHS R01 CA121941NCI NIH HHS R01-CA121941NCI NIH HHS U24 CA194107NICHD NIH HHS U54 HD090255
6 · The paper itself

Abstract

Since its first publication in 2003, the Gene Set Enrichment Analysis method, based on the Kolmogorov-Smirnov statistic, has been heavily used, modified, and also questioned. Recently a simplified approach using a one-sample t-test score to assess enrichment and ignoring gene-gene correlations was proposed by Irizarry et al. 2009 as a serious contender. The argument criticizes Gene Set Enrichment Analysis's nonparametric nature and its use of an empirical null distribution as unnecessary and hard to compute. We refute these claims by careful consideration of the assumptions of the simplified method and its results, including a comparison with Gene Set Enrichment Analysis's on a large benchmark set of 50 datasets. Our results provide strong empirical evidence that gene-gene correlations cannot be ignored due to the significant variance inflation they produced on the enrichment scores and should be taken into account when estimating gene set enrichment significance. In addition, we discuss the challenges that the complex correlation structure and multi-modality of gene sets pose more generally for gene set enrichment methods.

Indexed as

Genome, HumanKnowledge BasesBiostatisticsDatabases, GeneticEpistasis, GeneticGene Expression ProfilingHumansModels, StatisticalOligonucleotide Array Sequence AnalysisStatistics, Nonparametricgene expressionGene set enrichment analysis

Identifiers

PMID23070592
PMCPMC3758419

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.