Evidence map›Paper›PMID 24330332›Full record

ArticleBMC bioinformatics2013

Gene set bagging for estimating the probability a statistically significant result will replicate.

Andrew E Jaffe, John D Storey, Hongkai Ji, Jeffrey T Leek

Abstract read
In one paragraph

Article in BMC bioinformatics, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Andrew E Jaffe
John D Storey
Hongkai Ji
Jeffrey T LeekDepartment of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore MD 21205, USA. jleek@jhsph.edu.

Funding

Minority Action PlanP50HG003233 · NHGRI · JOHNS HOPKINS UNIVERSITY · PI FEINBERG, ANDREW P. · 2004 to 2013
$22.4M
Overcoming bias and unwanted variability in next generation sequencingR01HG005220 · NHGRI · JOHNS HOPKINS UNIVERSITY · PI IRIZARRY, RAFAEL ANGEL · 2010 to 2018
$3.6M
Statistical Methods for High-Throughput Gene Expression ProfilingR01HG002913 · NHGRI · UNIVERSITY OF WASHINGTON · PI STOREY, JOHN D · 2004 to 2015
$3.1M
NHGRI NIH HHS P50HG003233NHGRI NIH HHS R01 HG002913NHGRI NIH HHS R01HG002913NHGRI NIH HHS R01HG005220
6 · The paper itself

Abstract

backgroundSignificance analysis plays a major role in identifying and ranking genes, transcription factor binding sites, DNA methylation regions, and other high-throughput features associated with illness. We propose a new approach, called gene set bagging, for measuring the probability that a gene set replicates in future studies. Gene set bagging involves resampling the original high-throughput data, performing gene-set analysis on the resampled data, and confirming that biological categories replicate in the bagged samples.

resultsUsing both simulated and publicly-available genomics data, we demonstrate that significant categories in a gene set enrichment analysis may be unstable when subjected to resampling. We show our method estimates the replication probability (R), the probability that a gene set will replicate as a significant result in future studies, and show in simulations that this method reflects replication better than each set's p-value.

conclusionsOur results suggest that gene lists based on p-values are not necessarily stable, and therefore additional steps like gene set bagging may improve biological inference on gene sets.

Indexed as

AlgorithmsBinding SitesBrain ChemistryComputer SimulationDatabases, FactualDNA MethylationDNA ReplicationGene Expression ProfilingGenome, HumanGenomicsHumansOligonucleotide Array Sequence AnalysisPredictive Value of TestsProbabilitySample SizeSmokingTranscription Factors

Identifiers

PMID24330332
PMCPMC3890500

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.