Evidence map›Paper›PMID 31597578›Full record

ReviewGenome biology2019

Identifying significantly impacted pathways: a comprehensive review and assessment.

Tuan-Minh Nguyen, Adib Shafi, Tin Nguyen, Sorin Draghici

Erratum issuedAbstract readReview
In one paragraph

Review in Genome biology, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 137 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
137citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

137 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. ToxCompl completion of the DrugMatrix toxicogenomics database: an integrated resource for hypothesis generation.Toxicological sciences : an official journal of the Society of Toxicology · 2026
    Article
  6. Urinary metabolomic signatures of muscle injury and recovery in elite football players.Metabolomics : Official journal of the Metabolomic Society · 2026
    Observational
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. A practical guide to functional enrichment analysis.Frontiers in bioinformatics · 2026
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Simulated metabolic profiles reveal biases in pathway analysis methods.Metabolomics : Official journal of the Metabolomic Society · 2025
    Article
  19. Article
  20. Article

77 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors.

Tuan-Minh NguyenDepartment of Computer Science, Wayne State University, Detroit, 48202, USA.
Adib ShafiDepartment of Computer Science, Wayne State University, Detroit, 48202, USA.
Tin NguyenDepartment of Computer Science and Engineering, University of Nevada, Reno, 89557, USA.
Sorin DraghiciDepartment of Computer Science, Wayne State University, Detroit, 48202, USA. sorin@wayne.edu.ORCID http://orcid.org/0000-0002-0786-8377

Funding

Serine/threonine Protein Phosphatase 1 in Insulin resistance and Type 2 DiabetesR01DK107666 · NIDDK · WAYNE STATE UNIVERSITY · PI YI, ZHENGPING · 2015 to 2019
$2.6M
NIDDK NIH HHS R01 DK107666NIH/NIDDK 1R01DK107666-01
6 · The paper itself

Abstract

backgroundMany high-throughput experiments compare two phenotypes such as disease vs. healthy, with the goal of understanding the underlying biological phenomena characterizing the given phenotype. Because of the importance of this type of analysis, more than 70 pathway analysis methods have been proposed so far. These can be categorized into two main categories: non-topology-based (non-TB) and topology-based (TB). Although some review papers discuss this topic from different aspects, there is no systematic, large-scale assessment of such methods. Furthermore, the majority of the pathway analysis approaches rely on the assumption of uniformity of p values under the null hypothesis, which is often not true.

resultsThis article presents the most comprehensive comparative study on pathway analysis methods available to date. We compare the actual performance of 13 widely used pathway analysis methods in over 1085 analyses. These comparisons were performed using 2601 samples from 75 human disease data sets and 121 samples from 11 knockout mouse data sets. In addition, we investigate the extent to which each method is biased under the null hypothesis. Together, these data and results constitute a reliable benchmark against which future pathway analysis methods could and should be tested.

conclusionOverall, the result shows that no method is perfect. In general, TB methods appear to perform better than non-TB methods. This is somewhat expected since the TB methods take into consideration the structure of the pathway which is meant to describe the underlying phenomena. We also discover that most, if not all, listed approaches are biased and can produce skewed results under the null.

Indexed as

AnimalsGenomicsHumansStatistics as TopicBiasMetabolic pathwaysNetwork topologyPathway analysisSignaling pathwaysStatistical significance

Identifiers

PMID31597578
PMCPMC6784345

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.