Evidence map›Paper›PMID 38902649›Full record

ArticleBMC infectious diseases2024

Comparison of gene set scoring methods for reproducible evaluation of tuberculosis gene signatures.

Xutao Wang, Arthur VanValkenberg, Aubrey R Odom, Jerrold J Ellner, Natasha S Hochberg, Padmini Salgame, Prasad Patil, W Evan Johnson

Abstract readComparative Study
In one paragraph

Article in BMC infectious diseases, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Biomarker tests of progression from tuberculosis infection to disease: a systematic review.European respiratory review : an official journal of the European Respiratory Society · 2026
    Pooled it
  2. Monocyte-Amplified Transcriptional Signatures of Human Diseases.bioRxiv : the preprint server for biology · 2026
    Article
  3. Article
  4. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors.

Xutao WangDepartment of Biostatistics, Boston University, Boston, MA, USA.
Arthur VanValkenbergDivision of Infectious Disease, Center for Data Science, Rutgers New Jersey Medical School, Newark, NJ, USA.
Aubrey R OdomDivision of Computational Biomedicine and Bioinformatics Program, Boston University, Boston, MA, USA.
Jerrold J EllnerDepartment of Medicine, Center for Emerging Pathogens, Rutgers New Jersey Medical School, Newark, NJ, USA.
Natasha S HochbergBoston Medical Center, Boston, MA, USA.
Padmini SalgameDepartment of Medicine, Center for Emerging Pathogens, Rutgers New Jersey Medical School, Newark, NJ, USA.
Prasad Patil *Department of Biostatistics, Boston University, Boston, MA, USA.
W Evan Johnson *Division of Infectious Disease, Center for Data Science, Rutgers New Jersey Medical School, Newark, NJ, USA. w.evan.johnson@rutgers.edu.

Funding

FEND for TB supplement to accelerate BLINK X developmentU01AI152084 · NIAID · RUTGERS BIOMEDICAL AND HEALTH SCIENCES · PI ALLAND, DAVID, DORMAN, SUSAN E · 2020 to 2024
$20.0M
Novel and Optimized Diagnostics for Pediatric TBR01AI152159 · NIAID · RUTGERS BIOMEDICAL AND HEALTH SCIENCES · PI ALLAND, DAVID, ELLNER, JERROLD J. · 2020 to 2024
$6.0M
Multidisciplinary Training Program in Cardiovascular EpidemiologyT32HL125232 · NHLBI · BOSTON UNIVERSITY MEDICAL CAMPUS · PI Matthew G. Nayor, Vanessa Xanthakis · 2016 to 2026
$5.0M
Biomarker Signatures of TB Infection in Young Children With and Without HIVR01AI175315 · NIAID · RUTGERS BIOMEDICAL AND HEALTH SCIENCES · PI Jerrold J. Ellner, William Evan Johnson · 2023 to 2026
$4.2M
Removing batch effects in high-throughput biomedical studiesR01GM127430 · NIGMS · RUTGERS BIOMEDICAL AND HEALTH SCIENCES · PI William Evan Johnson · 2018 to 2026
$2.4M
Signature of profiling and staging the progression of TB from infection to disease.R21AI154387 · NIAID · BOSTON UNIVERSITY MEDICAL CAMPUS · PI JOHNSON, WILLIAM EVAN · 2020 to 2021
$468k
NHLBI NIH HHS T32 HL125232NIAID NIH HHS L30 AI107878NIAID NIH HHS R01 AI152159NIAID NIH HHS R01 AI175315NIAID NIH HHS R21 AI154387NIAID NIH HHS U01 AI152084NIGMS NIH HHS R01 GM127430NIH HHS R01GM127430
6 · The paper itself

Abstract

backgroundBlood-based transcriptional gene signatures for tuberculosis (TB) have been developed with potential use to diagnose disease. However, an unresolved issue is whether gene set enrichment analysis of the signature transcripts alone is sufficient for prediction and differentiation or whether it is necessary to use the original model created when the signature was derived. Intra-method comparison is complicated by the unavailability of original training data and missing details about the original trained model. To facilitate the utilization of these signatures in TB research, comparisons between gene set scoring methods cross-data validation of original model implementations are needed.

methodsWe compared the performance of 19 TB gene signatures across 24 transcriptomic datasets using both rrebuilt original models and gene set scoring methods. Existing gene set scoring methods, including ssGSEA, GSVA, PLAGE, Singscore, and Zscore, were used as alternative approaches to obtain the profile scores. The area under the ROC curve (AUC) value was computed to measure performance. Correlation analysis and Wilcoxon paired tests were used to compare the performance of enrichment methods with the original models.

resultsFor many signatures, the predictions from gene set scoring methods were highly correlated and statistically equivalent to the results given by the original models. In some cases, PLAGE outperformed the original models when considering signatures' weighted mean AUC values and the AUC results within individual studies.

conclusionGene set enrichment scoring of existing gene sets can distinguish patients with active TB disease from other clinical conditions with equivalent or improved accuracy compared to the original methods and models. These data justify using gene set scoring methods of published TB gene signatures for predicting TB risk and treatment outcomes, especially when original models are difficult to apply or implement.

Indexed as

Gene Expression ProfilingTuberculosisHumansMycobacterium tuberculosisReproducibility of ResultsROC CurveTranscriptomeGene scoring methodsOriginal modelReproducibility

Identifiers

PMID38902649
PMCPMC11191245

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.