Evidence map›Paper›PMID 31281919›Full record

ArticleBriefings in bioinformatics2020

Consistency and overfitting of multi-omics methods on experimental data.

Sean D McCabe, Dan-Yu Lin, Michael I Love

Abstract read
In one paragraph

Article in Briefings in bioinformatics, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Review
  5. Enhancement of the Antioxidant Activity ofMolecules (Basel, Switzerland) · 2025
    Article
  6. Review
  7. Article
  8. Review
  9. Article
  10. Article
  11. Proarrhythmic risk assessment of drugs by dVCPT: pharmacometrics & systems pharmacology · 2022
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Incorporating Machine Learning into Established Bioinformatics Frameworks.International journal of molecular sciences · 2021
    Review
  18. Integration strategies of multi-omics data for machine learning analysis.Computational and structural biotechnology journal · 2021
    Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Sean D McCabeDepartment of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA.
Dan-Yu LinDepartment of Genetics, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA.
Michael I LoveDepartment of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA.

Funding

UNC-CH CENTER FOR ENVIRONMENTAL HEALTH &SUSCEPTIBILITYP30ES010126 · NIEHS · UNIV OF NORTH CAROLINA CHAPEL HILL · PI Melissa A. Troester · 2001 to 2026
$36.3M
Statistical Methods for Cancer Clinical TrialsP01CA142538 · NCI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI DAVIDIAN, MARIE, KOSOROK, MICHAEL R · 2010 to 2019
$21.3M
Biostatistics for Research in Genomics and CancerT32CA106209 · NCI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI JOSEPH G IBRAHIM, Naim Ur Rashid · 2004 to 2026
$4.8M
A Modular Framework for Accurate, Interpretable, and Reproducible Analysis of Long Read RNA-Seq DataR01HG009937 · NHGRI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI Michael Isaiah Love, Robert Patro · 2018 to 2026
$2.8M
Semiparametric Analysis of Big Censored DataR01HL149683 · NHLBI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI LIN, DANYU · 2020 to 2023
$1.9M
Statistical Methods in Trans-Omics Chronic Disease ResearchR01HG009974 · NHGRI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI LIN, DANYU · 2018 to 2022
$1.5M
Multi-tissue and network models for next-generation EQTL studiesR01HG009125 · NHGRI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI NOBEL, ANDREW B, WRIGHT, FRED A. · 2016 to 2018
$1.1M
NCI NIH HHS P01 CA142538NCI NIH HHS T32 CA106209NHGRI NIH HHS R01 HG009125NHGRI NIH HHS R01 HG009937NHGRI NIH HHS R01 HG009974NHLBI NIH HHS R01 HL149683NIEHS NIH HHS P30 ES010126
6 · The paper itself

Abstract

Knowledge on the relationship between different biological modalities (RNA, chromatin, etc.) can help further our understanding of the processes through which biological components interact. The ready availability of multi-omics datasets has led to the development of numerous methods for identifying sources of common variation across biological modalities. However, evaluation of the performance of these methods, in terms of consistency, has been difficult because most methods are unsupervised. We present a comparison of sparse multiple canonical correlation analysis (Sparse mCCA), angle-based joint and individual variation explained (AJIVE) and multi-omics factor analysis (MOFA) using a cross-validation approach to assess overfitting and consistency. Both large and small-sample datasets were used to evaluate performance, and a permuted null dataset was used to identify overfitting through the application of our framework and approach. In the large-sample setting, we found that all methods demonstrated consistency and lack of overfitting; however, in the small-sample size setting, AJIVE provided the most stable results. We provide an R package so that our framework and approach can be applied to evaluate other methods and datasets.

Indexed as

Computational BiologyGenomicsangle-based joint and individual variation explainedcross-validationevaluationmulti-omicsmulti-omics factor analysissparse canonical correlation analysis

Identifiers

PMID31281919
PMCPMC7373174

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.