Evidence map›Paper›PMID 20186320›Full record

ArticlePloS one2010

Towards a rigorous assessment of systems biology models: the DREAM3 challenges.

Robert J Prill, Daniel Marbach, Julio Saez-Rodriguez, Peter K Sorger, Leonidas G Alexopoulos, Xiaowei Xue, Neil D Clarke, Gregoire Altan-Bonnet, Gustavo Stolovitzky

Erratum issuedOpen access · goldAbstract read
In one paragraph

Article in PloS one, 2010. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 187 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
187citing papers in PubMed, 1 pooled it
19.7field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

187 citing papers in PubMed, 1 synthesis or guideline pooled it, 447 citations in OpenAlex.

  1. Pooled it
  2. Review
  3. Review
  4. Article
  5. Review
  6. Understanding Iron and Oxidative Stress Response inbioRxiv : the preprint server for biology · 2026
    Article
  7. Article
  8. Article
  9. Multi-omic network inference from time-series data.NPJ systems biology and applications · 2025
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Causality-Aware Spatiotemporal Graph Neural Networks for Spatiotemporal Time Series Imputation.Proceedings of the ... ACM International Conference on Information & Knowledge Management. ACM International Conference on Information and Knowledge Management · 2024
    Article
  17. Article
  18. Article
  19. Article
  20. Article

127 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

  • Erratum issued
5 · Who and what money

Authors and funding

9 authors at 7 institutions in 4 countries.

Robert J PrillIBM T. J. Watson Research Center, Yorktown Heights, New York, United States of America.
Daniel Marbach
Julio Saez-Rodriguez
Peter K Sorger
Leonidas G Alexopoulos
Xiaowei Xue
Neil D Clarke
Gregoire Altan-Bonnet
Gustavo Stolovitzky
Genome Institute of Singapore · SGIBM Research - Thomas J. Watson Research Center · USCenter for Systems Biology · USÉcole Polytechnique Fédérale de Lausanne · CHMassachusetts Institute of Technology · USMemorial Sloan Kettering Cancer Center · USNational Technical University of Athens · GR

Funding

Systems Biology of Cell Decision ProcessesP50GM068762 · NIGMS · MASSACHUSETTS INSTITUTE OF TECHNOLOGY · PI YAFFE, MICHAEL B · 2003 to 2012
$32.3M
Tumor Cell Networks CenterU54CA112967 · NCI · MASSACHUSETTS INSTITUTE OF TECHNOLOGY · PI LAUFFENBURGER, DOUGLAS A · 2004 to 2015
$26.2M
Quantitative modeling of the phenotypic variability of individual T cells and theR01AI083408 · NIAID · SLOAN-KETTERING INST CAN RESEARCH · PI ALTAN-BONNET, GREGOIRE · 2009 to 2012
$1.9M
Self-organization of T lymphocyte activation into collective immune responsesR56AI083408 · NIAID · SLOAN-KETTERING INST CAN RESEARCH · PI HUSE, MORGAN A · 2014 to 2014
$537k
NCI NIH HHS U54-CA112967NIAID NIH HHS AI083408NIAID NIH HHS R01 AI083408NIAID NIH HHS R56 AI083408NIGMS NIH HHS P50 GM068762NIGMS NIH HHS P50-GM68762
6 · The paper itself

Abstract

backgroundSystems biology has embraced computational modeling in response to the quantitative nature and increasing scale of contemporary data sets. The onslaught of data is accelerating as molecular profiling technology evolves. The Dialogue for Reverse Engineering Assessments and Methods (DREAM) is a community effort to catalyze discussion about the design, application, and assessment of systems biology models through annual reverse-engineering challenges. METHODOLOGY AND PRINCIPAL

findingsWe describe our assessments of the four challenges associated with the third DREAM conference which came to be known as the DREAM3 challenges: signaling cascade identification, signaling response prediction, gene expression prediction, and the DREAM3 in silico network challenge. The challenges, based on anonymized data sets, tested participants in network inference and prediction of measurements. Forty teams submitted 413 predicted networks and measurement test sets. Overall, a handful of best-performer teams were identified, while a majority of teams made predictions that were equivalent to random. Counterintuitively, combining the predictions of multiple teams (including the weaker teams) can in some cases improve predictive power beyond that of any single method.

conclusionsDREAM provides valuable feedback to practitioners of systems biology modeling. Lessons learned from the predictions of the community provide much-needed context for interpreting claims of efficacy of algorithms described in the scientific literature.

Indexed as

AlgorithmsModels, BiologicalAnimalsCluster AnalysisComputational BiologyGene Expression ProfilingGene Regulatory NetworksHumansProtein Interaction MappingReproducibility of ResultsSignal TransductionSoftwareSystems Biology

Identifiers

PMID20186320
PMCPMC2826397
OpenAlexW2143076232

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.