Evidence map›Paper›PMID 27134723›Full record

ArticleF1000Research2015

DREAMTools: a Python package for scoring collaborative challenges.

Thomas Cokelaer, Mukesh Bansal, Christopher Bare, Erhan Bilal, Brian M Bot, Elias Chaibub Neto, Federica Eduati, Alberto de la Fuente, Mehmet Gönen, Steven M Hill and 12 more

Abstract read
In one paragraph

Article in F1000Research, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Article
  2. Review
  3. Review
  4. Article
  5. Article
  6. Article
  7. Robust network inference using response logic.Bioinformatics (Oxford, England) · 2019
    Article
  8. Review
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

22 authors.

Thomas CokelaerEuropean Molecular Biology Laboratory, European Bioinformatics Institute (EMBL-EBI),Wellcome Trust Genome Campus, Cambridge, UK; Bioinformatics and Biostatistics Hub, C3BI, Institut Pasteur, Paris, France.
Mukesh BansalDepartment of Systems Biology, Columbia University, New York, USA.
Christopher BareSage Bionetworks, Seattle, WA, USA.
Erhan BilalIBM, TJ Watson, Computational Biology Center, New York, USA.
Brian M BotSage Bionetworks, Seattle, WA, USA.
Elias Chaibub NetoSage Bionetworks, Seattle, WA, USA.
Federica EduatiEuropean Molecular Biology Laboratory, European Bioinformatics Institute (EMBL-EBI),Wellcome Trust Genome Campus, Cambridge, UK.
Alberto de la FuenteLeibniz Institute for Farm Animal Biology, Institute of Genetics and Biometry, Dummerstorf, Germany.
Mehmet GönenOregon Health & Science University, Portland, OR, USA.
Steven M HillMRC Biostatistics Unit, Cambridge Institute of Public Health, Cambridge, UK.
Bruce HoffSage Bionetworks, Seattle, WA, USA.
Jonathan R KarrDepartment of Genetics & Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, USA.
Robert KüffnerInstitute of Bioinformatics and Systems Biology, German Research Center for Environmental Health, Munich, Germany.
Michael P MendenEuropean Molecular Biology Laboratory, European Bioinformatics Institute (EMBL-EBI),Wellcome Trust Genome Campus, Cambridge, UK.
Pablo MeyerIBM, TJ Watson, Computational Biology Center, New York, USA.
Raquel NorelIBM, TJ Watson, Computational Biology Center, New York, USA.
Abhishek PratapSage Bionetworks, Seattle, WA, USA.
Robert J PrillIBM Almaden Research Center, San Jose, CA, USA.
Matthew T WeirauchCenter for Autoimmune Genomics and Etiology and Divisions of Biomedical Informatics and Developmental Biology, Cincinnati Children's Hospital, Cincinnati, OH, USA.
James C CostelloDepartment of Pharmacology, University of Colorado Anschutz Medical Campus, Aurora, CO, USA.
Gustavo StolovitzkyIBM, TJ Watson, Computational Biology Center, New York, USA; Department of Genetics & Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, USA.
Julio Saez-RodriguezEuropean Molecular Biology Laboratory, European Bioinformatics Institute (EMBL-EBI),Wellcome Trust Genome Campus, Cambridge, UK; RWTH Aachen University Medical Hospital, Joint Research Centre for Computational Biomedicine (JRCCOMBINE), Aachen, Germany.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

unlabelledDREAM challenges are community competitions designed to advance computational methods and address fundamental questions in system biology and translational medicine. Each challenge asks participants to develop and apply computational methods to either predict unobserved outcomes or to identify unknown model parameters given a set of training data. Computational methods are evaluated using an automated scoring metric, scores are posted to a public leaderboard, and methods are published to facilitate community discussions on how to build improved methods. By engaging participants from a wide range of science and engineering backgrounds, DREAM challenges can comparatively evaluate a wide range of statistical, machine learning, and biophysical methods. Here, we describe DREAMTools, a Python package for evaluating DREAM challenge scoring metrics. DREAMTools provides a command line interface that enables researchers to test new methods on past challenges, as well as a framework for scoring new challenges. As of March 2016, DREAMTools includes more than 80% of completed DREAM challenges. DREAMTools complements the data, metadata, and software tools available at the DREAM website http://dreamchallenges.org and on the Synapse platform at https://www.synapse.org. AVAILABILITY: DREAMTools is a Python package. Releases and documentation are available at http://pypi.python.org/pypi/dreamtools. The source code is available at http://github.com/dreamtools/dreamtools.

Indexed as

benchmarkingcollaborative competitioncrowdsourcingDREAMmachine learningmethod evaluationsystems biologytranslational medicine

Identifiers

PMID27134723
PMCPMC4837986

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.