Evidence map›Paper›PMID 31220077›Full record

ArticlePLoS biology2019

Challenges and recommendations to improve the installability and archival stability of omics computational tools.

Serghei Mangul, Thiago Mosqueiro, Richard J Abdill, Dat Duong, Keith Mitchell, Varuni Sarwal, Brian Hill, Jaqueline Brito, Russell Jared Littman, Benjamin Statz and 7 more

Abstract read
In one paragraph

Article in PLoS biology, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 54 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
54citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

54 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Profiler: an open web platform for multi-omics analysis.Bioinformatics (Oxford, England) · 2026
    Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Review
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

17 authors.

Serghei MangulDepartment of Computer Science, University of California Los Angeles, Los Angeles, California, United States of America.ORCID 0000-0003-1453-1729
Thiago MosqueiroInstitute for Quantitative and Computational Biosciences, University of California Los Angeles, Los Angeles, California, United States of America.ORCID 0000-0001-5808-8189
Richard J AbdillDepartment of Genetics, Cell Biology, and Development, University of Minnesota, Minneapolis, Minnesota, United States of America.ORCID 0000-0001-9565-5832
Dat DuongDepartment of Computer Science, University of California Los Angeles, Los Angeles, California, United States of America.ORCID 0000-0003-3022-9378
Keith MitchellDepartment of Computer Science, University of California Los Angeles, Los Angeles, California, United States of America.
Varuni SarwalIndian Institute of Technology Delhi, Hauz Khas, New Delhi, India.ORCID 0000-0001-7563-9835
Brian HillDepartment of Computer Science, University of California Los Angeles, Los Angeles, California, United States of America.ORCID 0000-0002-6881-5770
Jaqueline BritoInstitute of Mathematics and Computer Science, University of São Paulo, São Paulo, Brazil.ORCID 0000-0002-7158-3253
Russell Jared LittmanDepartment of Computer Science, University of California Los Angeles, Los Angeles, California, United States of America.ORCID 0000-0002-6790-312X
Benjamin StatzDepartment of Computer Science, University of California Los Angeles, Los Angeles, California, United States of America.
Angela Ka-Mei LamDepartment of Computer Science, University of California Los Angeles, Los Angeles, California, United States of America.ORCID 0000-0002-2617-9585
Gargi DayamaDepartment of Genetics, Cell Biology, and Development, University of Minnesota, Minneapolis, Minnesota, United States of America.ORCID 0000-0003-1349-8998
Laura GrieneisenDepartment of Genetics, Cell Biology, and Development, University of Minnesota, Minneapolis, Minnesota, United States of America.ORCID 0000-0001-7286-5001
Lana S MartinInstitute for Quantitative and Computational Biosciences, University of California Los Angeles, Los Angeles, California, United States of America.ORCID 0000-0003-2311-7191
Jonathan FlintCenter for Neurobehavioral Genetics, Semel Institute for Neuroscience and Human Behavior, University of California Los Angeles, Los Angeles, California, United States of America.
Eleazar EskinDepartment of Computer Science, University of California Los Angeles, Los Angeles, California, United States of America.
Ran BlekhmanDepartment of Genetics, Cell Biology, and Development, University of Minnesota, Minneapolis, Minnesota, United States of America.

Funding

ULTRASTRUCTURE OF THE INTIMA IN EARLY LESION FORMATIONP01HL030568 · NHLBI · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI FOGELMAN, ALAN M · 1985 to 2019
$55.2M
Systems genomics of metabolic syndrome traitsP01HL028481 · NHLBI · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI LUSIS, ALDONS JAKE · 1985 to 2019
$50.2M
Substance Abuse & Behavioral Disinhibition: Integrating Genes & EnvironmentU01DA024417 · NIDA · UNIVERSITY OF MINNESOTA · PI IACONO, WILLIAM G. · 2007 to 2010
$10.8M
INTEGRATIVE GENETIC APPROACHES TO GENE-AIR POLLUTION INTERACTIONS IN ASTHMAR01ES021801 · NIEHS · UNIVERSITY OF SOUTHERN CALIFORNIA · PI AKBARI, OMID, ALLAYEE, HOOMAN · 2012 to 2016
$3.9M
Population Genomics of Host-Microbiome InteractionsR35GM128716 · NIGMS · UNIVERSITY OF MINNESOTA · PI Ran Blekhman · 2018 to 2026
$3.5M
An integrated molecular approach to understand variation in iron metabolismR01GM083198 · NIGMS · UNIVERSITY OF FLORIDA · PI VULPE, CHRISTOPHER D · 2012 to 2015
$2.7M
Genetic Regulation of Gene Expression and its Impact on Phenotypes - SupplementR01MH101782 · NIMH · STANFORD UNIVERSITY · PI SABATTI, CHIARA · 2013 to 2016
$1.3M
Correcting for Population Structure in Gene-by-Environment Interaction StudiesR01ES022282 · NIEHS · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI ESKIN, ELEAZAR · 2013 to 2015
$1.2M
Discovering the Genetic Basis of HypertensionK25HL080079 · NHLBI · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI ESKIN, ELEAZAR · 2006 to 2010
$685k
Undergraduate Research Experience in Neuropsychiatric GenomicsR25MH109172 · NIMH · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI ESKIN, ELEAZAR, FREIMER, NELSON B. · 2016 to 2020
$429k
NHLBI NIH HHS K25 HL080079NHLBI NIH HHS P01 HL028481NHLBI NIH HHS P01 HL030568NIDA NIH HHS U01 DA024417NIEHS NIH HHS R01 ES021801NIEHS NIH HHS R01 ES022282NIGMS NIH HHS R01 GM083198NIGMS NIH HHS R35 GM128716NIMH NIH HHS R01 MH101782NIMH NIH HHS R25 MH109172
6 · The paper itself

Abstract

Developing new software tools for analysis of large-scale biological data is a key component of advancing modern biomedical research. Scientific reproduction of published findings requires running computational tools on data generated by such studies, yet little attention is presently allocated to the installability and archival stability of computational software tools. Scientific journals require data and code sharing, but none currently require authors to guarantee the continuing functionality of newly published tools. We have estimated the archival stability of computational biology software tools by performing an empirical analysis of the internet presence for 36,702 omics software resources published from 2005 to 2017. We found that almost 28% of all resources are currently not accessible through uniform resource locators (URLs) published in the paper they first appeared in. Among the 98 software tools selected for our installability test, 51% were deemed "easy to install," and 28% of the tools failed to be installed at all because of problems in the implementation. Moreover, for papers introducing new software, we found that the number of citations significantly increased when authors provided an easy installation process. We propose for incorporation into journal policy several practical solutions for increasing the widespread installability and archival stability of published bioinformatics software.

Indexed as

Biomedical ResearchComputational BiologyDatabases, FactualHumansInformation DisseminationInformation Storage and RetrievalInternetSoftware

Identifiers

PMID31220077
PMCPMC6605654

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.