Evidence map›Paper›PMID 32365137›Full record

ReviewPLoS computational biology2020

Better together: Elements of successful scientific software development in a distributed collaborative community.

Julia Koehler Leman, Brian D Weitzner, P Douglas Renfrew, Steven M Lewis, Rocco Moretti, Andrew M Watkins, Vikram Khipple Mulligan, Sergey Lyskov, Jared Adolf-Bryfogle, Jason W Labonte and 16 more

Open access · goldAbstract readReview
In one paragraph

Review in PLoS computational biology, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed
11.9field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed, 43 citations in OpenAlex.

  1. Review
  2. Article
  3. Article
  4. Review
  5. Article
  6. Review
  7. Article
  8. Review
  9. Review
  10. Review
  11. Article
  12. Advances in the Computational Design of Small-Molecule-Controlled Protein-Based Circuits for Synthetic Biology.Proceedings of the IEEE. Institute of Electrical and Electronics Engineers · 2022
    Article
  13. Article
  14. Article
  15. Article
  16. Review
  17. In Silico Structural Modeling and Analysis of Interactions ofInternational journal of molecular sciences · 2021
    Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

26 authors at 14 institutions in 4 countries.

Julia Koehler LemanCenter for Computational Biology, Flatiron Institute, Simons Foundation, New York, NY, United States of America.ORCID 0000-0002-5693-3593
Brian D WeitznerDept of Chemical and Biomolecular Engineering, Johns Hopkins University, Baltimore, MD, United States of America.ORCID 0000-0002-1909-0961
P Douglas RenfrewCenter for Computational Biology, Flatiron Institute, Simons Foundation, New York, NY, United States of America.
Steven M LewisDept of Biochemistry and Biophysics, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States of America.
Rocco MorettiDept of Chemistry, Vanderbilt University, Nashville, TN, United States of America.
Andrew M WatkinsDept of Biochemistry, Stanford University School of Medicine, Stanford CA, United States of America.
Vikram Khipple MulliganCenter for Computational Biology, Flatiron Institute, Simons Foundation, New York, NY, United States of America.
Sergey LyskovDept of Chemical and Biomolecular Engineering, Johns Hopkins University, Baltimore, MD, United States of America.
Jared Adolf-BryfogleDept of Immunology and Microbiology, The Scripps Research Institute, La Jolla, CA, United States of America.
Jason W LabonteDept of Chemical and Biomolecular Engineering, Johns Hopkins University, Baltimore, MD, United States of America.
Justyna KrysDept of Chemistry, University of Warsaw, Warsaw, Poland.
RosettaCommons Consortium
Christopher BystroffDept of Biological Sciences, Rensselaer Polytechnic Institute, Troy, NY, United States of America.
William SchiefDept of Immunology and Microbiology, The Scripps Research Institute, La Jolla, CA, United States of America.
Dominik GrontDept of Chemistry, University of Warsaw, Warsaw, Poland.
Ora Schueler-FurmanDept of Microbiology and Molecular Genetics, IMRIC, Ein Kerem Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel.
David BakerDept of Biochemistry, University of Washington, Seattle, WA, United States of America.
Philip BradleyFred Hutchinson Cancer Research Center, Seattle, WA, United States of America.
Roland DunbrackInstitute for Cancer Research, Fox Chase Cancer Center, Philadelphia PA, United States of America.
Tanja KortemmeDept of Bioengineering and Therapeutic Sciences, University of California San Francisco, CA, United States of America.
Andrew Leaver-FayDept of Biochemistry and Biophysics, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States of America.
Charlie E M StraussBioscience Division, Los Alamos National Laboratory, Los Alamos, NM, United States of America.
Jens MeilerDepts of Chemistry, Pharmacology and Biomedical Informatics, Vanderbilt University, Nashville, TN, United States of America.
Brian KuhlmanDept of Biochemistry and Biophysics, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States of America.
Jeffrey J GrayDept of Chemical and Biomolecular Engineering, Johns Hopkins University, Baltimore, MD, United States of America.ORCID 0000-0001-6380-2324
Richard BonneauCenter for Computational Biology, Flatiron Institute, Simons Foundation, New York, NY, United States of America.
Johns Hopkins University · USSimons Foundation · USUniversity of North Carolina at Chapel Hill · USScripps Research Institute · USUniversity of Warsaw · PLUniversity of Washington · USVanderbilt University · USFox Chase Cancer Center · USFred Hutch Cancer Center · USHebrew University of Jerusalem · ILLos Alamos National Laboratory · USRensselaer Polytechnic Institute · USStanford University · USUniversity of California, San Francisco · US

Funding

Support Component D/Vaccine Discovery, Concept to ClinicUM1AI100663 · NIAID · SCRIPPS RESEARCH INSTITUTE, THE · PI BAROUCH, DAN H. · 2012 to 2018
$131.5M
Decrypting Variants of Uncertain Significance in Long-QT SyndromeR01HL122010 · NHLBI · VANDERBILT UNIVERSITY · PI GEORGE, ALFRED L., SANDERS, CHARLES R · 2014 to 2025
$15.5M
PROGRAM IN MOLECULAR BIOPHYSICST32GM008403 · NIGMS · JOHNS HOPKINS UNIVERSITY · PI BARRICK, DOUGLAS E. · 1990 to 2019
$13.5M
Structure based design of antibodies and vaccinesU19AI117905 · NIAID · VANDERBILT UNIVERSITY MEDICAL CENTER · PI SCHIEF, WILLIAM R. · 2015 to 2019
$12.0M
PATHOGENESIS AND IMMUNOLOGY OF DISEASET32AI007244 · NIAID · SCRIPPS RESEARCH INSTITUTE, THE · PI NEMAZEE, DAVID · 1985 to 2022
$8.8M
ROSETTA An Integrated Protein Structure Modeling SuiteR01GM073151 · NIGMS · UNIV OF NORTH CAROLINA CHAPEL HILL · PI KUHLMAN, BRIAN A · 2005 to 2019
$7.8M
Next-generation computational/chemical methods for complex RNA structuresR35GM122579 · NIGMS · STANFORD UNIVERSITY · PI Rhiju Das · 2017 to 2026
$7.2M
Structural Bioinformatics of Proteins and Protein Complexes and Applications to Cancer BiologyR35GM122517 · NIGMS · RESEARCH INST OF FOX CHASE CAN CTR · PI ROLAND L DUNBRACK · 2017 to 2026
$6.3M
GPU workstation for deep learning-based protein design and cryo-EM data processingR35GM131923 · NIGMS · UNIV OF NORTH CAROLINA CHAPEL HILL · PI BRIAN A KUHLMAN · 2019 to 2026
$6.1M
Glycan dependent epitopes of HIV broadly neutralizing antibodiesR01AI113867 · NIAID · SCRIPPS RESEARCH INSTITUTE, THE · PI PAULSON, JAMES C, SCHIEF, WILLIAM R. · 2014 to 2018
$4.8M
Prediction of the Structure of Therapeutic Antibodies with their AntigensR01GM078221 · NIGMS · JOHNS HOPKINS UNIVERSITY · PI GRAY, JEFFREY J · 2006 to 2020
$4.0M
Membrane Protein Structure Elucidation from sparse NMR data (KAMP)R01GM080403 · NIGMS · VANDERBILT UNIVERSITY · PI MEILER, JENS · 2007 to 2019
$3.0M
Howard Hughes Medical InstituteNCI NIH HHS F32 CA189246NCI NIH HHS R21 CA219847NCI NIH HHS RL1 CA133832NHLBI NIH HHS R01 HL122010NIAID NIH HHS R01 AI113867NIAID NIH HHS R21 AI121799NIAID NIH HHS T32 AI007244NIAID NIH HHS U19 AI117905NIAID NIH HHS UM1 AI100663NIDDK NIH HHS R01 DK097376NIGMS NIH HHS R01 GM073151NIGMS NIH HHS R01 GM078221NIGMS NIH HHS R01 GM080403NIGMS NIH HHS R01 GM084453NIGMS NIH HHS R01 GM088277NIGMS NIH HHS R01 GM092802NIGMS NIH HHS R01 GM098101NIGMS NIH HHS R01 GM099827NIGMS NIH HHS R01 GM099842NIGMS NIH HHS R01 GM110089NIGMS NIH HHS R01 GM117189NIGMS NIH HHS R01 GM117968NIGMS NIH HHS R01 GM121487NIGMS NIH HHS R01 GM127578NIGMS NIH HHS R35 GM122517NIGMS NIH HHS R35 GM122579NIGMS NIH HHS R35 GM131923NIGMS NIH HHS RL1 GM084433NIGMS NIH HHS T32 GM008403
6 · The paper itself

Abstract

Many scientific disciplines rely on computational methods for data analysis, model generation, and prediction. Implementing these methods is often accomplished by researchers with domain expertise but without formal training in software engineering or computer science. This arrangement has led to underappreciation of sustainability and maintainability of scientific software tools developed in academic environments. Some software tools have avoided this fate, including the scientific library Rosetta. We use this software and its community as a case study to show how modern software development can be accomplished successfully, irrespective of subject area. Rosetta is one of the largest software suites for macromolecular modeling, with 3.1 million lines of code and many state-of-the-art applications. Since the mid 1990s, the software has been developed collaboratively by the RosettaCommons, a community of academics from over 60 institutions worldwide with diverse backgrounds including chemistry, biology, physiology, physics, engineering, mathematics, and computer science. Developing this software suite has provided us with more than two decades of experience in how to effectively develop advanced scientific software in a global community with hundreds of contributors. Here we illustrate the functioning of this development community by addressing technical aspects (like version control, testing, and maintenance), community-building strategies, diversity efforts, software dissemination, and user support. We demonstrate how modern computational research can thrive in a distributed collaborative community. The practices described here are independent of subject area and can be readily adopted by other software development communities.

Indexed as

Computational BiologyCooperative BehaviorData AnalysisEngineeringGene LibraryHumansModels, MolecularResearchResearch PersonnelSocial BehaviorSoftwareUser-Computer Interface

Identifiers

PMID32365137
PMCPMC7197760
OpenAlexW3022874274

What OpenQuestion holds

Textmetadata
LicenceCC0
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.