Evidence map›Paper›PMID 23353650›Full record

ArticleNature methods2013

A large-scale evaluation of computational protein function prediction.

Predrag Radivojac, Wyatt T Clark, Tal Ronnen Oron, Alexandra M Schnoes, Tobias Wittkop, Artem Sokolov, Kiley Graim, Christopher Funk, Karin Verspoor, Asa Ben-Hur and 92 more

Abstract read
In one paragraph

Article in Nature methods, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 515 papers.

0numbers the graph read from it
0cells of the map it votes in
515citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

515 citing papers in PubMed.

  1. Diverse oxidosqualene cyclases for triterpenoid biosynthesis.Synthetic and systems biotechnology · 2027
    Review
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Advances in Protein Function Prediction from the Fifth CAFA Challenge.bioRxiv : the preprint server for biology · 2026
    Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Artificial Intelligence Powers Protein Functional Annotation.Advanced science (Weinheim, Baden-Wurttemberg, Germany) · 2026
    Review
  19. Article
  20. Article

455 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

102 authors.

Predrag RadivojacSchool of Informatics and Computing, Indiana University, Bloomington, Indiana, USA.
Wyatt T Clark
Tal Ronnen Oron
Alexandra M Schnoes
Tobias Wittkop
Artem Sokolov
Kiley Graim
Christopher Funk
Karin Verspoor
Asa Ben-Hur
Gaurav Pandey
Jeffrey M Yunes
Ameet S Talwalkar
Susanna Repo
Michael L Souza
Damiano Piovesan
Rita Casadio
Zheng Wang
Jianlin Cheng
Hai Fang
Julian Gough
Patrik Koskinen
Petri Törönen
Jussi Nokso-Koivisto
Liisa Holm
Domenico Cozzetto
Daniel W A Buchan
Kevin Bryson
David T Jones
Bhakti Limaye
Harshal Inamdar
Avik Datta
Sunitha K Manjari
Rajendra Joshi
Meghana Chitale
Daisuke Kihara
Andreas M Lisewski
Serkan Erdin
Eric Venner
Olivier Lichtarge
Robert Rentzsch
Haixuan Yang
Alfonso E Romero
Prajwal Bhat
Alberto Paccanaro
Tobias Hamp
Rebecca Kaßner
Stefan Seemayer
Esmeralda Vicedo
Christian Schaefer
Dominik Achten
Florian Auer
Ariane Boehm
Tatjana Braun
Maximilian Hecht
Mark Heron
Peter Hönigschmid
Thomas A Hopf
Stefanie Kaufmann
Michael Kiening
Denis Krompass
Cedric Landerer
Yannick Mahlich
Manfred Roos
Jari Björne
Tapio Salakoski
Andrew Wong
Hagit Shatkay
Fanny Gatzmann
Ingolf Sommer
Mark N Wass
Michael J E Sternberg
Nives Škunca
Fran Supek
Matko Bošnjak
Panče Panov
Sašo Džeroski
Tomislav Šmuc
Yiannis A I Kourmpetis
Aalt D J van Dijk
Cajo J F ter Braak
Yuanpeng Zhou
Qingtian Gong
Xinran Dong
Weidong Tian
Marco Falda
Paolo Fontana
Enrico Lavezzo
Barbara Di Camillo
Stefano Toppo
Liang Lan
Nemanja Djuric
Yuhong Guo
Slobodan Vucetic
Amos Bairoch
Michal Linial
Patricia C Babbitt
Steven E Brenner
Christine Orengo
Burkhard Rost
Sean D Mooney
Iddo Friedberg

Funding

STANFORD COMPOSITE(RMI)U54HG004028 · NHGRI · STANFORD UNIVERSITY · PI MUSEN, MARK A · 2005 to 2014
$36.2M
GENOMICST32HG000047 · NHGRI · UNIVERSITY OF CALIFORNIA BERKELEY · PI RASMUS NIELSEN, Daniel Soleyman Rokhsar · 2000 to 2026
$13.5M
Functional Determinnats in G Protein-coupled ReceptorsR01GM066099 · NIGMS · BAYLOR COLLEGE OF MEDICINE · PI LICHTARGE, OLIVIER · 2003 to 2022
$7.5M
Laying the Foundation of Genomic EnzymologyR01GM060595 · NIGMS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI BABBITT, PATRICIA CLEMENT · 2000 to 2018
$5.4M
Comparative genomics of protein structure and functionR01GM079656 · NIGMS · BAYLOR COLLEGE OF MEDICINE · PI LICHTARGE, OLIVIER · 2007 to 2019
$4.3M
Integrated Prediction of Protein Struture at 1D, 2D and 3D LevelsR01GM093123 · NIGMS · UNIVERSITY OF MISSOURI-COLUMBIA · PI CHENG, JIANLIN · 2010 to 2023
$3.8M
Informatic Profiling of Clinically Relevant MutationR01LM009722 · NLM · UNIVERSITY OF WASHINGTON · PI MOONEY, SEAN DAVID · 2007 to 2014
$3.5M
Surface Shape Based Screening of Large Protein DatabasesR01GM075004 · NIGMS · PURDUE UNIVERSITY WEST LAFAYETTE · PI KIHARA, DAISUKE · 2005 to 2009
$1.5M
Protein function prediction by statistical phylogenomicsR01GM071749 · NIGMS · UNIVERSITY OF CALIFORNIA BERKELEY · PI BRENNER, STEVEN E · 2007 to 2010
$1.4M
Identification of protein-metabolite interactome.R01GM097528 · NIGMS · PURDUE UNIVERSITY · PI KIHARA, DAISUKE · 2011 to 2014
$1.1M
Automated Function Prediction (AFP 2011)R13HG006079 · NHGRI · TRUSTEES OF INDIANA UNIVERSITY · PI RADIVOJAC, PREDRAG · 2011 to 2011
$20k
Biotechnology and Biological Sciences Research Council BB/F00964X/1Biotechnology and Biological Sciences Research Council BB/F020481/1Biotechnology and Biological Sciences Research Council BB/G022771/1Biotechnology and Biological Sciences Research Council BB/H02364X/1Biotechnology and Biological Sciences Research Council BB/K004131/1NHGRI NIH HHS HG004028NHGRI NIH HHS R13 HG006079NHGRI NIH HHS R13 HG006079-01A1NHGRI NIH HHS T32 HG000047NHGRI NIH HHS U54 HG004028NIGMS NIH HHS GM066099NIGMS NIH HHS GM075004NIGMS NIH HHS GM079656NIGMS NIH HHS GM093123NIGMS NIH HHS GM097528NIGMS NIH HHS R01 GM060595NIGMS NIH HHS R01 GM066099NIGMS NIH HHS R01 GM071749NIGMS NIH HHS R01 GM075004NIGMS NIH HHS R01 GM079656NIGMS NIH HHS R01 GM093123NIGMS NIH HHS R01 GM097528NLM NIH HHS LM00945102NLM NIH HHS LM009722NLM NIH HHS R01 LM009722
6 · The paper itself

Abstract

Automated annotation of protein function is challenging. As the number of sequenced genomes rapidly grows, the overwhelming majority of protein products can only be annotated computationally. If computational predictions are to be relied upon, it is crucial that the accuracy of these methods be high. Here we report the results from the first large-scale community-based critical assessment of protein function annotation (CAFA) experiment. Fifty-four methods representing the state of the art for protein function prediction were evaluated on a target set of 866 proteins from 11 organisms. Two findings stand out: (i) today's best protein function prediction algorithms substantially outperform widely used first-generation methods, with large gains on all types of targets; and (ii) although the top methods perform well enough to guide experiments, there is considerable need for improvement of currently available tools.

Indexed as

Molecular Sequence AnnotationAlgorithmsAnimalsComputational BiologyDatabases, ProteinExoribonucleasesForecastingHumansMitochondrial ProteinsMolecular BiologyProteinsSpecies SpecificityExoribonucleasesMitochondrial ProteinsPNPT1 protein, humanProteins

Identifiers

PMID23353650
PMCPMC3584181

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-SA
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.