Evidence map›Paper›PMID 30169622›Full record

ArticleBioinformatics (Oxford, England)2019

Comparative analysis of methods for evaluation of protein models against native structures.

Kliment Olechnovič, Bohdan Monastyrskyy, Andriy Kryshtafovych, Česlovas Venclovas

Open access · bronzeAbstract readComparative Study
In one paragraph

Article in Bioinformatics (Oxford, England), 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 34 papers.

0numbers the graph read from it
0cells of the map it votes in
34citing papers in PubMed
1.7field-weighted citation impact, top 15% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

34 citing papers in PubMed, 53 citations in OpenAlex.

  1. Article
  2. Molecular genetics and metabolism reports · 2026
    Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Medicinal chemistry (Shariqah (United Arab Emirates)) · 2025
    Article
  17. Extracellular vesicles for developing targeted hearing loss therapy.Journal of controlled release : official journal of the Controlled Release Society · 2024
    Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 2 institutions in 2 countries.

Kliment OlechnovičInstitute of Biotechnology Life Sciences Center Vilnius University, Saulėtekio 7, Vilnius, Lithuania.
Bohdan MonastyrskyyGenome Center UC Davis, 451 Health Sciences Drive, Davis, CA, USA.
Andriy KryshtafovychGenome Center UC Davis, 451 Health Sciences Drive, Davis, CA, USA.
Česlovas VenclovasInstitute of Biotechnology Life Sciences Center Vilnius University, Saulėtekio 7, Vilnius, Lithuania.
University of California, Davis · USVilnius University · LT

Funding

Prospective analysis to determine model accuracy performance and boundaries in the post-AlphaFold2 environmentR01GM100482 · NIGMS · UNIVERSITY OF CALIFORNIA AT DAVIS · PI FIDELIS, KRZYSZTOF A · 2012 to 2025
$11.1M
NIGMS NIH HHS R01 GM100482
6 · The paper itself

Abstract

motivationMeasuring discrepancies between protein models and native structures is at the heart of development of protein structure prediction methods and comparison of their performance. A number of different evaluation methods have been developed; however, their comprehensive and unbiased comparison has not been performed.

resultsWe carried out a comparative analysis of several popular model assessment methods (RMSD, TM-score, GDT, QCS, CAD-score, LDDT, SphereGrinder and RPF) to reveal their relative strengths and weaknesses. The analysis, performed on a large and diverse model set derived in the course of three latest community-wide CASP experiments (CASP10-12), had two major directions. First, we looked at general differences between the scores by analyzing distribution, correspondence and correlation of their values as well as differences in selecting best models. Second, we examined the score differences taking into account various structural properties of models (stereochemistry, hydrogen bonds, packing of domains and chain fragments, missing residues, protein length and secondary structure). Our results provide a solid basis for an informed selection of the most appropriate score or combination of scores depending on the task at hand. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

Indexed as

Computational BiologyModels, MolecularProtein ConformationProteinsProteins

Identifiers

PMID30169622
PMCPMC6419896
OpenAlexW2889674656

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.