Evidence map›Paper›PMID 24749745›Full record

ArticleJournal of chemical information and modeling2014

An unbiased method to build benchmarking sets for ligand-based virtual screening and its application to GPCRs.

Jie Xia, Hongwei Jin, Zhenming Liu, Liangren Zhang, Xiang Simon Wang

Abstract read
In one paragraph

Article in Journal of chemical information and modeling, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Comprehensive Survey of Recent Drug Discovery Using Deep Learning.International journal of molecular sciences · 2021
    Review
  6. Article
  7. FRAGSITE: A Fragment-Based Approach for Virtual Ligand Screening.Journal of chemical information and modeling · 2021
    Article
  8. Article
  9. Property-Unmatched Decoys in Docking Benchmarks.Journal of chemical information and modeling · 2021
    Article
  10. Article
  11. The discovery of novel HDAC3 inhibitors via virtual screening and in vitro bioassay.Journal of enzyme inhibition and medicinal chemistry · 2018
    Article
  12. FINDSITEJournal of chemical information and modeling · 2018
    Article
  13. Deep learning and virtual drug screening.Future medicinal chemistry · 2018
    Article
  14. Article
  15. Review
  16. Review
  17. Article
  18. Getting the most out of PubChem for virtual screening.Expert opinion on drug discovery · 2016
    Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Jie XiaState Key Laboratory of Natural and Biomimetic Drugs, School of Pharmaceutical Sciences, Peking University , Beijing 100191, China.
Hongwei Jin
Zhenming Liu
Liangren Zhang
Xiang Simon Wang

Funding

PROTEOMICS CORE FACILITYG12MD007597 · NIMHD · HOWARD UNIVERSITY · PI SOUTHERLAND, WILLIAM M. · 2012 to 2018
$14.8M
The District of Columbia Developmental Center for AIDS Research (DC D-CFAR)P30AI087714 · NIAID · GEORGE WASHINGTON UNIVERSITY · PI MILLER, VERONICA · 2010 to 2014
$8.4M
NIAID NIH HHS P30 AI087714NIAID NIH HHS P30AI087714NIMHD NIH HHS G12 MD007597NIMHD NIH HHS G12MD007597PHS HHS 5P30A10877714-02
6 · The paper itself

Abstract

Benchmarking data sets have become common in recent years for the purpose of virtual screening, though the main focus had been placed on the structure-based virtual screening (SBVS) approaches. Due to the lack of crystal structures, there is great need for unbiased benchmarking sets to evaluate various ligand-based virtual screening (LBVS) methods for important drug targets such as G protein-coupled receptors (GPCRs). To date these ready-to-apply data sets for LBVS are fairly limited, and the direct usage of benchmarking sets designed for SBVS could bring the biases to the evaluation of LBVS. Herein, we propose an unbiased method to build benchmarking sets for LBVS and validate it on a multitude of GPCRs targets. To be more specific, our methods can (1) ensure chemical diversity of ligands, (2) maintain the physicochemical similarity between ligands and decoys, (3) make the decoys dissimilar in chemical topology to all ligands to avoid false negatives, and (4) maximize spatial random distribution of ligands and decoys. We evaluated the quality of our Unbiased Ligand Set (ULS) and Unbiased Decoy Set (UDS) using three common LBVS approaches, with Leave-One-Out (LOO) Cross-Validation (CV) and a metric of average AUC of the ROC curves. Our method has greatly reduced the "artificial enrichment" and "analogue bias" of a published GPCRs benchmarking set, i.e., GPCR Ligand Library (GLL)/GPCR Decoy Database (GDD). In addition, we addressed an important issue about the ratio of decoys per ligand and found that for a range of 30 to 100 it does not affect the quality of the benchmarking set, so we kept the original ratio of 39 from the GLL/GDD.

Indexed as

BenchmarkingChemical PhenomenaDatabases, PharmaceuticalDrug Evaluation, PreclinicalHumansLigandsReceptors, G-Protein-CoupledUser-Computer InterfaceLigandsReceptors, G-Protein-Coupled

Identifiers

PMID24749745
PMCPMC4038372

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.