Evidence map›Paper›PMID 38560736›Full record

ArticleArXiv2024

An Improved Metric and Benchmark for Assessing the Performance of Virtual Screening Models.

Michael Brocidiacono, Konstantin I Popov, Alexander Tropsha

Abstract readPreprint
In one paragraph

Article in ArXiv, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Michael BrocidiaconoUniverity of North Carolina at Chapel Hill.
Konstantin I PopovUniverity of North Carolina at Chapel Hill.
Alexander TropshaUniverity of North Carolina at Chapel Hill.

Funding

Enabling the Accelerated Discovery of Novel Chemical Probes by Integration of Crystallographic, Computational, and Synthetic Chemistry ApproachesR01GM140154 · NIGMS · UNIV OF NORTH CAROLINA CHAPEL HILL · PI TROPSHA, ALEXANDER, WILLSON, TIMOTHY M · 2021 to 2024
$2.4M
NIGMS NIH HHS R01 GM140154
6 · The paper itself

Abstract

Structure-based virtual screening (SBVS) is a key workflow in computational drug discovery. SBVS models are assessed by measuring the enrichment of known active molecules over decoys in retrospective screens. However, the standard formula for enrichment cannot estimate model performance on very large libraries. Additionally, current screening benchmarks cannot easily be used with machine learning (ML) models due to data leakage. We propose an improved formula for calculating VS enrichment and introduce the BayesBind benchmarking set composed of protein targets that are structurally dissimilar to those in the BigBind training set. We assess current models on this benchmark and find that none perform appreciably better than a KNN baseline. We publicly release the BayesBind benchmark at https://github.com/molecularmodelinglab/bigbind.

Identifiers

PMID38560736
PMCPMC10980085

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.