Evidence map›Paper›PMID 39951479›Full record

ReviewJournal of chemical information and modeling2025

The Need for Continuing Blinded Pose- and Activity Prediction Benchmarks.

Christian Kramer, John Chodera, Kelly L Damm-Ganamet, Michael K Gilson, Judith Günther, Uta Lessel, Richard A Lewis, David Mobley, Eva Nittinger, Adam Pecina and 2 more

Abstract readReview
In one paragraph

Review in Journal of chemical information and modeling, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Fine-Tuning DiffDock-L for Allosteric Kinase Docking.Journal of chemical information and modeling · 2026
    Article
  3. Article
  4. Review
  5. Article
  6. RSC advances · 2025
    Article
  7. Article
  8. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Christian KramerF. Hoffmann-La Roche Ltd. Pharma Research and Early Development, Basel 4070, Switzerland.ORCID 0000-0001-8663-5266
John ChoderaMemorial Sloan Kettering Cancer Center, New York, New York 10065, United States.ORCID 0000-0003-0542-119X
Kelly L Damm-GanametIn Silico Discovery, Therapeutics Discovery, Johnson & Johnson Innovative Medicine, San Diego, California 92121, United States.ORCID 0000-0001-6377-8280
Michael K GilsonSkaggs School of Pharmacy and Pharmaceutical Sciences, University of California San Diego, La Jolla, California 92093-0736, United States.ORCID 0000-0002-3375-1738
Judith GüntherBayer AG, Drug Discovery Sciences, 13353 Berlin, Germany.ORCID 0000-0001-5794-8984
Uta LesselMedicinal Chemistry, Boehringer Ingelheim Pharma GmbH & Co. KG, Biberach an der Riss 88397, Germany.ORCID 0000-0002-1698-6017
Richard A LewisGlobal Discovery Chemistry, Novartis Pharma AG, Basel 4002, Switzerland.ORCID 0000-0002-5478-8599
David MobleyDepartments of Pharmaceutical Sciences and Chemistry, University of California Irvine, Irvine, California 92697, United States.ORCID 0000-0002-1083-5533
Eva NittingerMedicinal Chemistry, Research and Early Development, Respiratory and Immunology (R&I), BioPharmaceuticals R&D, AstraZeneca, 43183 Gothenburg, Sweden.ORCID 0000-0001-7231-7996
Adam PecinaInstitute of Organic Chemistry and Biochemistry of the Czech Academy of Sciences, Prague 16000, Czech Republic.ORCID 0000-0003-3890-7831
Matthieu SchapiraStructural Genomics Consortium and Department of Pharmacology & Toxicology, University of Toronto, Toronto, Ontario M5G 1L7, Canada.ORCID 0000-0002-1047-3309
W Patrick WaltersComputation, Relay Therapeutics, Cambridge, Massachusetts 02141, United States.ORCID 0000-0003-2860-7958

Funding

Accelerating drug discovery via ML-guided iterative design and optimizationR35GM148236 · NIGMS · UNIVERSITY OF CALIFORNIA-IRVINE · PI David Lowell Mobley · 2023 to 2026
$2.2M
NIGMS NIH HHS R35 GM148236
6 · The paper itself

Abstract

Computational tools for structure-based drug design (SBDD) are widely used in drug discovery and can provide valuable insights to advance projects in an efficient and cost-effective manner. However, despite the importance of SBDD to the field, the underlying methodologies and techniques have many limitations. In particular, binding pose and activity predictions (P-AP) are still not consistently reliable. We strongly believe that a limiting factor is the lack of a widely accepted and established community benchmarking process that independently assesses the performance and drives the development of methods, similar to the CASP benchmarking challenge for protein structure prediction. Here, we provide an overview of P-AP, unblinded benchmarking data sets, and blinded benchmarking initiatives (concluded and ongoing) and offer a perspective on learnings and the future of the field. To accelerate a breakthrough on the development of novel P-AP methods, it is necessary for the community to establish and support a long-term benchmark challenge that provides nonbiased training/test/validation sets, a systematic independent validation, and a forum for scientific discussions.

Indexed as

BenchmarkingProteinsDrug DesignDrug DiscoveryProtein ConformationProteins

Identifiers

PMID39951479
PMCPMC12818095

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.