Evidence map›Paper›PMID 38834746›Full record

ArticleCommunications chemistry2024

Benchmarking compound activity prediction for real-world drug discovery applications.

Tingzhong Tian, Shuya Li, Ziting Zhang, Lin Chen, Ziheng Zou, Dan Zhao, Jianyang Zeng

Abstract read
In one paragraph

Article in Communications chemistry, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Article
  2. Technical review of artificial intelligence in TCR-T therapy.Journal of the National Cancer Center · 2026
    Review
  3. Review
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Tingzhong Tian *Institute for Interdisciplinary Information Sciences, Tsinghua University, Beijing, China.ORCID http://orcid.org/0000-0003-4899-0632
Shuya Li *Institute for Interdisciplinary Information Sciences, Tsinghua University, Beijing, China.ORCID http://orcid.org/0009-0003-2878-0926
Ziting ZhangDepartment of Automation, Tsinghua University, Beijing, China.
Lin ChenSilexon AI Technology Co., Ltd., Nanjing, Jiangsu Province, China.
Ziheng ZouSilexon AI Technology Co., Ltd., Nanjing, Jiangsu Province, China.
Dan ZhaoInstitute for Interdisciplinary Information Sciences, Tsinghua University, Beijing, China. zhaodan2018@tsinghua.edu.cn.ORCID http://orcid.org/0000-0003-0195-6031
Jianyang ZengInstitute for Interdisciplinary Information Sciences, Tsinghua University, Beijing, China. zengjy@westlake.edu.cn.ORCID http://orcid.org/0000-0003-0950-7716

Funding

National Natural Science Foundation of China (National Science Foundation of China) 31900862National Natural Science Foundation of China (National Science Foundation of China) T2125007
6 · The paper itself

Abstract

Identifying active compounds for target proteins is fundamental in early drug discovery. Recently, data-driven computational methods have demonstrated promising potential in predicting compound activities. However, there lacks a well-designed benchmark to comprehensively evaluate these methods from a practical perspective. To fill this gap, we propose a Compound Activity benchmark for Real-world Applications (CARA). Through carefully distinguishing assay types, designing train-test splitting schemes and selecting evaluation metrics, CARA can consider the biased distribution of current real-world compound activity data and avoid overestimation of model performances. We observed that although current models can make successful predictions for certain proportions of assays, their performances varied across different assays. In addition, evaluation of several few-shot training strategies demonstrated different performances related to task types. Overall, we provide a high-quality dataset for developing and evaluating compound activity prediction models, and the analyses in this work may inspire better applications of data-driven models in drug discovery.

Identifiers

PMID38834746
PMCPMC11150475

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.