Evidence map›Paper›PMID 29086168›Full record

ArticleJournal of cheminformatics2017

Beyond the hype: deep neural networks outperform established methods using a ChEMBL bioactivity benchmark set.

Eelke B Lenselink, Niels Ten Dijke, Brandon Bongers, George Papadatos, Herman W T van Vlijmen, Wojtek Kowalczyk, Adriaan P IJzerman, Gerard J P van Westen

Open access · goldAbstract read
In one paragraph

Article in Journal of cheminformatics, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 124 papers.

0numbers the graph read from it
0cells of the map it votes in
124citing papers in PubMed
28.7field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

124 citing papers in PubMed, 334 citations in OpenAlex.

  1. Article
  2. Review
  3. Article
  4. Review
  5. Article
  6. Integrative deep learning strategies to enhance early-stage drug discovery: optimizing computational structure-activity modeling for pharmacotherapeutic innovation.Journal of pharmacy & pharmaceutical sciences : a publication of the Canadian Society for Pharmaceutical Sciences, Societe canadienne des sciences pharmaceutiques · 2026
    Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Review
  12. Article
  13. Article
  14. Article
  15. Article
  16. Review
  17. DrugForm-DTA: Towards real-world drug-target binding affinity model.Computational and structural biotechnology journal · 2025
    Article
  18. Article
  19. Article
  20. Article

64 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 2 institutions in 2 countries.

Eelke B LenselinkDivision of Medicinal Chemistry, Drug Discovery and Safety, Leiden Academic Centre for Drug Research, Leiden University, P.O. Box 9502, 2300 RA, Leiden, The Netherlands.
Niels Ten DijkeLeiden Institute of Advanced Computer Science, Leiden University, P.O. Box 9512, 2300 RA, Leiden, The Netherlands.
Brandon BongersDivision of Medicinal Chemistry, Drug Discovery and Safety, Leiden Academic Centre for Drug Research, Leiden University, P.O. Box 9502, 2300 RA, Leiden, The Netherlands.
George PapadatosEuropean Molecular Biology Laboratory, European Bioinformatics Institute (EMBL-EBI), Wellcome Genome Campus, Hinxton, Cambridge, UK.
Herman W T van VlijmenDivision of Medicinal Chemistry, Drug Discovery and Safety, Leiden Academic Centre for Drug Research, Leiden University, P.O. Box 9502, 2300 RA, Leiden, The Netherlands.
Wojtek KowalczykLeiden Institute of Advanced Computer Science, Leiden University, P.O. Box 9512, 2300 RA, Leiden, The Netherlands.
Adriaan P IJzermanDivision of Medicinal Chemistry, Drug Discovery and Safety, Leiden Academic Centre for Drug Research, Leiden University, P.O. Box 9502, 2300 RA, Leiden, The Netherlands.
Gerard J P van WestenDivision of Medicinal Chemistry, Drug Discovery and Safety, Leiden Academic Centre for Drug Research, Leiden University, P.O. Box 9502, 2300 RA, Leiden, The Netherlands. gerard@gjpvanwesten.nl.ORCID http://orcid.org/0000-0003-0717-1817
Leiden University · NLEuropean Bioinformatics Institute · GB

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

The increase of publicly available bioactivity data in recent years has fueled and catalyzed research in chemogenomics, data mining, and modeling approaches. As a direct result, over the past few years a multitude of different methods have been reported and evaluated, such as target fishing, nearest neighbor similarity-based methods, and Quantitative Structure Activity Relationship (QSAR)-based protocols. However, such studies are typically conducted on different datasets, using different validation strategies, and different metrics. In this study, different methods were compared using one single standardized dataset obtained from ChEMBL, which is made available to the public, using standardized metrics (BEDROC and Matthews Correlation Coefficient). Specifically, the performance of Naïve Bayes, Random Forests, Support Vector Machines, Logistic Regression, and Deep Neural Networks was assessed using QSAR and proteochemometric (PCM) methods. All methods were validated using both a random split validation and a temporal validation, with the latter being a more realistic benchmark of expected prospective execution. Deep Neural Networks are the top performing classifiers, highlighting the added value of Deep Neural Networks over other more conventional methods. Moreover, the best method ('DNN_PCM') performed significantly better at almost one standard deviation higher than the mean performance. Furthermore, Multi-task and PCM implementations were shown to improve performance over single task Deep Neural Networks. Conversely, target prediction performed almost two standard deviations under the mean performance. Random Forests, Support Vector Machines, and Logistic Regression performed around mean performance. Finally, using an ensemble of DNNs, alongside additional tuning, enhanced the relative performance by another 27% (compared with unoptimized 'DNN_PCM'). Here, a standardized set to test and evaluate different machine learning algorithms in the context of multi-task learning is offered by providing the data and the protocols. Graphical Abstract .

Indexed as

ChEMBLCheminformaticsChemogenomicsDeep neural networksProteochemometricsQSAR

Identifiers

PMID29086168
PMCPMC5555960
OpenAlexW2740946158

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.