Evidence map›Paper›PMID 39122775›Full record

ArticleNature communications2024

High-performance deep spiking neural networks with 0.3 spikes per neuron.

Ana Stanojevic, Stanisław Woźniak, Guillaume Bellec, Giovanni Cherubini, Angeliki Pantazi, Wulfram Gerstner

Abstract read
In one paragraph

Article in Nature communications, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed.

  1. Review
  2. Review
  3. Low-Latency Visuotactile Neuron Using Self-Oscillating Memristor.Small (Weinheim an der Bergstrasse, Germany) · 2026
    Article
  4. Review
  5. Article
  6. Spark: modular spiking neural networks.Frontiers in artificial intelligence · 2026
    Article
  7. Article
  8. Article
  9. Article
  10. Deep oscillatory neural network.Scientific reports · 2025
    Article
  11. Can neuromorphic computing help reduce AI's high energy cost?Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Ana StanojevicIBM Research Europe - Zurich, Rüschlikon, Switzerland.
Stanisław WoźniakIBM Research Europe - Zurich, Rüschlikon, Switzerland. stw@zurich.ibm.com.ORCID http://orcid.org/0000-0001-7282-3792
Guillaume BellecSchool of Computer and Communication Sciences, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.ORCID http://orcid.org/0000-0001-7568-4994
Giovanni CherubiniIBM Research Europe - Zurich, Rüschlikon, Switzerland.ORCID http://orcid.org/0000-0002-0573-2919
Angeliki PantaziIBM Research Europe - Zurich, Rüschlikon, Switzerland.ORCID http://orcid.org/0000-0003-4720-4038
Wulfram GerstnerSchool of Computer and Communication Sciences, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Communication by rare, binary spikes is a key factor for the energy efficiency of biological brains. However, it is harder to train biologically-inspired spiking neural networks than artificial neural networks. This is puzzling given that theoretical results provide exact mapping algorithms from artificial to spiking neural networks with time-to-first-spike coding. In this paper we analyze in theory and simulation the learning dynamics of time-to-first-spike-networks and identify a specific instance of the vanishing-or-exploding gradient problem. While two choices of spiking neural network mappings solve this problem at initialization, only the one with a constant slope of the neuron membrane potential at threshold guarantees the equivalence of the training trajectory between spiking and artificial neural networks with rectified linear units. For specific image classification architectures comprising feed-forward dense or convolutional layers, we demonstrate that deep spiking neural network models can be effectively trained from scratch on MNIST and Fashion-MNIST datasets, or fine-tuned on large-scale datasets, such as CIFAR10, CIFAR100 and PLACES365, to achieve the exact same performance as that of artificial neural networks, surpassing previous spiking neural networks. Our approach accomplishes high-performance classification with less than 0.3 spikes per neuron, lending itself for an energy-efficient implementation. We also show that fine-tuning spiking neural networks with our robust gradient descent algorithm enables their optimization for hardware implementations with low latency and resilience to noise and quantization.

Identifiers

PMID39122775
PMCPMC11315905

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.