Evidence map›Paper›PMID 33244209›Full record

ArticleAdvances in neural information processing systems2019

An Adaptive Empirical Bayesian Method for Sparse Deep Learning.

Wei Deng, Xiao Zhang, Faming Liang, Guang Lin

Abstract read
In one paragraph

Article in Advances in neural information processing systems, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Article
  2. Extended fiducial inference: toward an automated process of statistical inference.Journal of the Royal Statistical Society. Series B, Statistical methodology · 2025
    Article
  3. Article
  4. Deep network embedding with dimension selection.Neural networks : the official journal of the International Neural Network Society · 2024
    Article
  5. Causal-StoNet: Causal Inference for High-Dimensional Complex Data.... International Conference on Learning Representations · 2024
    Article
  6. A Stochastic Approximation-Langevinized Ensemble Kalman Filter Algorithm for State Space Models with Unknown Parameters.Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America · 2023
    Article
  7. Stochastic gradient Langevin dynamics with adaptive drifts.Journal of statistical computation and simulation · 2022
    Article
  8. Article
  9. A Variational Approximation for Analyzing the Dynamics of Panel Data.Uncertainty in artificial intelligence : proceedings of the ... conference. Conference on Uncertainty in Artificial Intelligence · 2021
    Article
  10. Non-convex Learning via Replica Exchange Stochastic Gradient MCMC.Proceedings of machine learning research · 2020
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Wei DengDepartment of Mathematics, Purdue University, West Lafayette, IN 47907.
Xiao ZhangDepartment of Computer Science, Purdue University, West Lafayette, IN 47907.
Faming LiangDepartment of Statistics, Purdue University, West Lafayette, IN 47907.
Guang LinDepartments of Mathematics, Statistics and School of Mechanical Engineering, Purdue University, West Lafayette, IN 47907.

Funding

An Imputation-Consistency Algorithm for Biomedical Complex Data AnalysisR01GM126089 · NIGMS · PURDUE UNIVERSITY · PI LIANG, FAMING · 2018 to 2021
$1.2M
Equivalent Partial Correlation Methods for Integrative Genetic Network Analysis R01GM117597 · NIGMS · UNIVERSITY OF FLORIDA · PI LIANG, FAMING · 2015 to 2017
$1.0M
NIGMS NIH HHS R01 GM117597NIGMS NIH HHS R01 GM126089
6 · The paper itself

Abstract

We propose a novel adaptive empirical Bayesian (AEB) method for sparse deep learning, where the sparsity is ensured via a class of self-adaptive spike-and-slab priors. The proposed method works by alternatively sampling from an adaptive hierarchical posterior distribution using stochastic gradient Markov Chain Monte Carlo (MCMC) and smoothly optimizing the hyperparameters using stochastic approximation (SA). We further prove the convergence of the proposed method to the asymptotically correct distribution under mild conditions. Empirical applications of the proposed method lead to the state-of-the-art performance on MNIST and Fashion MNIST with shallow convolutional neural networks (CNN) and the state-of-the-art compression performance on CIFAR10 with Residual Networks. The proposed method also improves resistance to adversarial attacks.

Identifiers

PMID33244209
PMCPMC7687285

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.