Evidence map›Paper›PMID 39107416›Full record

ArticleScientific reports2024

Convolutional neural network transformer (CNNT) for fluorescence microscopy image denoising with improved generalization and fast adaptation.

Azaan Rehman, Alexander Zhovmer, Ryo Sato, Yoh-Suke Mukouyama, Jiji Chen, Alberto Rissone, Rosa Puertollano, Jiamin Liu, Harshad D Vishwasrao, Hari Shroff and 2 more

Abstract read
In one paragraph

Article in Scientific reports, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

12 authors.

Azaan RehmanOffice of AI Research, National Heart, Lung and Blood Institute (NHLBI), National Institutes of Health (NIH), Bethesda, MD, 20892, USA.
Alexander ZhovmerCenter for Biologics Evaluation and Research, U.S. Food and Drug Administration (FDA), Silver Spring, MD, 20903, USA.
Ryo SatoLaboratory of Stem Cell and Neurovascular Research, NHLBI, NIH, Bethesda, MD, 20892, USA.
Yoh-Suke MukouyamaLaboratory of Stem Cell and Neurovascular Research, NHLBI, NIH, Bethesda, MD, 20892, USA.
Jiji ChenAdvanced Imaging and Microscopy Resource, NIBIB, NIH, Bethesda, MD, 20892, USA.
Alberto RissoneLaboratory of Protein Trafficking and Organelle Biology, NHLBI, NIH, Bethesda, MD, 20892, USA.
Rosa PuertollanoLaboratory of Protein Trafficking and Organelle Biology, NHLBI, NIH, Bethesda, MD, 20892, USA.
Jiamin LiuAdvanced Imaging and Microscopy Resource, NIBIB, NIH, Bethesda, MD, 20892, USA.
Harshad D VishwasraoAdvanced Imaging and Microscopy Resource, NIBIB, NIH, Bethesda, MD, 20892, USA.
Hari ShroffJanelia Research Campus, Howard Hughes Medical Institute (HHMI), Ashburn, VA, USA.
Christian A CombsLight Microscopy Core, National Heart, Lung, and Blood Institute, National Institutes of Health, 9000 Rockville Pike, Bethesda, MD, 20892, USA. combsc@nhlbi.nih.gov.
Hui XueOffice of AI Research, National Heart, Lung and Blood Institute (NHLBI), National Institutes of Health (NIH), Bethesda, MD, 20892, USA.

Funding

Light Microscopy CoreZICHL006019 · NHLBI · NATIONAL HEART, LUNG, AND BLOOD INSTITUTE · PI COMBS, CHRISTIAN · 2009 to 2025
$29.3M
The study of stem cell and neuro-vascular developmentZIAHL005702 · NHLBI · NATIONAL HEART, LUNG, AND BLOOD INSTITUTE · PI MUKOUYAMA, YOH-SUKE · 2009 to 2025
$14.9M
Advanced Imaging and Microscopy Shared ResourceZICEB000104 · NIBIB · NATIONAL INSTITUTE OF BIOMEDICAL IMAGING AND BIOENGINEERING · PI VISHWASRAO, HARSHAD · 2024 to 2025
$1.3M
6 · The paper itself

Abstract

Deep neural networks can improve the quality of fluorescence microscopy images. Previous methods, based on Convolutional Neural Networks (CNNs), require time-consuming training of individual models for each experiment, impairing their applicability and generalization. In this study, we propose a novel imaging-transformer based model, Convolutional Neural Network Transformer (CNNT), that outperforms CNN based networks for image denoising. We train a general CNNT based backbone model from pairwise high-low Signal-to-Noise Ratio (SNR) image volumes, gathered from a single type of fluorescence microscope, an instant Structured Illumination Microscope. Fast adaptation to new microscopes is achieved by fine-tuning the backbone on only 5-10 image volume pairs per new experiment. Results show that the CNNT backbone and fine-tuning scheme significantly reduces training time and improves image quality, outperforming models trained using only CNNs such as 3D-RCAN and Noise2Fast. We show three examples of efficacy of this approach in wide-field, two-photon, and confocal fluorescence microscopy.

Identifiers

PMID39107416
PMCPMC11303381

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.