Evidence map›Paper›PMID 36316563›Full record

ArticleNature methods2022

Incorporating the image formation process into deep learning improves network performance.

Yue Li, Yijun Su, Min Guo, Xiaofei Han, Jiamin Liu, Harshad D Vishwasrao, Xuesong Li, Ryan Christensen, Titas Sengupta, Mark W Moyle and 8 more

Open access · hybridAbstract read
In one paragraph

Article in Nature methods, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 49 papers.

0numbers the graph read from it
0cells of the map it votes in
49citing papers in PubMed
26.9field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

49 citing papers in PubMed, 110 citations in OpenAlex.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors at 7 institutions in 2 countries.

Yue LiState Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou, Zhejiang, China.ORCID 0000-0002-9299-0974
Yijun SuLaboratory of High Resolution Optical Imaging, National Institute of Biomedical Imaging and Bioengineering, National Institutes of Health, Bethesda, MD, USA.
Min GuoLaboratory of High Resolution Optical Imaging, National Institute of Biomedical Imaging and Bioengineering, National Institutes of Health, Bethesda, MD, USA.ORCID 0000-0002-2093-8771
Xiaofei HanLaboratory of High Resolution Optical Imaging, National Institute of Biomedical Imaging and Bioengineering, National Institutes of Health, Bethesda, MD, USA.
Jiamin LiuAdvanced Imaging and Microscopy Resource, National Institutes of Health, Bethesda, MD, USA.
Harshad D VishwasraoAdvanced Imaging and Microscopy Resource, National Institutes of Health, Bethesda, MD, USA.
Xuesong LiLaboratory of High Resolution Optical Imaging, National Institute of Biomedical Imaging and Bioengineering, National Institutes of Health, Bethesda, MD, USA.
Ryan ChristensenLaboratory of High Resolution Optical Imaging, National Institute of Biomedical Imaging and Bioengineering, National Institutes of Health, Bethesda, MD, USA.
Titas SenguptaLewis-Sigler Institute for Integrative Genomics, Princeton University, Princeton, NJ, USA.
Mark W MoyleDepartment of Biology, Brigham Young University-Idaho, Rexburg, ID, USA.
Ivan Rey-SuarezInstitute for Physical Science and Technology, University of Maryland, College Park, MD, USA.
Jiji ChenAdvanced Imaging and Microscopy Resource, National Institutes of Health, Bethesda, MD, USA.ORCID 0000-0002-4426-3035
Arpita UpadhyayaInstitute for Physical Science and Technology, University of Maryland, College Park, MD, USA.
Ted B UsdinSystems Neuroscience Imaging Resource, National Institute of Mental Health (NIMH), National Institutes of Health (NIH), Bethesda, MD, USA.
Daniel Alfonso Colón-RamosWu Tsai Institute, Department of Neuroscience and Department of Cell Biology, Yale University School of Medicine, New Haven, CT, USA.ORCID 0000-0003-0223-7717
Huafeng LiuState Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou, Zhejiang, China. liuhf@zju.edu.cn.
Yicong WuLaboratory of High Resolution Optical Imaging, National Institute of Biomedical Imaging and Bioengineering, National Institutes of Health, Bethesda, MD, USA. yicong.wu@nih.gov.ORCID 0000-0002-8819-7527
Hari ShroffLaboratory of High Resolution Optical Imaging, National Institute of Biomedical Imaging and Bioengineering, National Institutes of Health, Bethesda, MD, USA.
National Institutes of Health · USUniversity of Maryland, College Park · USBrigham Young University - Idaho · USJiaxing University · CNMarine Biological Laboratory · USPrinceton University · USZhejiang University · CN

Funding

Systems Neuroscience Imaging ResourceZICMH002963 · NIMH · NATIONAL INSTITUTE OF MENTAL HEALTH · PI USDIN, THEODORE · 2017 to 2025
$18.0M
Section on High Resolution Optical ImagingZIAEB000074 · NIBIB · NATIONAL INSTITUTE OF BIOMEDICAL IMAGING AND BIOENGINEERING · PI SHROFF, HARI · 2010 to 2022
$15.2M
WormGUIDES: A Resource for Global Understanding in Dynamic Embryonic SystemsR24OD016474 · OD · YALE UNIVERSITY · PI BAO, ZHIRONG, COLON-RAMOS, DANIEL A · 2013 to 2020
$6.5M
Supplement request for Microtubule regulation of actomyosin dynamics and force generation in T lymphocytesR01GM131054 · NIGMS · UNIV OF MARYLAND, COLLEGE PARK · PI UPADHYAYA, ARPITA · 2019 to 2022
$1.4M
Molecular and cellular mechanisms required for fascicle organization during neurodevelopmentF32NS098616 · NINDS · YALE UNIVERSITY · PI MOYLE, MARK WAYNE · 2016 to 2018
$192k
Howard Hughes Medical InstituteIntramural NIH HHS ZIA EB000074Intramural NIH HHS ZIC MH002963NIGMS NIH HHS R01 GM131054NIH HHS R24 OD016474NINDS NIH HHS F32 NS098616
6 · The paper itself

Abstract

We present Richardson-Lucy network (RLN), a fast and lightweight deep learning method for three-dimensional fluorescence microscopy deconvolution. RLN combines the traditional Richardson-Lucy iteration with a fully convolutional network structure, establishing a connection to the image formation process and thereby improving network performance. Containing only roughly 16,000 parameters, RLN enables four- to 50-fold faster processing than purely data-driven networks with many more parameters. By visual and quantitative analysis, we show that RLN provides better deconvolution, better generalizability and fewer artifacts than other networks, especially along the axial dimension. RLN outperforms classic Richardson-Lucy deconvolution on volumes contaminated with severe out of focus fluorescence or noise and provides four- to sixfold faster reconstructions of large, cleared-tissue datasets than classic multi-view pipelines. We demonstrate RLN's performance on cells, tissues and embryos imaged with widefield-, light-sheet-, confocal- and super-resolution microscopy.

Indexed as

AlgorithmsDeep LearningArtifactsImage Processing, Computer-AssistedMicroscopy, Fluorescence

Identifiers

PMID36316563
PMCPMC9636023
OpenAlexW4307716783

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.