Evidence map›Paper›PMID 37069271›Full record

ArticleNature methods2023

BigNeuron: a resource to benchmark and predict performance of algorithms for automated tracing of neurons in light microscopy datasets.

Linus Manubens-Gil, Zhi Zhou, Hanbo Chen, Arvind Ramanathan, Xiaoxiao Liu, Yufeng Liu, Alessandro Bria, Todd Gillette, Zongcai Ruan, Jian Yang and 55 more

Erratum issuedAbstract read
PubMed Publisher
In one paragraph

Article in Nature methods, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 22 papers.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Sharing massive biomedical data at magnitudes lower bandwidth using implicit neural function.Proceedings of the National Academy of Sciences of the United States of America · 2024
    Article
  15. Article
  16. Review
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

65 authors.

Linus Manubens-Gil *Institute for Brain and Intelligence, Southeast University, Nanjing, China.ORCID 0000-0003-2036-2204
Zhi ZhouMicrosoft Corporation, Redmond, WA, USA.
Hanbo ChenTencent AI Lab, Bellevue, WA, USA.
Arvind RamanathanComputing, Environment and Life Sciences Directorate, Argonne National Laboratory, Lemont, IL, USA.
Xiaoxiao LiuKaya Medical, Seattle, WA, USA.
Yufeng LiuInstitute for Brain and Intelligence, Southeast University, Nanjing, China.ORCID 0000-0003-0848-5113
Alessandro BriaUniversity of Cassino and Southern Lazio, Cassino, Italy.ORCID 0000-0002-2895-6544
Todd GilletteCenter for Neural Informatics, Structures and Plasticity, Krasnow Institute for Advanced Study, George Mason University, Fairfax, VA, USA.
Zongcai RuanInstitute for Brain and Intelligence, Southeast University, Nanjing, China.
Jian YangFaculty of Information Technology, Beijing University of Technology, Beijing, China.
Miroslav RadojevićNuctech Netherlands, Rotterdam, the Netherlands.
Ting ZhaoJanelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA.
Li ChengDepartment of Electrical and Computer Engineering, University of Alberta, Edmonton, Alberta, Canada.
Lei QuInstitute for Brain and Intelligence, Southeast University, Nanjing, China.ORCID 0000-0002-2129-5253
Siqi LiuPaige AI, New York, NY, USA.
Kristofer E BouchardScientific Data Division and Biological Systems and Engineering Division, Lawrence Berkeley National Lab, Berkeley, CA, USA.
Lin GuRIKEN AIP, Tokyo, Japan.ORCID 0000-0002-7419-6240
Weidong CaiSchool of Computer Science, University of Sydney, Sydney, New South Wales, Australia.ORCID 0000-0003-3706-8896
Shuiwang JiTexas A&M University, College Station, TX, USA.ORCID 0000-0002-4205-4563
Badrinath RoysamCullen College of Engineering, University of Houston, Houston, TX, USA.ORCID 0000-0002-8310-1389
Ching-Wei WangGraduate Institute of Biomedical Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan.ORCID 0000-0001-9992-6863
Hongchuan YuNational Centre for Computer Animation, Bournemouth University, Poole, UK.ORCID 0000-0002-8508-7488
Amos SironiPROPHESEE, Paris, France.
Daniel Maxim IasconeDepartment of Neuroscience, Columbia University, New York, NY, USA.ORCID 0000-0002-8629-7639
Jie ZhouDepartment of Computer Science, Northern Illinois University, DeKalb, IL, USA.
Erhan BasAWS AI, Seattle, WA, USA.
Eduardo Conde-Sousai3S, Instituto de Investigação E Inovação Em Saúde, Universidade Do Porto, Porto, Portugal.
Paulo Aguiari3S, Instituto de Investigação E Inovação Em Saúde, Universidade Do Porto, Porto, Portugal.
Xiang LiMassachusetts General Hospital and Harvard Medical School, Boston, MA, USA.ORCID 0000-0002-9851-6376
Yujie LiAllen Institute for Brain Science, Seattle, WA, USA.
Sumit NandaCenter for Neural Informatics, Structures and Plasticity, Krasnow Institute for Advanced Study, George Mason University, Fairfax, VA, USA.
Yuan WangProgram in Neuroscience, Department of Biomedical Sciences, Florida State University College of Medicine, Tallahassee, FL, USA.ORCID 0000-0003-4347-7063
Leila MuresanCambridge Advanced Imaging Centre, University of Cambridge, Cambridge, UK.ORCID 0000-0002-7602-0249
Pascal FuaComputer Vision Laboratory, EPFL, Lausanne, Switzerland.
Bing YeLife Sciences Institute and Department of Cell and Developmental Biology, University of Michigan, Ann Arbor, MI, USA.ORCID 0000-0002-8828-4065
Hai-Yan HeDepartment of Biology, Georgetown University, Washington, DC, USA.
Jochen F StaigerInstitute for Neuroanatomy, University Medical Center Göttingen, Georg-August- University Göttingen, Goettingen, Germany.
Manuel PeterDepartment of Stem Cell and Regenerative Biology and Center for Brain Science, Harvard University, Cambridge, MA, USA.
Daniel N CoxNeuroscience Institute, Georgia State University, Atlanta, GA, USA.ORCID 0000-0001-9191-9212
Michel Simonneau42 ENS Paris-Saclay, CNRS, CentraleSupélec, LuMIn, Université Paris-Saclay, Gif-sur-Yvette, France.
Marcel OberlaenderMax Planck Group: In Silico Brain Sciences, Max Planck Institute for Neurobiology of Behavior - caesar, Bonn, Germany.
Gregory JefferisJanelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA.ORCID 0000-0002-0587-9355
Kei ItoJanelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA.
Paloma Gonzalez-BellidoDepartment of Ecology, Evolution, and Behavior, University of Minnesota, St Paul, MN, USA.
Jinhyun KimBrain Science Institute, Korea Institute of Science and Technology (KIST), Seoul, South Korea.
Edwin RubelVirginia Merrill Bloedel Hearing Research Center, University of Washington, Seattle, WA, USA.
Hollis T ClineThe Scripps Research Institute, San Diego, CA, USA.ORCID 0000-0002-4887-9603
Hongkui ZengAllen Institute for Brain Science, Seattle, WA, USA.ORCID 0000-0002-0326-5878
Aljoscha NernJanelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA.ORCID 0000-0002-3822-489X
Ann-Shyn ChiangBrain Research Center, National Tsing Hua University, Hsinchu, Taiwan.ORCID 0000-0001-9668-7115
Jianhua YaoTencent AI Lab, Shenzhen, China.
Jane RoskamsAllen Institute for Brain Science, Seattle, WA, USA.
Rick LiveseyZayed Centre for Rare Disease Research, UCL Great Ormond Street Institute of Child Health, London, UK.
Janine StevensJanelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA.
Tianming LiuCortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, GA, USA.
Chinh DangVirginia Merrill Bloedel Hearing Research Center, University of Washington, Seattle, WA, USA.
Yike GuoData Science Institute, Imperial College London, London, UK.
Ning ZhongFaculty of Information Technology, Beijing University of Technology, Beijing, China.
Georgia TourassiBSEC, ORNL, Oak Ridge, TN, USA.ORCID 0000-0002-9418-9638
Sean HillCampbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, Ontario, Canada.ORCID 0000-0001-8055-860X
Michael HawrylyczAllen Institute for Brain Science, Seattle, WA, USA.ORCID 0000-0002-5741-8024
Christof KochAllen Institute for Brain Science, Seattle, WA, USA.ORCID 0000-0001-6482-8067
Erik MeijeringSchool of Computer Science and Engineering, University of New South Wales, Sydney, New South Wales, Australia. meijering@imagescience.org.ORCID 0000-0001-8015-8358
Giorgio A AscoliCenter for Neural Informatics, Structures and Plasticity, Krasnow Institute for Advanced Study, George Mason University, Fairfax, VA, USA. ascoli@gmu.edu.ORCID 0000-0002-0964-676X
Hanchuan Peng *Institute for Brain and Intelligence, Southeast University, Nanjing, China. h@braintell.org.ORCID 0000-0002-3478-3942

Funding

Generation and Description of Neuronal Morphology and ConnectivityR01NS039600 · NINDS · GEORGE MASON UNIVERSITY · PI ASCOLI, GIORGIO A · 1999 to 2024
$6.9M
Experience-dependent Cellular Plasticity MechanismsR01EY031597 · NEI · SCRIPPS RESEARCH INSTITUTE, THE · PI CLINE, HOLLIS T. · 2021 to 2025
$3.6M
Cytoskeletal mechanisms of dendrite arbor shape developmentR01NS086082 · NINDS · GEORGIA STATE UNIVERSITY · PI ASCOLI, GIORGIO A, COX, DANIEL N · 2013 to 2023
$3.1M
Long-range neuronal projections: circuit blueprint or stochastic targeting? Rigorous classification of brain-wide axonal reconstructionsRF1MH128693 · NIMH · GEORGE MASON UNIVERSITY · PI ASCOLI, GIORGIO A · 2021 to 2021
$1.3M
New methods and theories to interrogate organizational principles from single cell to neuronal networksR01EB028159 · NIBIB · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI DIERSSEN, MARA, YE, BING · 2019 to 2019
$951k
Medical Research Council MC_U105188491NEI NIH HHS R01 EY031597NIBIB NIH HHS R01 EB028159NIMH NIH HHS RF1 MH128693NINDS NIH HHS R01 NS039600NINDS NIH HHS R01 NS086082
6 · The paper itself

Abstract

BigNeuron is an open community bench-testing platform with the goal of setting open standards for accurate and fast automatic neuron tracing. We gathered a diverse set of image volumes across several species that is representative of the data obtained in many neuroscience laboratories interested in neuron tracing. Here, we report generated gold standard manual annotations for a subset of the available imaging datasets and quantified tracing quality for 35 automatic tracing algorithms. The goal of generating such a hand-curated diverse dataset is to advance the development of tracing algorithms and enable generalizable benchmarking. Together with image quality features, we pooled the data in an interactive web application that enables users and developers to perform principal component analysis, t-distributed stochastic neighbor embedding, correlation and clustering, visualization of imaging and tracing data, and benchmarking of automatic tracing algorithms in user-defined data subsets. The image quality metrics explain most of the variance in the data, followed by neuromorphological features related to neuron size. We observed that diverse algorithms can provide complementary information to obtain accurate results and developed a method to iteratively combine methods and generate consensus reconstructions. The consensus trees obtained provide estimates of the neuron structure ground truth that typically outperform single algorithms in noisy datasets. However, specific algorithms may outperform the consensus tree strategy in specific imaging conditions. Finally, to aid users in predicting the most accurate automatic tracing results without manual annotations for comparison, we used support vector machine regression to predict reconstruction quality given an image volume and a set of automatic tracings.

Indexed as

MicroscopyAlgorithmsImaging, Three-DimensionalNeurons

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.