Evidence map›Paper›PMID 33074102›Full record

ArticleeLife2020

On the objectivity, reliability, and validity of deep learning enabled bioimage analyses.

Dennis Segebarth, Matthias Griebel, Nikolai Stein, Cora R von Collenberg, Corinna Martin, Dominik Fiedler, Lucas B Comeras, Anupam Sah, Victoria Schoeffler, Teresa Lüffe and 10 more

Abstract read
In one paragraph

Article in eLife, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 23 papers.

0numbers the graph read from it
0cells of the map it votes in
23citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

23 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Deep learning for genomic selection of aquatic animals.Marine life science & technology · 2024
    Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Review
  20. Bioimage Analysis and Cell Motility.Patterns (New York, N.Y.) · 2021
    Review
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

20 authors.

Dennis Segebarth *Institute of Clinical Neurobiology, University Hospital Würzburg, Würzburg, Germany.ORCID 0000-0002-3806-9324
Matthias Griebel *Department of Business and Economics, University of Würzburg, Würzburg, Germany.ORCID 0000-0003-1959-0242
Nikolai SteinDepartment of Business and Economics, University of Würzburg, Würzburg, Germany.
Cora R von CollenbergInstitute of Clinical Neurobiology, University Hospital Würzburg, Würzburg, Germany.
Corinna MartinInstitute of Clinical Neurobiology, University Hospital Würzburg, Würzburg, Germany.
Dominik FiedlerInstitute of Physiology I, Westfälische Wilhlems-Universität, Münster, Germany.
Lucas B ComerasDepartment of Pharmacology, Medical University of Innsbruck, Innsbruck, Austria.ORCID 0000-0003-2445-3605
Anupam SahDepartment of Pharmacology and Toxicology, Institute of Pharmacy and Center for Molecular Biosciences Innsbruck, University of Innsbruck, Innsbruck, Austria.ORCID 0000-0001-8298-6501
Victoria SchoefflerDepartment of Child and Adolescent Psychiatry, Center of Mental Health, University Hospital Würzburg, Würzburg, Germany.
Teresa LüffeDepartment of Child and Adolescent Psychiatry, Center of Mental Health, University Hospital Würzburg, Würzburg, Germany.
Alexander DürrDepartment of Business and Economics, University of Würzburg, Würzburg, Germany.
Rohini GuptaInstitute of Clinical Neurobiology, University Hospital Würzburg, Würzburg, Germany.
Manju SasiInstitute of Clinical Neurobiology, University Hospital Würzburg, Würzburg, Germany.
Christina LillesaarDepartment of Child and Adolescent Psychiatry, Center of Mental Health, University Hospital Würzburg, Würzburg, Germany.ORCID 0000-0002-5166-2851
Maren D LangeInstitute of Physiology I, Westfälische Wilhlems-Universität, Münster, Germany.
Ramon O TasanDepartment of Pharmacology, Medical University of Innsbruck, Innsbruck, Austria.
Nicolas SingewaldDepartment of Pharmacology and Toxicology, Institute of Pharmacy and Center for Molecular Biosciences Innsbruck, University of Innsbruck, Innsbruck, Austria.ORCID 0000-0002-0166-3370
Hans-Christian PapeInstitute of Physiology I, Westfälische Wilhlems-Universität, Münster, Germany.ORCID 0000-0001-6874-8224
Christoph M Flath *Department of Business and Economics, University of Würzburg, Würzburg, Germany.ORCID 0000-0002-1761-9833
Robert Blum *Institute of Clinical Neurobiology, University Hospital Würzburg, Würzburg, Germany.ORCID 0000-0002-5270-3854

Funding

Austrian Science Fund DKW-1206Austrian Science Fund I2433-B26,DKW-1206,SFB F4410Austrian Science Fund I 3875Austrian Science Fund P29952 & P25851Austrian Science Fund SFB F4410Austrian Science Fund FWF I 2433Austrian Science Fund FWF P 25851Austrian Science Fund FWF P 29952Deutsche Forschungsgemeinschaft ID 424778381Deutsche Forschungsgemeinschaft ID 424778381 A02Deutsche Forschungsgemeinschaft ID 44541416 - TRR58 A03Deutsche Forschungsgemeinschaft ID 44541416 - TRR58,A03Deutsche Forschungsgemeinschaft ID 44541416 - TRR58 A10Deutsche Forschungsgemeinschaft ID 44541416 - TRR58,A10Deutsche Forschungsgemeinschaft ID 44541416 - TRR58 B08Deutsche Forschungsgemeinschaft ID 44541416 - TRR58,B08Graduate School of Life Sciences Wuerzburg fellowshipInterdisziplinaeres Zentrum fuer Klinische Zusammenarbeit Wuerzburg N-320
6 · The paper itself

Abstract

Bioimage analysis of fluorescent labels is widely used in the life sciences. Recent advances in deep learning (DL) allow automating time-consuming manual image analysis processes based on annotated training data. However, manual annotation of fluorescent features with a low signal-to-noise ratio is somewhat subjective. Training DL models on subjective annotations may be instable or yield biased models. In turn, these models may be unable to reliably detect biological effects. An analysis pipeline integrating data annotation, ground truth estimation, and model training can mitigate this risk. To evaluate this integrated process, we compared different DL-based analysis approaches. With data from two model organisms (mice, zebrafish) and five laboratories, we show that ground truth estimation from multiple human annotators helps to establish objectivity in fluorescent feature annotations. Furthermore, ensembles of multiple models trained on the estimated ground truth establish reliability and validity. Our research provides guidelines for reproducible DL-based bioimage analyses.

Indexed as

AnimalsDeep LearningFearFluorescent DyesImage Processing, Computer-AssistedMaleMiceReproducibility of ResultsSignal-To-Noise RatioZebrafishFluorescent Dyesbioimage informaticscomputational biologydeep learningfluorescence microscopymouseneuroscienceobjectivityreproducibilitysystems biologyvalidityzebrafish

Identifiers

PMID33074102
PMCPMC7710359

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.