Evidence map›Paper›PMID 37202537›Full record

ArticleNature methods2023

The Cell Tracking Challenge: 10 years of objective benchmarking.

Martin Maška, Vladimír Ulman, Pablo Delgado-Rodriguez, Estibaliz Gómez-de-Mariscal, Tereza Nečasová, Fidel A Guerrero Peña, Tsang Ing Ren, Elliot M Meyerowitz, Tim Scherr, Katharina Löffler and 29 more

Abstract read
In one paragraph

Article in Nature methods, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 92 papers.

0numbers the graph read from it
0cells of the map it votes in
92citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

92 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Identification of optimal fluorophores for use in theMolecular biology of the cell · 2026
    Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Review
  20. Article

32 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

39 authors.

Martin MaškaCentre for Biomedical Image Analysis, Faculty of Informatics, Masaryk University, Brno, Czech Republic.ORCID http://orcid.org/0000-0003-3544-6494
Vladimír UlmanCentre for Biomedical Image Analysis, Faculty of Informatics, Masaryk University, Brno, Czech Republic.ORCID http://orcid.org/0000-0002-4270-7982
Pablo Delgado-RodriguezBioengineering Department, Universidad Carlos III de Madrid, Madrid, Spain.ORCID http://orcid.org/0000-0002-5991-7791
Estibaliz Gómez-de-MariscalBioengineering Department, Universidad Carlos III de Madrid, Madrid, Spain.ORCID http://orcid.org/0000-0003-2082-3277
Tereza NečasováCentre for Biomedical Image Analysis, Faculty of Informatics, Masaryk University, Brno, Czech Republic.ORCID http://orcid.org/0000-0002-5896-2347
Fidel A Guerrero PeñaCentro de Informatica, Universidade Federal de Pernambuco, Recife, Brazil.ORCID http://orcid.org/0000-0002-9999-5321
Tsang Ing RenCentro de Informatica, Universidade Federal de Pernambuco, Recife, Brazil.ORCID http://orcid.org/0000-0002-3677-0264
Elliot M MeyerowitzDivision of Biology and Biological Engineering and Howard Hughes Medical Institute, California Institute of Technology, Pasadena, CA, USA.ORCID http://orcid.org/0000-0003-4798-5153
Tim ScherrInstitute for Automation and Applied Informatics, Karlsruhe Institute of Technology, Eggenstein-Leopoldshafen, Germany.ORCID http://orcid.org/0000-0001-8755-2825
Katharina LöfflerInstitute for Automation and Applied Informatics, Karlsruhe Institute of Technology, Eggenstein-Leopoldshafen, Germany.ORCID http://orcid.org/0000-0001-9769-3517
Ralf MikutInstitute for Automation and Applied Informatics, Karlsruhe Institute of Technology, Eggenstein-Leopoldshafen, Germany.ORCID http://orcid.org/0000-0001-9100-5496
Tianqi GuoThe Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA.ORCID http://orcid.org/0000-0002-1690-5897
Yin WangThe Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA.
Jan P AllebachThe Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA.
Rina BaoBoston Children's Hospital and Harvard Medical School, Boston, MA, USA.
Noor M Al-ShakarjiCIVA Lab, Department of Electrical Engineering and Computer Science, University of Missouri, Columbia, MO, USA.
Gani RahmonCIVA Lab, Department of Electrical Engineering and Computer Science, University of Missouri, Columbia, MO, USA.ORCID http://orcid.org/0000-0002-4961-8229
Imad Eddine ToubalCIVA Lab, Department of Electrical Engineering and Computer Science, University of Missouri, Columbia, MO, USA.ORCID http://orcid.org/0000-0003-1754-0823
Kannappan PalaniappanCIVA Lab, Department of Electrical Engineering and Computer Science, University of Missouri, Columbia, MO, USA.
Filip LuxCentre for Biomedical Image Analysis, Faculty of Informatics, Masaryk University, Brno, Czech Republic.ORCID http://orcid.org/0000-0002-3707-8157
Petr MatulaCentre for Biomedical Image Analysis, Faculty of Informatics, Masaryk University, Brno, Czech Republic.ORCID http://orcid.org/0000-0003-4125-1597
Ko SugawaraInstitut de Génomique Fonctionnelle de Lyon (IGFL), École Normale Supérieure de Lyon, Lyon, France.ORCID http://orcid.org/0000-0002-1392-9340
Klas E G MagnussonRaysearch Laboratories AB, Stockholm, Sweden.ORCID http://orcid.org/0000-0002-5329-575X
Layton AhoDepartment of Electrical and Computer Engineering, Drexel University, Philadelphia, PA, USA.
Andrew R CohenDepartment of Electrical and Computer Engineering, Drexel University, Philadelphia, PA, USA.
Assaf ArbelleSchool of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Beersheba, Israel.
Tal Ben-HaimSchool of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Beersheba, Israel.
Tammy Riklin RavivSchool of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Beersheba, Israel.
Fabian IsenseeDivision of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany.
Paul F JägerHelmholtz Imaging, German Cancer Research Center (DKFZ), Heidelberg, Germany.
Klaus H Maier-HeinDivision of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany.
Yanming ZhuSchool of Computer Science and Engineering, University of New South Wales, Sydney, New South Wales, Australia.ORCID http://orcid.org/0000-0002-8238-8090
Cristina EderraBiomedical Engineering Program and Ciberonc, Center for Applied Medical Research, Universidad de Navarra, Pamplona, Spain.
Ainhoa UrbiolaBiomedical Engineering Program and Ciberonc, Center for Applied Medical Research, Universidad de Navarra, Pamplona, Spain.
Erik MeijeringSchool of Computer Science and Engineering, University of New South Wales, Sydney, New South Wales, Australia.
Alexandre CunhaCenter for Advanced Methods in Biological Image Analysis, Beckman Institute, California Institute of Technology, Pasadena, CA, USA.ORCID http://orcid.org/0000-0002-2541-6024
Arrate Muñoz-BarrutiaBioengineering Department, Universidad Carlos III de Madrid, Madrid, Spain.ORCID http://orcid.org/0000-0002-1573-1661
Michal Kozubek *Centre for Biomedical Image Analysis, Faculty of Informatics, Masaryk University, Brno, Czech Republic. kozubek@fi.muni.cz.ORCID http://orcid.org/0000-0001-7902-589X
Carlos Ortiz-de-Solórzano *Biomedical Engineering Program and Ciberonc, Center for Applied Medical Research, Universidad de Navarra, Pamplona, Spain. codesolorzano@unav.es.ORCID http://orcid.org/0000-0001-8720-0205

Funding

Quantitative analysis of estrogen and sleep deprivation-induced blood and lymphatic vascular remodeling in the brain systemR01NS110915 · NINDS · UNIVERSITY OF MISSOURI-COLUMBIA · PI GLINSKII, OLGA V, PALANIAPPAN, KANNAPPAN · 2019 to 2023
$2.7M
Howard Hughes Medical InstituteNINDS NIH HHS R01 NS110915
6 · The paper itself

Abstract

The Cell Tracking Challenge is an ongoing benchmarking initiative that has become a reference in cell segmentation and tracking algorithm development. Here, we present a significant number of improvements introduced in the challenge since our 2017 report. These include the creation of a new segmentation-only benchmark, the enrichment of the dataset repository with new datasets that increase its diversity and complexity, and the creation of a silver standard reference corpus based on the most competitive results, which will be of particular interest for data-hungry deep learning-based strategies. Furthermore, we present the up-to-date cell segmentation and tracking leaderboards, an in-depth analysis of the relationship between the performance of the state-of-the-art methods and the properties of the datasets and annotations, and two novel, insightful studies about the generalizability and the reusability of top-performing methods. These studies provide critical practical conclusions for both developers and users of traditional and machine learning-based cell segmentation and tracking algorithms.

Indexed as

Cell TrackingAlgorithmsMachine Learning

Identifiers

PMID37202537
PMCPMC10333123

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.