Evidence map›Paper›PMID 24526711›Full record

ArticleBioinformatics (Oxford, England)2014

A benchmark for comparison of cell tracking algorithms.

Martin Maška, Vladimír Ulman, David Svoboda, Pavel Matula, Petr Matula, Cristina Ederra, Ainhoa Urbiola, Tomás España, Subramanian Venkatesan, Deepak M W Balak and 20 more

Abstract read
In one paragraph

Article in Bioinformatics (Oxford, England), 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 120 papers.

0numbers the graph read from it
0cells of the map it votes in
120citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

120 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. BOUNDARY-AWARE INSTANCE SEGMENTATION IN MICROSCOPY IMAGING.Proceedings. IEEE International Symposium on Biomedical Imaging · 2026
    Article
  10. Article
  11. Article
  12. Article
  13. Tui: A Multigenerational and Expert-Correctable Tracker for Cellular Dynamics.Computational and structural biotechnology journal · 2026
    Article
  14. TrackRefiner a tool for refinement of bacillus cell tracking data.NPJ systems biology and applications · 2025
    Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

60 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

30 authors.

Martin MaškaCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, SpainCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and
Vladimír UlmanCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
David SvobodaCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Pavel MatulaCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Petr MatulaCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Cristina EderraCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Ainhoa UrbiolaCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Tomás EspañaCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Subramanian VenkatesanCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Deepak M W BalakCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Pavel KarasCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Tereza BolckováCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Markéta StreitováCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Craig CarthelCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Stefano CoraluppiCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Nathalie HarderCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Karl RohrCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Klas E G MagnussonCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Joakim JaldénCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Helen M BlauCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Oleh DzyubachykCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Pavel KřížekCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Guy M HagenCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
David Pastor-EscuredoCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Daniel Jimenez-CarreteroCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Maria J Ledesma-CarbayoCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Arrate Muñoz-BarrutiaCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Erik MeijeringCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Michal KozubekCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.
Carlos Ortiz-de-SolorzanoCenter for Biomedical Image Analysis, Masaryk University, 602 00 Brno, Czech Republic, Cancer Imaging Laboratory, Oncology Division, Center for Applied Medical Research, University of Navarra, 31008 Pamplona, Spain, Biomedical Imaging Group Rotterdam, Erasmus University Medical Center, 3015 GE Rotterdam, The Netherlands, Fusion Technology and Systems Department, Compunetix Inc., Monroeville, PA 15146, USA, Biomedical Computer Vision Group, Department of Bioinformatics and Functional Genomics, University of Heidelberg, BIOQUANT, IPMB and DKFZ, 69120 Heidelberg, Germany, KTH Royal Institute of Technology, ACCESS Linnaeus Center, Department of Signal Processing, 100 44 Stockholm, Sweden, Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Institute for Stem Cell Biology and Regenerative Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA, Division of Image Processing, Leiden University Medical Center, 2300 RC Leiden, The Netherlands, Institute of Cellular Biology and Pathology, First Faculty of Medicine, Charles University in Prague, 12801 Prague 2, Czech Republic and Biomedical Image Technologies, Universidad Politécnica de Madrid & CIBER BBN, 28040 Madrid, Spain.

Funding

Stem Cells for Brain and BrawnR01AG020961 · NIA · STANFORD UNIVERSITY · PI BLAU, HELEN M · 2002 to 2019
$5.0M
ACTIVATORS OF MUSCLE GENESR01AG009521 · NIA · STANFORD UNIVERSITY · PI BLAU, HELEN M · 1990 to 2014
$4.7M
Regulation of Hematopoietic Stem Cell Fate in Bioengineered NichesR01HL096113 · NHLBI · STANFORD UNIVERSITY · PI BLAU, HELEN M · 2009 to 2013
$2.7M
3D Bioengineering Strategies to Mimic Human Skeletal Muscle Progenitor Cell NicheR21AR062359 · NIAMS · STANFORD UNIVERSITY · PI BLAU, HELEN M, HEILSHORN, SARAH C · 2011 to 2012
$367k
NHLBI NIH HHS R01 HL096113NIAMS NIH HHS R21 AR062359NIA NIH HHS R01 AG009521NIA NIH HHS R01 AG020961
6 · The paper itself

Abstract

motivationAutomatic tracking of cells in multidimensional time-lapse fluorescence microscopy is an important task in many biomedical applications. A novel framework for objective evaluation of cell tracking algorithms has been established under the auspices of the IEEE International Symposium on Biomedical Imaging 2013 Cell Tracking Challenge. In this article, we present the logistics, datasets, methods and results of the challenge and lay down the principles for future uses of this benchmark.

resultsThe main contributions of the challenge include the creation of a comprehensive video dataset repository and the definition of objective measures for comparison and ranking of the algorithms. With this benchmark, six algorithms covering a variety of segmentation and tracking paradigms have been compared and ranked based on their performance on both synthetic and real datasets. Given the diversity of the datasets, we do not declare a single winner of the challenge. Instead, we present and discuss the results for each individual dataset separately. AVAILABILITY AND IMPLEMENTATION: The challenge Web site (http://www.codesolorzano.com/celltrackingchallenge) provides access to the training and competition datasets, along with the ground truth of the training videos. It also provides access to Windows and Linux executable files of the evaluation software and most of the algorithms that competed in the challenge.

Indexed as

AlgorithmsBenchmarkingCell TrackingMicroscopy, Fluorescence

Identifiers

PMID24526711
PMCPMC4029039

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.