Evidence map›Paper›PMID 40667282›Full record

ArticlebioRxiv : the preprint server for biology2025

Beyond benchmarking: an expert-guided consensus approach to spatially aware clustering.

Jieran Sun, Kirti Biharie, Peiying Cai, Niklas Müller-Bötticher, Paul Kiessling, Meghan A Turner, Søren H Dam, Florian Heyl, Sarusan Kathirchelvan, Martin Emons and 13 more

Abstract readPreprint
In one paragraph

Article in bioRxiv : the preprint server for biology, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

23 authors.

Jieran SunBiomedical Data Science Center, Centre Hospitalier Universitaire Vaudois, Rue du Bugnon 21, 1011 Lausanne, Switzerland.ORCID 0000-0002-7996-3840
Kirti BiharieDepartment of Human Genetics, Leiden University Medical Center, Einthovenweg 20, 2333 ZC Leiden, Netherlands.ORCID 0000-0002-8274-8439
Peiying CaiDepartment of Molecular Life Sciences and SIB Swiss Institute of Bioinformatics, University of Zurich, Winterthurerstrasse 190, 8057 Zurich, Switzerland.ORCID 0009-0001-9229-2244
Niklas Müller-BötticherBerlin Institute of Health at Charité - Universitätsmedizin Berlin, Center of Digital Health, Charitéplatz 1, 10117 Berlin, Germany.ORCID 0000-0001-5103-7282
Paul KiesslingDepartment of Nephrology, Rheumatology, and Clinical Immunology, University Hospital RWTH Aachen, Pauwelsstraße 30, Aachen, Germany.ORCID 0000-0002-9794-9532
Meghan A TurnerAllen Institute for Brain Science, 615 Westlake Ave N, Seattle, WA, USA 98109.ORCID 0000-0003-2451-5036
Søren H DamDTU Health Tech, Technical University of Denmark, Ørsteds Plads, Building 345C, 2800, Kgs. Lyngby, Denmark.ORCID 0000-0003-0755-0016
Florian HeylGerman Cancer Research Center (DKFZ), Division of Computational Genomics and Systems Genetics, Im Neuenheimer Feld 280, 69120 Heidelberg, Germany.ORCID 0000-0002-3651-5685
Sarusan KathirchelvanDepartment of Molecular Life Sciences and SIB Swiss Institute of Bioinformatics, University of Zurich, Winterthurerstrasse 190, 8057 Zurich, Switzerland.
Martin EmonsDepartment of Molecular Life Sciences and SIB Swiss Institute of Bioinformatics, University of Zurich, Winterthurerstrasse 190, 8057 Zurich, Switzerland.ORCID 0009-0000-5219-5311
Samuel GunzDepartment of Molecular Life Sciences and SIB Swiss Institute of Bioinformatics, University of Zurich, Winterthurerstrasse 190, 8057 Zurich, Switzerland.ORCID 0000-0002-8909-0932
Sven TwardziokBerlin Institute of Health at Charité - Universitätsmedizin Berlin, Center of Digital Health, Charitéplatz 1, 10117 Berlin, Germany.ORCID 0000-0002-0326-5704
Amin El-HeliebiDivision of Cell Biology, Histology and Embryology, Gottfried Schatz Research Center, Medical University of Graz, Graz, Austria.ORCID 0000-0002-7679-6856
Martin ZachariasDiagnostic and Research Institute of Pathology, Medical University of Graz, Graz, Austria.
SpaceHack 2.0 participants
Roland EilsBerlin Institute of Health at Charité - Universitätsmedizin Berlin, Center of Digital Health, Charitéplatz 1, 10117 Berlin, Germany.
Marcel ReindersDelft Bioinformatics Lab, Delft University of Technology, Van Mourik Broekmanweg 6, 2628 XE Delft, Netherlands.ORCID 0000-0002-1148-1562
Raphael GottardoBiomedical Data Science Center, Centre Hospitalier Universitaire Vaudois, Rue du Bugnon 21, 1011 Lausanne, Switzerland.ORCID 0000-0002-3867-0232
Christoph KuppeDepartment of Nephrology, Rheumatology, and Clinical Immunology, University Hospital RWTH Aachen, Pauwelsstraße 30, Aachen, Germany.ORCID 0000-0003-4597-9833
Brian LongAllen Institute for Brain Science, 615 Westlake Ave N, Seattle, WA, USA 98109.ORCID 0000-0002-7793-5969
Ahmed MahfouzDepartment of Human Genetics, Leiden University Medical Center, Einthovenweg 20, 2333 ZC Leiden, Netherlands.ORCID 0000-0001-8601-2149
Mark D RobinsonDepartment of Molecular Life Sciences and SIB Swiss Institute of Bioinformatics, University of Zurich, Winterthurerstrasse 190, 8057 Zurich, Switzerland.ORCID 0000-0002-3048-5518
Naveed IshaqueBerlin Institute of Health at Charité - Universitätsmedizin Berlin, Center of Digital Health, Charitéplatz 1, 10117 Berlin, Germany.ORCID 0000-0002-8426-901X

Funding

Thalamus in the middle: computations in multi-regional neural circuitsU19NS123714 · NINDS · ALLEN INSTITUTE · PI Adam G Carter, Jayaram Chandrashekar · 2022 to 2026
$19.0M
NINDS NIH HHS U19 NS123714
6 · The paper itself

Abstract

Spatial omics technologies have revolutionized the study of tissue architecture and cellular heterogeneity by integrating molecular profiles with spatial localization. In spatially resolved transcriptomics, delineating higher-order anatomical structures is critical for understanding how cellular organization affects tissue and organ function. Since 2020, more than 50 spatially aware clustering (SAC) methods have been developed for this purpose. However, the reliability of current benchmarks is undermined by their narrow focus on Visium and brain tissue datasets, as well as incorrect interpretation of manual annotation as ground truth. Here, we present SACCELERATOR, a community-driven, extensible framework that standardizes data formatting, method integration, and metric evaluation, and is designed to rapidly incorporate new methods and datasets. SACCELERATOR currently includes 22 SAC methods applied to 15 datasets spanning 9 technologies and diverse tissue types. Our analysis revealed substantial limitations in the generalizability and reproducibility of SAC methods across tissues and platforms. We also demonstrate that anatomical labels commonly used as ground truths are often biased, potentially error-prone, and, in some cases, unsuitable for benchmarking efforts. Rather than scoring and comparing methods, we propose a consensus-guided workflow that aggregates clustering results to generate consensus representations. Descriptive spatial metrics highlight areas of high entropy where method disagreement is highest, enabling targeted feedback for tissue experts. Applied to brain and cancer datasets, this approach uncovered biologically meaningful patterns overlooked by individual methods and manual annotations. Our results underscore the need for iterative, expert-in-the-loop analysis and reveal that traditional evaluation metrics do not always capture the subjective qualities of results. By improving tissue annotation and addressing key benchmarking limitations, SACCELERATOR provides a robust foundation for advancing spatial omics research.

Indexed as

benchmarkclusteringexpert-in-the-loopground truthmeta-analysisspatial transcriptomics

Identifiers

PMID40667282
PMCPMC12262716

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.