Evidence map›Paper›PMID 42637977›Full record

ArticleNature methods2026

Beyond benchmarking: an expert-guided consensus approach to spatially aware clustering.

Jieran Sun, Kirti Biharie, Peiying Cai, Niklas Müller-Bötticher, Paul Kiessling, Meghan A Turner, Søren Helweg Dam, Florian Heyl, Sarusan Kathirchelvan, Martin Emons and 13 more

Abstract read
In one paragraph

Article in Nature methods, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. Embedding AI in biology - part 2.Nature methods · 2026
    Article
  2. Article
  3. Article
  4. Spatial Multiomics Reveal Insights Into ADC Efficacy.European journal of immunology · 2026
    Review
  5. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

23 authors.

Jieran Sun *Biomedical Data Science Center, Centre Hospitalier Universitaire Vaudois, Lausanne, Switzerland.
Kirti Biharie *Department of Human Genetics, Leiden University Medical Center, Leiden, the Netherlands.ORCID http://orcid.org/0000-0002-8274-8439
Peiying Cai *Department of Molecular Life Sciences and SIB Swiss Institute of Bioinformatics, University of Zurich, Zurich, Switzerland.
Niklas Müller-Bötticher *Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Center of Digital, Berlin, Germany.ORCID http://orcid.org/0000-0001-5103-7282
Paul Kiessling *Department of Nephrology, Rheumatology, and Clinical Immunology, University Hospital RWTH Aachen, Aachen, Germany.ORCID http://orcid.org/0000-0002-9794-9532
Meghan A Turner *Allen Institute for Brain Science, Seattle, WA, USA.ORCID http://orcid.org/0000-0003-2451-5036
Søren Helweg Dam *DTU Health Tech, Technical University of Denmark, Ørsteds Plads, Kongens Lyngby, Denmark.ORCID http://orcid.org/0000-0003-0755-0016
Florian Heyl *German Cancer Research Center (DKFZ), Division of Computational Genomics and Systems Genetics, Heidelberg, Germany.
Sarusan KathirchelvanDepartment of Molecular Life Sciences and SIB Swiss Institute of Bioinformatics, University of Zurich, Zurich, Switzerland.
Martin EmonsDepartment of Molecular Life Sciences and SIB Swiss Institute of Bioinformatics, University of Zurich, Zurich, Switzerland.ORCID http://orcid.org/0009-0000-5219-5311
Samuel GunzDepartment of Molecular Life Sciences and SIB Swiss Institute of Bioinformatics, University of Zurich, Zurich, Switzerland.ORCID http://orcid.org/0000-0002-8909-0932
Sven TwardziokBerlin Institute of Health at Charité - Universitätsmedizin Berlin, Center of Digital, Berlin, Germany.ORCID http://orcid.org/0000-0002-0326-5704
Amin El-HeliebiDivision of Cell Biology, Histology and Embryology, Gottfried Schatz Research Center, Medical University of Graz, Graz, Austria.ORCID http://orcid.org/0000-0002-7679-6856
Martin ZachariasDiagnostic and Research Institute of Pathology, Medical University of Graz, Graz, Austria.
SpaceHack 2.0 participants
Roland EilsBerlin Institute of Health at Charité - Universitätsmedizin Berlin, Center of Digital, Berlin, Germany.ORCID http://orcid.org/0000-0002-0034-4036
Marcel ReindersDelft Bioinformatics Lab, Delft University of Technology, Delft, the Netherlands.ORCID http://orcid.org/0000-0002-1148-1562
Raphael GottardoBiomedical Data Science Center, Centre Hospitalier Universitaire Vaudois, Lausanne, Switzerland.ORCID http://orcid.org/0000-0002-3867-0232
Christoph KuppeDepartment of Nephrology, Rheumatology, and Clinical Immunology, University Hospital RWTH Aachen, Aachen, Germany.ORCID http://orcid.org/0000-0003-4597-9833
Brian LongAllen Institute for Brain Science, Seattle, WA, USA. brianl@alleninstitute.org.ORCID http://orcid.org/0000-0002-7793-5969
Ahmed MahfouzDepartment of Human Genetics, Leiden University Medical Center, Leiden, the Netherlands. a.mahfouz@lumc.nl.ORCID http://orcid.org/0000-0001-8601-2149
Mark D RobinsonDepartment of Molecular Life Sciences and SIB Swiss Institute of Bioinformatics, University of Zurich, Zurich, Switzerland. mark.robinson@mls.uzh.ch.ORCID http://orcid.org/0000-0002-3048-5518
Naveed IshaqueBerlin Institute of Health at Charité - Universitätsmedizin Berlin, Center of Digital, Berlin, Germany. naveed.ishaque@bih-charite.de.ORCID http://orcid.org/0000-0002-8426-901X

Funding

Thalamus in the middle: computations in multi-regional neural circuitsU19NS123714 · NINDS · ALLEN INSTITUTE · PI Adam G Carter, Jayaram Chandrashekar · 2022 to 2026
$19.0M
Bundesministerium für Bildung und Forschung (Federal Ministry of Education and Research) 01KD2443Bundesministerium für Bildung und Forschung (Federal Ministry of Education and Research) 031L0265Deutsche Forschungsgemeinschaft (German Research Foundation) 35081457Nederlandse Organisatie voor Wetenschappelijk Onderzoek (Netherlands Organisation for Scientific Research) 024.004.012NINDS NIH HHS U19 NS123714Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (Swiss National Science Foundation) 320030 215550Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (Swiss National Science Foundation) 320030_215550U.S. Department of Health & Human Services | NIH | National Institute of Neurological Disorders and Stroke (NINDS) U19NS123714
6 · The paper itself

Abstract

Spatial omics technologies have revolutionized the study of tissue architecture and cellular heterogeneity by integrating molecular profiles with spatial localization. In spatially resolved transcriptomics, delineating higher-order anatomical structures is critical for understanding how cellular organization affects function. However, the reliability of current benchmarks of spatially aware clustering (SAC) methods is undermined by their narrow focus on Visium and brain tissue datasets and the incorrect interpretation of manual annotation as ground truth. Here we present SACCELERATOR, a community-driven, extensible framework that standardizes data formatting, method integration and metric evaluation, enabling rapid inclusion of new methods and datasets. Our analysis revealed substantial limitations in the generalizability and reproducibility of SAC methods and shows that anatomical labels commonly used as ground truths are often biased, error prone and unsuitable for benchmarking. Rather than ranking methods, we propose a consensus-guided workflow where descriptive spatial metrics highlight high-entropy regions of method disagreement, enabling targeted feedback for tissue experts. Applied to brain and cancer datasets, this approach uncovered biologically meaningful patterns overlooked by individual SAC methods and manual annotations, highlighting the need for iterative, expert-in-the-loop evaluation.

Indexed as

BenchmarkingBrainBrain NeoplasmsCluster AnalysisClustering AlgorithmsConsensusHumansReproducibility of ResultsSpatial Transcriptomics

Identifiers

PMID42637977
PMCPMC13541621

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.