Evidence map›Paper›PMID 42601459›Full record

ArticleNature methods2026

Lessons learned from a Kaggle challenge for particle picking in cryo-electron tomography.

Ariana Peck, Joshua Hutchings, Jonathan Schwartz, Yue Yu, Utz H Ermel, Saugat Kandel, Dari Kimanius, Zhuowen Zhao, Shawn Zheng, Brendan Artley and 18 more

Abstract read
In one paragraph

Article in Nature methods, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

28 authors.

Ariana Peck *Biohub, Redwood City, CA, USA.ORCID http://orcid.org/0000-0002-5940-3897
Joshua Hutchings *Biohub, Redwood City, CA, USA.ORCID http://orcid.org/0000-0001-6841-8583
Jonathan SchwartzBiohub, Redwood City, CA, USA.ORCID http://orcid.org/0000-0002-8063-6951
Yue YuBiohub, Redwood City, CA, USA.ORCID http://orcid.org/0000-0002-3248-9678
Utz H ErmelBiohub, Redwood City, CA, USA.ORCID http://orcid.org/0000-0003-4685-037X
Saugat KandelBiohub, Redwood City, CA, USA.
Dari KimaniusBiohub, Redwood City, CA, USA.ORCID http://orcid.org/0000-0002-2662-6373
Zhuowen ZhaoBiohub, Redwood City, CA, USA.ORCID http://orcid.org/0000-0002-2355-2284
Shawn ZhengBiohub, Redwood City, CA, USA.ORCID http://orcid.org/0000-0001-9517-3075
Brendan ArtleyUnaffiliated, Vancouver, British Columbia, Canada.
David ListUnaffiliated, Denver, CO, USA.ORCID http://orcid.org/0009-0007-0818-3402
Sergio A SilvaDepartment of Informatics, State University of Maringá, Maringá, Brazil.ORCID http://orcid.org/0000-0001-5270-370X
Walter ReadeKaggle/Google, Mountain View, CA, USA.
Jeremy AsuncionBiohub, Redwood City, CA, USA.
Kira EvansBiohub, Redwood City, CA, USA.
Jessica GadlingBiohub, Redwood City, CA, USA.
Kandarp KhandwalaBiohub, Redwood City, CA, USA.ORCID http://orcid.org/0009-0003-2343-2105
Suzette McCannyBiohub, Redwood City, CA, USA.
Dannielle G McCarthyBiohub, Redwood City, CA, USA.
Jun Xi NiBiohub, Redwood City, CA, USA.ORCID http://orcid.org/0009-0002-6721-4559
Janeece PourroyBiohub, Redwood City, CA, USA.ORCID http://orcid.org/0009-0000-0786-3173
Manasa VenkatakrishnanBiohub, Redwood City, CA, USA.
Zun Shi WangBiohub, Redwood City, CA, USA.
David A AgardBiohub, Redwood City, CA, USA.
Clinton S PotterBiohub, Redwood City, CA, USA.
Bridget CarragherBiohub, Redwood City, CA, USA.ORCID http://orcid.org/0000-0002-0624-5020
Kyle I S HarringtonBiohub, Redwood City, CA, USA.ORCID http://orcid.org/0000-0002-7237-1973
Mohammadreza ParaanBiohub, Redwood City, CA, USA. reza.paraan@biohub.org.ORCID http://orcid.org/0000-0002-8402-0134

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

The difficulty of particle picking in cryo-electron tomography remains a barrier to routine in situ structure determination. Machine learning is well suited to overcome this bottleneck with efficient algorithms that generalize across molecular species. To spur new algorithm development, we held a 3-month Kaggle challenge that tasked contestants with annotating five molecular species across hundreds of experimental tomograms. Here we analyze the results of this competition, which successfully engaged >1,000 participants and delivered particle pickers that outperformed existing state of the art. Systematic comparisons of the contestants' submissions revealed the tolerance of subtomogram averaging to moderate but not severe over-picking and underscored the need for more robust measures of annotation quality. The winning models also highlighted the importance of data augmentation to overcome limited training data. All competition tomograms along with the ground truth and winning teams' annotations have been released on the CryoET Data Portal as a resource to benchmark current and future particle picking algorithms.

Indexed as

Cryoelectron MicroscopyElectron Microscope TomographyImage Processing, Computer-AssistedMachine LearningAlgorithms

Identifiers

PMID42601459
PMCPMC13541615

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.