Evidence map›Paper›PMID 35379947›Full record

ArticleNature methods2022

SLEAP: A deep learning system for multi-animal pose tracking.

Talmo D Pereira, Nathaniel Tabris, Arie Matsliah, David M Turner, Junyu Li, Shruthi Ravindranath, Eleni S Papadoyannis, Edna Normand, David S Deutsch, Z Yan Wang and 11 more

Erratum issuedAbstract read
In one paragraph

Article in Nature methods, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 404 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
404citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

404 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. ABEL: an active-learning behavior estimation and labeling platform.bioRxiv : the preprint server for biology · 2026
    Article
  14. Article
  15. Article
  16. Cross-species identification of conserved and divergent locomotor kinematic strategies using AutoGaitA.Proceedings of the National Academy of Sciences of the United States of America · 2026
    Article
  17. Article
  18. Article
  19. Article
  20. Review

344 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

21 authors.

Talmo D PereiraPrinceton Neuroscience Institute, Princeton University, Princeton, NJ, USA.ORCID http://orcid.org/0000-0001-9075-8365
Nathaniel TabrisPrinceton Neuroscience Institute, Princeton University, Princeton, NJ, USA.ORCID http://orcid.org/0000-0003-4639-3121
Arie MatsliahPrinceton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
David M TurnerPrinceton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Junyu LiPrinceton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Shruthi RavindranathPrinceton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Eleni S PapadoyannisPrinceton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Edna NormandPrinceton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
David S DeutschPrinceton Neuroscience Institute, Princeton University, Princeton, NJ, USA.ORCID http://orcid.org/0000-0002-8587-2435
Z Yan WangDepartment of Ecology and Evolutionary Biology, Princeton University, Princeton, NJ, USA.
Grace C McKenzie-SmithDepartment of Physics, Princeton University, Princeton, NJ, USA.
Catalin C MitelutCenter for Neural Science, New York University, New York, NY, USA.
Marielisa Diez CastroCenter for Neural Science, New York University, New York, NY, USA.
John D'UvaPrinceton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Mikhail KislinPrinceton Neuroscience Institute, Princeton University, Princeton, NJ, USA.ORCID http://orcid.org/0000-0002-5447-8881
Dan H SanesCenter for Neural Science, New York University, New York, NY, USA.
Sarah D KocherDepartment of Ecology and Evolutionary Biology, Princeton University, Princeton, NJ, USA.
Samuel S-H WangPrinceton Neuroscience Institute, Princeton University, Princeton, NJ, USA.ORCID http://orcid.org/0000-0002-0490-9786
Annegret L FalknerPrinceton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Joshua W Shaevitz *Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA.ORCID http://orcid.org/0000-0001-8809-4723
Mala Murthy *Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA. mmurthy@princeton.edu.ORCID http://orcid.org/0000-0003-3063-3389

Funding

Viral Vector Core (VVC)P30CA014195 · NCI · SALK INSTITUTE FOR BIOLOGICAL STUDIES · PI Reuben Shaw · 1985 to 2026
$82.8M
Imaging adaptive cerebellar processing at cellular resolution in awake miceR01NS045193 · NINDS · PRINCETON UNIVERSITY · PI WANG, SAMUEL SHENG-HUNG · 2003 to 2024
$7.5M
Rescue of cortical inhibitory synapses following developmental hearing lossR01DC011284 · NIDCD · NEW YORK UNIVERSITY · PI SANES, DAN HARVEY · 2011 to 2022
$5.4M
Uncovering the Neural Mechanisms that Flexibly Link Sensory Processing to BehaviorR35NS111580 · NINDS · PRINCETON UNIVERSITY · PI Mala Murthy · 2019 to 2026
$5.0M
Cerebellar determinants of flexible and social behavior on rapid time scales in autism model mice.R01MH115750 · NIMH · PRINCETON UNIVERSITY · PI PILLOW, JONATHAN WILLIAM, SHAEVITZ, JOSHUA W · 2017 to 2021
$4.7M
Generating pro-resilient states through individualized circuit read-write therapeuticsDP2MH126375 · NIMH · PRINCETON UNIVERSITY · PI FALKNER, ANNEGRET LEA · 2020 to 2020
$2.4M
What makes - and breaks - a social brain?DP2GM137424 · NIGMS · PRINCETON UNIVERSITY · PI KOCHER, SARAH D · 2019 to 2019
$2.4M
Dissecting Sensorimotor Pathways Underlying Social Interactions: Models, Circuits, and BehaviorR01NS104899 · NINDS · PRINCETON UNIVERSITY · PI BIALEK, WILLIAM, MURTHY, MALA · 2018 to 2022
$2.4M
Inhibitory Control of Hypothalamic Circuit for AggressionR00MH109674 · NIMH · PRINCETON UNIVERSITY · PI FALKNER, ANNEGRET LEA · 2018 to 2020
$743k
Howard Hughes Medical InstituteNCI NIH HHS P30 CA014195NIDCD NIH HHS R01 DC011284NIGMS NIH HHS DP2 GM137424NIMH NIH HHS DP2 MH126375NIMH NIH HHS R00 MH109674NIMH NIH HHS R01 MH115750NINDS NIH HHS R01 NS045193NINDS NIH HHS R01 NS104899NINDS NIH HHS R35 NS111580
6 · The paper itself

Abstract

The desire to understand how the brain generates and patterns behavior has driven rapid methodological innovation in tools to quantify natural animal behavior. While advances in deep learning and computer vision have enabled markerless pose estimation in individual animals, extending these to multiple animals presents unique challenges for studies of social behaviors or animals in their natural environments. Here we present Social LEAP Estimates Animal Poses (SLEAP), a machine learning system for multi-animal pose tracking. This system enables versatile workflows for data labeling, model training and inference on previously unseen data. SLEAP features an accessible graphical user interface, a standardized data model, a reproducible configuration system, over 30 model architectures, two approaches to part grouping and two approaches to identity tracking. We applied SLEAP to seven datasets across flies, bees, mice and gerbils to systematically evaluate each approach and architecture, and we compare it with other existing approaches. SLEAP achieves greater accuracy and speeds of more than 800 frames per second, with latencies of less than 3.5 ms at full 1,024 × 1,024 image resolution. This makes SLEAP usable for real-time applications, which we demonstrate by controlling the behavior of one animal on the basis of the tracking and detection of social interactions with another animal.

Indexed as

Deep LearningAlgorithmsAnimalsBehavior, AnimalHeadMachine LearningMiceSocial Behavior

Identifiers

PMID35379947
PMCPMC9007740

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.