Evidence map›Paper›PMID 34473051›Full record

ArticleeLife2021

DeepEthogram, a machine learning pipeline for supervised behavior classification from raw pixels.

James P Bohnslav, Nivanthika K Wimalasena, Kelsey J Clausing, Yu Y Dai, David A Yarmolinsky, Tomás Cruz, Adam D Kashlan, M Eugenia Chiappe, Lauren L Orefice, Clifford J Woolf and 1 more

Abstract readVideo-Audio Media
In one paragraph

Article in eLife, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 108 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
108citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

108 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. A paradigm for skilled forelimb reaching by head-restrained mice.bioRxiv : the preprint server for biology · 2026
    Article
  11. Autobehaver: An AI-Based Pipeline for Animal Behavior Analysis.bioRxiv : the preprint server for biology · 2026
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

48 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

James P BohnslavDepartment of Neurobiology, Harvard Medical School, Boston, United States.ORCID 0000-0002-9359-8907
Nivanthika K WimalasenaDepartment of Neurobiology, Harvard Medical School, Boston, United States.
Kelsey J ClausingDepartment of Molecular Biology, Massachusetts General Hospital, Boston, United States.
Yu Y DaiDepartment of Molecular Biology, Massachusetts General Hospital, Boston, United States.
David A YarmolinskyDepartment of Neurobiology, Harvard Medical School, Boston, United States.
Tomás CruzChampalimaud Neuroscience Programme, Champalimaud Center for the Unknown, Lisbon, Portugal.
Adam D KashlanDepartment of Neurobiology, Harvard Medical School, Boston, United States.
M Eugenia ChiappeChampalimaud Neuroscience Programme, Champalimaud Center for the Unknown, Lisbon, Portugal.ORCID 0000-0003-1761-0457
Lauren L OreficeDepartment of Molecular Biology, Massachusetts General Hospital, Boston, United States.
Clifford J WoolfDepartment of Neurobiology, Harvard Medical School, Boston, United States.
Christopher D HarveyDepartment of Neurobiology, Harvard Medical School, Boston, United States.ORCID 0000-0001-9850-2268

Funding

Unravelling Mechanisms and Novel Therapeutic Targets for Peripheral Neuropathy and Neuropathic Pain (Diversity Supplement)R35NS105076 · NINDS · BOSTON CHILDREN'S HOSPITAL · PI WOOLF, CLIFFORD J · 2018 to 2025
$9.5M
Genetic Analysis and Manipulation Core (GAEC)P50HD105351 · NICHD · BOSTON CHILDREN'S HOSPITAL · PI SCOTT Loren POMEROY, MUSTAFA SAHIN · 2021 to 2026
$9.4M
Toward mechanistic cognitive neuroscience: cell types, connectivity, and patterned perturbationsDP1MH125776 · NIMH · HARVARD MEDICAL SCHOOL · PI HARVEY, CHRISTOPHER D · 2020 to 2024
$5.9M
Studying perceptual decision-making across cortex by combining population imaging, connectomics, and computational modelingR01NS108410 · NINDS · HARVARD MEDICAL SCHOOL · PI HARVEY, CHRISTOPHER D, LEE, WEI-CHUNG ALLEN · 2018 to 2022
$5.7M
Spinal Cord Nociceptive Circuits that Deliver Outputs to the Brain to Initiate PainR01AT011447 · NCCIH · HARVARD MEDICAL SCHOOL · PI DRUGOWITSCH, JAN, GINTY, DAVID D · 2020 to 2024
$5.3M
Parietal Cortex Networks for Sensorimotor Processing During NavigationR01NS089521 · NINDS · HARVARD MEDICAL SCHOOL · PI HARVEY, CHRISTOPHER D · 2015 to 2024
$4.5M
New approaches to understand neuronal microcircuit dynamics for working memoryR01MH107620 · NIMH · HARVARD MEDICAL SCHOOL · PI HARVEY, CHRISTOPHER D · 2015 to 2019
$2.8M
Understanding Somatosensory Deficits in Autism Spectrum DisordersR00NS101057 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI OREFICE, LAUREN LYNN · 2019 to 2021
$824k
Defining the generators of spontaneous trigeminal painK99DE028360 · NIDCR · BOSTON CHILDREN'S HOSPITAL · PI YARMOLINSKY, DAVID AVRAHM · 2018 to 2020
$305k
Multiple timescales of motor planning and execution in mouse cortexF31NS108450 · NINDS · HARVARD MEDICAL SCHOOL · PI ROBINSON-BOHNSLAV, JAMES PHILIP · 2019 to 2020
$71k
NCCIH NIH HHS R01 AT011447NICHD NIH HHS P50 HD105351NIDCR NIH HHS K99 DE028360NIMH NIH HHS DP1 MH125776NIMH NIH HHS R01 MH107620NINDS NIH HHS F31 NS108450NINDS NIH HHS R00 NS101057NINDS NIH HHS R01 NS089521NINDS NIH HHS R01 NS108410NINDS NIH HHS R35 NS105076
6 · The paper itself

Abstract

Videos of animal behavior are used to quantify researcher-defined behaviors of interest to study neural function, gene mutations, and pharmacological therapies. Behaviors of interest are often scored manually, which is time-consuming, limited to few behaviors, and variable across researchers. We created DeepEthogram: software that uses supervised machine learning to convert raw video pixels into an ethogram, the behaviors of interest present in each video frame. DeepEthogram is designed to be general-purpose and applicable across species, behaviors, and video-recording hardware. It uses convolutional neural networks to compute motion, extract features from motion and images, and classify features into behaviors. Behaviors are classified with above 90% accuracy on single frames in videos of mice and flies, matching expert-level human performance. DeepEthogram accurately predicts rare behaviors, requires little training data, and generalizes across subjects. A graphical interface allows beginning-to-end analysis without end-user programming. DeepEthogram's rapid, automatic, and reproducible labeling of researcher-defined behaviors of interest may accelerate and enhance supervised behavior analysis. Code is available at: https://github.com/jbohnslav/deepethogram.

Indexed as

GroomingImage Processing, Computer-AssistedMotor ActivityNeural Networks, ComputerSocial BehaviorSupervised Machine LearningVideo RecordingAnimalsDrosophila melanogasterFemaleHumansKineticsMaleMiceMice, Inbred C57BLPattern Recognition, Automatedbehavior analysiscomputer visiondeep learningD. melanogastermouseneuroscience

Identifiers

PMID34473051
PMCPMC8455138

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.