Evidence map›Paper›PMID 34550974›Full record

ArticlePLoS computational biology2021

Partitioning variability in animal behavioral videos using semi-supervised variational autoencoders.

Matthew R Whiteway, Dan Biderman, Yoni Friedman, Mario Dipoppa, E Kelly Buchanan, Anqi Wu, John Zhou, Niccolò Bonacchi, Nathaniel J Miska, Jean-Paul Noel and 8 more

Abstract read
In one paragraph

Article in PLoS computational biology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Behavioral Coding of Captive African Elephants (Animals : an open access journal from MDPI · 2024
    Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors.

Matthew R WhitewayCenter for Theoretical Neuroscience, Columbia University, New York, New York, United States of America.ORCID 0000-0003-3756-1349
Dan BidermanCenter for Theoretical Neuroscience, Columbia University, New York, New York, United States of America.ORCID 0000-0003-2054-8439
Yoni FriedmanCenter for Theoretical Neuroscience, Columbia University, New York, New York, United States of America.ORCID 0000-0003-4966-6869
Mario DipoppaCenter for Theoretical Neuroscience, Columbia University, New York, New York, United States of America.
E Kelly BuchananCenter for Theoretical Neuroscience, Columbia University, New York, New York, United States of America.ORCID 0000-0003-1448-5662
Anqi WuCenter for Theoretical Neuroscience, Columbia University, New York, New York, United States of America.
John ZhouDepartment of Computer Science, Columbia University, New York, New York, United States of America.ORCID 0000-0003-3565-5376
Niccolò BonacchiChampalimaud Centre for the Unknown, Lisbon, Portugal.ORCID 0000-0001-5228-6918
Nathaniel J MiskaSainsbury-Wellcome Centre for Neural Circuits and Behavior, University College London, London, United Kingdom.ORCID 0000-0001-8587-4919
Jean-Paul NoelCenter for Neural Science, New York University, New York, New York, United States of America.ORCID 0000-0001-5297-3363
Erica RodriguezMortimer B. Zuckerman Mind Brain Behavior Institute, Columbia University, New York, New York, United States of America.ORCID 0000-0001-5966-714X
Michael SchartnerChampalimaud Centre for the Unknown, Lisbon, Portugal.ORCID 0000-0002-4854-3034
Karolina SochaInstitute of Ophthalmology, University College London, London, United Kingdom.ORCID 0000-0002-1677-1489
Anne E UraiCognitive Psychology Unit, Leiden University, Leiden, The Netherlands.ORCID 0000-0001-5270-6513
C Daniel SalzmanMortimer B. Zuckerman Mind Brain Behavior Institute, Columbia University, New York, New York, United States of America.
International Brain Laboratory
John P CunninghamCenter for Theoretical Neuroscience, Columbia University, New York, New York, United States of America.
Liam PaninskiCenter for Theoretical Neuroscience, Columbia University, New York, New York, United States of America.

Funding

Validating Theoretical Models with Neurophysiology and OptogeneticsU19NS107613 · NINDS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI JI, NA · 2018 to 2022
$16.7M
Research Training in Mood and Anxiety Disorders: From Animal Models to PatientsT32MH015144 · NIMH · COLUMBIA UNIV NEW YORK MORNINGSIDE · PI Eduardo David Leonardo · 1985 to 2026
$11.1M
ADVANCED GRADUATE TRAINING PROGRAM IN THEORETICAL NEUROSCIENCET32NS064929 · NINDS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI Laurence F. Abbott, Roudabeh Behnia · 2009 to 2026
$2.9M
High-throughput Physiological Micro-connectivity Mapping in VivoRF1MH120680 · NIMH · UNIVERSITY OF CALIFORNIA BERKELEY · PI ADESNIK, HILLEL · 2019 to 2021
$2.2M
kHz-rate in vivo imaging of neural activity througout the living brainUF1NS107696 · NINDS · UNIVERSITY OF CALIFORNIA BERKELEY · PI JI, NA, TSIA, KEVIN KIN MAN · 2018 to 2018
$2.1M
The interactive roles of the amygdala and orbitofrontal cortex during reversal learningR21MH116348 · NIMH · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI SALZMAN, C. DANIEL · 2019 to 2020
$446k
NIMH NIH HHS R21 MH116348NIMH NIH HHS RF1 MH120680NIMH NIH HHS T32 MH015144NINDS NIH HHS T32 NS064929NINDS NIH HHS U19 NS107613NINDS NIH HHS UF1 NS107696Wellcome Trust 209558Wellcome Trust 209558/Z/17/ZWellcome Trust 216324
6 · The paper itself

Abstract

Recent neuroscience studies demonstrate that a deeper understanding of brain function requires a deeper understanding of behavior. Detailed behavioral measurements are now often collected using video cameras, resulting in an increased need for computer vision algorithms that extract useful information from video data. Here we introduce a new video analysis tool that combines the output of supervised pose estimation algorithms (e.g. DeepLabCut) with unsupervised dimensionality reduction methods to produce interpretable, low-dimensional representations of behavioral videos that extract more information than pose estimates alone. We demonstrate this tool by extracting interpretable behavioral features from videos of three different head-fixed mouse preparations, as well as a freely moving mouse in an open field arena, and show how these interpretable features can facilitate downstream behavioral and neural analyses. We also show how the behavioral features produced by our model improve the precision and interpretation of these downstream analyses compared to using the outputs of either fully supervised or fully unsupervised methods alone.

Indexed as

AlgorithmsBehavior, AnimalVideo RecordingAnimalsArtificial IntelligenceComputational BiologyComputer SimulationMarkov ChainsMiceModels, StatisticalNeural Networks, ComputerSupervised Machine LearningUnsupervised Machine Learning

Identifiers

PMID34550974
PMCPMC8489729

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.