Evidence map›Paper›PMID 41659017›Full record

ArticleInterspeech2023

Towards Robust Family-Infant Audio Analysis Based on Unsupervised Pretraining of Wav2vec 2.0 on Large-Scale Unlabeled Family Audio.

Jialu Li, Mark Hasegawa-Johnson, Nancy L McElwain

Abstract read
In one paragraph

Article in Interspeech, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. ANALYSIS OF SELF-SUPERVISED SPEECH MODELS ON CHILDREN'S SPEECH AND INFANT VOCALIZATIONS.... IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops · 2024
    Article
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Jialu LiDepartment of Electrical and Computer Engineering, University of Illinois.
Mark Hasegawa-JohnsonDepartment of Electrical and Computer Engineering, University of Illinois.
Nancy L McElwainBeckman Institute for Advanced Science and Technology, University of Illinois.

Funding

Using Remote Sensing Technology to Assess Parent-Infant Interactions as a Mechanism Linking COVID-related Stress and Infant Neurobehavioral FunctioningR34DA050256 · NIDA · UNIVERSITY OF ILLINOIS AT URBANA-CHAMPAIGN · PI MCELWAIN, NANCY L · 2019 to 2021
$745k
Integration of Neural Networks and Attachment in Human InfantsR21MH112578 · NIMH · UNIVERSITY OF ILLINOIS AT URBANA-CHAMPAIGN · PI MCELWAIN, NANCY L, TELZER, EVA HAIMO · 2017 to 2018
$442k
NIDA NIH HHS R34 DA050256NIMH NIH HHS R21 MH112578
6 · The paper itself

Abstract

To perform automatic family audio analysis, past studies have collected recordings using phone, video, or audio-only recording devices like LENA, investigated supervised learning methods, and used or fine-tuned general-purpose embeddings learned from large pretrained models. In this study, we advance the audio component of a new infant wearable multi-modal device called LittleBeats (LB) by learning family audio representation via wav2vec 2.0 (W2V2) pretraining. We show given a limited number of labeled LB home recordings, W2V2 pretrained using 1k-hour of unlabeled home recordings outperforms oracle W2V2 pretrained on 52k-hour unlabeled audio in terms of parent/infant speaker diarization (SD) and vocalization classifications (VC) at home. Extra relevant external unlabeled and labeled data further benefit W2V2 pretraining and fine-tuning. With SpecAug and environmental speech corruptions, we obtain 12% relative gain on SD and moderate boost on VC. Code and model weights are available.

Indexed as

family-infant audio analysisspeaker diarizationunsupervised learningvocalization classificationwav2vec 2.0

Identifiers

PMID41659017
PMCPMC12875392

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.