Evidence map›Paper›PMID 39248654›Full record

ArticleAdvanced science (Weinheim, Baden-Wurttemberg, Germany)2024

Brain-Controlled Augmented Hearing for Spatially Moving Conversations in Multi-Talker Environments.

Vishal Choudhari, Cong Han, Stephan Bickel, Ashesh D Mehta, Catherine Schevon, Guy M McKhann, Nima Mesgarani

Abstract read
In one paragraph

Article in Advanced science (Weinheim, Baden-Wurttemberg, Germany), 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Article
  2. From Selective Listening to Brain-Controlled Hearing: A Perspective on the Future of Auditory Technology.Journal of the Association for Research in Otolaryngology : JARO · 2026
    Review
  3. Article
  4. Review
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Vishal ChoudhariDepartment of Electrical Engineering, Columbia University, New York, NY, 10027, USA.ORCID 0009-0000-5486-5913
Cong HanDepartment of Electrical Engineering, Columbia University, New York, NY, 10027, USA.ORCID 0000-0003-2121-000X
Stephan BickelHofstra Northwell School of Medicine, Uniondale, NY, 11549, USA.ORCID 0000-0001-5265-2447
Ashesh D MehtaHofstra Northwell School of Medicine, Uniondale, NY, 11549, USA.ORCID 0000-0001-7293-1101
Catherine SchevonDepartment of Neurology, Columbia University, New York, NY, 10027, USA.ORCID 0000-0002-4485-7933
Guy M McKhannDepartment of Neurological Surgery, Vagelos College of Physicians and Surgeons, Columbia University, New York, New York, NY, 10027, USA.ORCID 0000-0002-9695-3564
Nima MesgaraniDepartment of Electrical Engineering, Columbia University, New York, NY, 10027, USA.ORCID 0000-0002-2987-759X

Funding

National Institute of Health's National Institute on Deafness and Other Communication DisordersThe Marie-Josee and Henry R. Kravis Foundation
6 · The paper itself

Abstract

Focusing on a specific conversation amidst multiple interfering talkers is challenging, especially for those with hearing loss. Brain-controlled assistive hearing devices aim to alleviate this problem by enhancing the attended speech based on the listener's neural signals using auditory attention decoding (AAD). Departing from conventional AAD studies that relied on oversimplified scenarios with stationary talkers, a realistic AAD task that involves multiple talkers taking turns as they continuously move in space in background noise is presented. Invasive electroencephalography (iEEG) data are collected from three neurosurgical patients as they focused on one of the two moving conversations. An enhanced brain-controlled assistive hearing system that combines AAD and a binaural speaker-independent speech separation model is presented. The separation model unmixes talkers while preserving their spatial location and provides talker trajectories to the neural decoder to improve AAD accuracy. Subjective and objective evaluations show that the proposed system enhances speech intelligibility and facilitates conversation tracking while maintaining spatial cues and voice quality in challenging acoustic environments. This research demonstrates the potential of this approach in real-world scenarios and marks a significant step toward developing assistive hearing technologies that adapt to the intricate dynamics of everyday auditory experiences.

Indexed as

ElectroencephalographySpeech PerceptionAdultAttentionBrain-Computer InterfacesFemaleHearing AidsHearing LossHumansMaleMiddle AgedSpeech Intelligibilityauditory attention decodingbrain‐computer interfacesdeep learninghearing aidsintracranial electroencephalographypsychophysicsspeech separation

Identifiers

PMID39248654
PMCPMC11538705

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.