Evidence map›Paper›PMID 39215679›Full record

ArticleSleep2024

Refining sleep staging accuracy: transfer learning coupled with scorability models.

Wolfgang Ganglberger, Samaneh Nasiri, Haoqi Sun, Soriul Kim, Chol Shin, M Brandon Westover, Robert J Thomas

Abstract read
In one paragraph

Article in Sleep, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Automated analysis of the American Academy of Sleep Medicine Inter-Scorer Reliability gold-standard polysomnogram dataset.Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine · 2025
    Article
  5. Article
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Wolfgang GanglbergerDepartment of Neurology, Beth Israel Deaconess Medical Center, Boston, MA, USA.ORCID 0000-0002-6029-2450
Samaneh NasiriMcCance Center for Brain Health, Massachusetts General Hospital, Boston, MA, USA.
Haoqi SunDepartment of Neurology, Beth Israel Deaconess Medical Center, Boston, MA, USA.
Soriul KimInstitute of Human Genomic Study, College of Medicine, Kore University, Seoul, Republic of Korea.
Chol ShinInstitute of Human Genomic Study, College of Medicine, Kore University, Seoul, Republic of Korea.
M Brandon WestoverDepartment of Neurology, Beth Israel Deaconess Medical Center, Boston, MA, USA.
Robert J ThomasDivision of Sleep Medicine, Harvard Medical School, Boston, MA, USA.ORCID 0000-0002-5575-3953

Funding

Late-onset Unexplained Epilepsy as a Risk Factor for DementiaR01NS130119 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI Alice D Lam · 2023 to 2026
$8.7M
Data-Driven Sleep Biomarkers of Brain Health, Heart Health, and MortalityR01HL161253 · NHLBI · BETH ISRAEL DEACONESS MEDICAL CENTER · PI CLIFFORD, GARI DAVID, MIGNOT, EMMANUEL J · 2022 to 2025
$8.3M
Comparative Safety of Seizure Prophylaxis within the Medicare ProgramR01AG073410 · NIA · MASSACHUSETTS GENERAL HOSPITAL · PI Lidia Maria Veras Rocha de Moura · 2021 to 2026
$4.1M
Low Neurophysiologic Resistance to Anesthetics as a Marker of Preclinical/Prodromal Alzheimer's Disease and Neurovascular Pathology, Delirium risk and InattentionR01AG073598 · NIA · STANFORD UNIVERSITY · PI Miles Berger · 2022 to 2026
$3.8M
Integrative Motor Activity Biomarker for the Risk of Alzheimer's RiskRF1AG064312 · NIA · BRIGHAM AND WOMEN'S HOSPITAL · PI HU, KUN · 2019 to 2019
$3.6M
Multimodal Network Connectivity Architecture (MOCA) of the Brain and its Role in the Recovery of Consciousness in Comatose Cardiac Arrest PatientsR01NS102574 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI GREER, DAVID MATTHEW, WU, ONA · 2018 to 2022
$3.4M
Investigation of Sleep in the Intensive Care Unit (ICU-SLEEP)R01NS102190 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI WESTOVER, MICHAEL BRANDON · 2018 to 2022
$3.2M
Prospective Validation of Neurophysiologic Outcome Prediction in Acute Brain InjuryR01NS126282 · NINDS · BETH ISRAEL DEACONESS MEDICAL CENTER · PI Aaron F Struck, Michael Brandon Westover · 2023 to 2026
$2.9M
Big Data and Deep Learning for the Interictal-Ictal-Injury ContiuumR01NS107291 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI WESTOVER, MICHAEL BRANDON · 2018 to 2022
$2.8M
Establishing a Brain Health Index from the Sleep ElectroencephalogramRF1NS120947 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI CASH, SYDNEY S, THOMAS, ROBERT JOSEPH · 2021 to 2021
$2.4M
Establishing a Brain Health IndexR01NS120947 · NINDS · BETH ISRAEL DEACONESS MEDICAL CENTER · PI CASH, SYDNEY S, THOMAS, ROBERT JOSEPH · 2024 to 2025
$1.6M
NHLBI NIH HHS R01 HL161253NIA NIH HHS R01 AG073410NIA NIH HHS R01 AG073598NIA NIH HHS RF1 AG064312NINDS NIH HHS R01 NS102190NINDS NIH HHS R01 NS102574NINDS NIH HHS R01 NS107291NINDS NIH HHS R01 NS126282NINDS NIH HHS RF1 NS120947
6 · The paper itself

Abstract

STUDY

objectivesThis study aimed to (1) improve sleep staging accuracy through transfer learning (TL), to achieve or exceed human inter-expert agreement and (2) introduce a scorability model to assess the quality and trustworthiness of automated sleep staging.

methodsA deep neural network (base model) was trained on a large multi-site polysomnography (PSG) dataset from the United States. TL was used to calibrate the model to a reduced montage and limited samples from the Korean Genome and Epidemiology Study (KoGES) dataset. Model performance was compared to inter-expert reliability among three human experts. A scorability assessment was developed to predict the agreement between the model and human experts.

resultsInitial sleep staging by the base model showed lower agreement with experts (κ = 0.55) compared to the inter-expert agreement (κ = 0.62). Calibration with 324 randomly sampled training cases matched expert agreement levels. Further targeted sampling improved performance, with models exceeding inter-expert agreement (κ = 0.70). The scorability assessment, combining biosignal quality and model confidence features, predicted model-expert agreement moderately well (R² = 0.42). Recordings with higher scorability scores demonstrated greater model-expert agreement than inter-expert agreement. Even with lower scorability scores, model performance was comparable to inter-expert agreement.

conclusionsFine-tuning a pretrained neural network through targeted TL significantly enhances sleep staging performance for an atypical montage, achieving and surpassing human expert agreement levels. The introduction of a scorability assessment provides a robust measure of reliability, ensuring quality control and enhancing the practical application of the system before deployment. This approach marks an important advancement in automated sleep analysis, demonstrating the potential for AI to exceed human performance in clinical settings.

Indexed as

PolysomnographySleep StagesAdultDeep LearningFemaleHumansMaleMiddle AgedNeural Networks, ComputerReproducibility of Resultsconfidencedeep learninghome sleep recordingsinterrater reliabilityscorabilitysleep stagingtransfer learning

Identifiers

PMID39215679
PMCPMC12104150

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.