Evidence map›Paper›PMID 38355559›Full record

ArticleBMC medical informatics and decision making2024

InsightSleepNet: the interpretable and uncertainty-aware deep learning network for sleep staging using continuous Photoplethysmography.

Borum Nam, Beomjun Bark, Jeyeon Lee, In Young Kim

Open access · goldAbstract read
In one paragraph

Article in BMC medical informatics and decision making, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
1.3field-weighted citation impact, top 23% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 7 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 2 institutions in 1 country.

Borum NamDepartment of Electronic Engineering, Hanyang University, Seoul, Republic of Korea.
Beomjun BarkDepartment of Biomedical Engineering, Hanyang University, 222, Wangsimni-ro, Seoul, 04763, Republic of Korea.
Jeyeon LeeDepartment of Biomedical Engineering, Hanyang University, 222, Wangsimni-ro, Seoul, 04763, Republic of Korea.
In Young KimDepartment of Biomedical Engineering, Hanyang University, 222, Wangsimni-ro, Seoul, 04763, Republic of Korea. iykim@hanyang.ac.kr.
Hanyang University · KRAnyang University · KR

Funding

Institute for Clinical and Translational ResearchUL1TR001079 · NCATS · JOHNS HOPKINS UNIVERSITY · PI FORD, DANIEL ERNEST · 2013 to 2017
$60.1M
Wake Forest Clinical and Translational Science AwardUL1TR001420 · NCATS · WAKE FOREST UNIVERSITY HEALTH SCIENCES · PI ARD, JAMY D, FOLEY, KRISTIE L · 2015 to 2023
$32.3M
Clinical and Translational Science AwardUL1TR000040 · NCATS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI GINSBERG, HENRY N · 2012 to 2015
$26.2M
Zosuquidar trihydrochloride for acute myeloid leukemia &refractory anemiaM01RR000080 · NCRR · UNIVERSITY HOSPITALS OF CLEVELAND · PI DEARBORN, DORR GELLATLY · 1985 to 2007
$22.2M
ASSOCIATION OF SLEEP DISORDERS WITH CARDIOVASCULAR HEALTH ACROSS ETHNIC GROUPSR01HL098433 · NHLBI · BRIGHAM AND WOMEN'S HOSPITAL · PI REDLINE, SUSAN S. · 2010 to 2015
$8.2M
National Sleep Research Resource (NSRR)R24HL114473 · NHLBI · BRIGHAM AND WOMEN'S HOSPITAL · PI REDLINE, SUSAN S., ZHANG, GUO-QIANG · 2013 to 2017
$7.5M
BIOMETRIC-GENETIC ANALYSIS OF CARDIOVASCULAR DISEASET32HL007567 · NHLBI · LOUISIANA STATE UNIV HSC NEW ORLEANS · PI ZHU, XIAOFENG · 1985 to 2021
$6.0M
FAMILIAL AGGREGATION OF OBSTRUCTIVE SLEEP APNEAR01HL046380 · NHLBI · UNIVERSITY HOSPITALS OF CLEVELAND · PI REDLINE, SUSAN S · 1990 to 2005
$3.5M
Cigarette Smoke and Susceptibility to Influenza InfectionR01HL095163 · NHLBI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI JASPERS, ILONA, NOAH, TERRY L · 2009 to 2013
$2.0M
Adjunctive Use of Apyrase to Fibrinolytic TherapyR44HL095169 · NHLBI · APT THERAPEUTICS, INC. · PI CHEN, RIDONG · 2012 to 2013
$1.3M
SUBCLINICAL CARDIOVASCULAR DISEASE STUDYN01HC095166 · HC · UNIVERSITY OF VERMONT &ST AGRIC COLLEGE · PI TRACY, RUSSELL P · 1999 to 2001
$758k
SUBCLINICAL CARDIOVASCULAR DISEASE STUDY-FIELD CENTERN01HC095162 · HC · JOHNS HOPKINS UNIVERSITY · PI SZKLO, MOYSES A · 1999 to 2000
$694k
NCATS NIH HHS UL1 TR000040NCATS NIH HHS UL1 TR001079NCATS NIH HHS UL1 TR001420NCRR NIH HHS M01 RR000080NHLBI NIH HHS HHSN268201500003CNHLBI NIH HHS HHSN268201500003INHLBI NIH HHS N01 HC095159NHLBI NIH HHS N01 HC095160NHLBI NIH HHS N01 HC095161NHLBI NIH HHS N01 HC095162NHLBI NIH HHS N01 HC095163NHLBI NIH HHS N01 HC095164NHLBI NIH HHS N01 HC095165NHLBI NIH HHS N01 HC095166NHLBI NIH HHS N01 HC095167NHLBI NIH HHS N01 HC095168NHLBI NIH HHS N01 HC095169NHLBI NIH HHS R01 HL046380NHLBI NIH HHS R01 HL098433NHLBI NIH HHS R24 HL114473NHLBI NIH HHS T32 HL007567
6 · The paper itself

Abstract

backgroundThis study was conducted to address the existing drawbacks of inconvenience and high costs associated with sleep monitoring. In this research, we performed sleep staging using continuous photoplethysmography (PPG) signals for sleep monitoring with wearable devices. Furthermore, our aim was to develop a more efficient sleep monitoring method by considering both the interpretability and uncertainty of the model's prediction results, with the goal of providing support to medical professionals in their decision-making process.

methodThe developed 4-class sleep staging model based on continuous PPG data incorporates several key components: a local attention module, an InceptionTime module, a time-distributed dense layer, a temporal convolutional network (TCN), and a 1D convolutional network (CNN). This model prioritizes both interpretability and uncertainty estimation in its prediction results. The local attention module is introduced to provide insights into the impact of each epoch within the continuous PPG data. It achieves this by leveraging the TCN structure. To quantify the uncertainty of prediction results and facilitate selective predictions, an energy score estimation is employed. By enhancing both the performance and interpretability of the model and taking into consideration the reliability of its predictions, we developed the InsightSleepNet for accurate sleep staging.

resultInsightSleepNet was evaluated using three distinct datasets: MESA, CFS, and CAP. Initially, we assessed the model's classification performance both before and after applying an energy score threshold. We observed a significant improvement in the model's performance with the implementation of the energy score threshold. On the MESA dataset, prior to applying the energy score threshold, the accuracy was 84.2% with a Cohen's kappa of 0.742 and weighted F1 score of 0.842. After implementing the energy score threshold, the accuracy increased to a range of 84.8-86.1%, Cohen's kappa values ranged from 0.75 to 0.78 and weighted F1 scores ranged from 0.848 to 0.861. In the case of the CFS dataset, we also noted enhanced performance. Before the application of the energy score threshold, the accuracy stood at 80.6% with a Cohen's kappa of 0.72 and weighted F1 score of 0.808. After thresholding, the accuracy improved to a range of 81.9-85.6%, Cohen's kappa values ranged from 0.74 to 0.79 and weighted F1 scores ranged from 0.821 to 0.857. Similarly, on the CAP dataset, the initial accuracy was 80.6%, accompanied by a Cohen's kappa of 0.73 and weighted F1 score was 0.805. Following the application of the threshold, the accuracy increased to a range of 81.4-84.3%, Cohen's kappa values ranged from 0.74 to 0.79 and weighted F1 scores ranged from 0.813 to 0.842. Additionally, by interpreting the model's predictions, we obtained results indicating a correlation between the peak of the PPG signal and sleep stage classification.

conclusionInsightSleepNet is a 4-class sleep staging model that utilizes continuous PPG data, serves the purpose of continuous sleep monitoring with wearable devices. Beyond its primary function, it might facilitate in-depth sleep analysis by medical professionals and empower them with interpretability for intervention-based predictions. This capability can also support well-informed clinical decision-making, providing valuable insights and serving as a reliable second opinion in medical settings.

Indexed as

Deep LearningHumansPhotoplethysmographyReproducibility of ResultsSleepUncertaintyArtificial intelligenceInterpretabilityPhotoplethysmographySleep stagingUncertainty

Identifiers

PMID38355559
PMCPMC10865603
OpenAlexW4391814662

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.