Evidence map›Paper›PMID 30445569›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2018

Expert-level sleep scoring with deep neural networks.

Siddharth Biswal, Haoqi Sun, Balaji Goparaju, M Brandon Westover, Jimeng Sun, Matt T Bianchi

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 83 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
83citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

83 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. A case study on generative artificial intelligence to extract the fundamental sleep parameters from polysomnography notes.Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine · 2025
    Article
  12. Article
  13. Article
  14. Review
  15. Article
  16. Review
  17. Optimizing wearable single-channel electroencephalography sleep staging in a heterogeneous sleep-disordered population using transfer learning.Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine · 2025
    Article
  18. Article
  19. Weakly Supervised Deep Learning for Monitoring Sleep Apnea Severity Using Coarse-grained Labels.IEEE transactions on automation science and engineering : a publication of the IEEE Robotics and Automation Society · 2025
    Article
  20. Article

23 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Siddharth BiswalSchool of Computational Science and Engineering, Georgia Institute of Technology, Atlanta, GA, USA.
Haoqi SunNeurology Department, Massachusetts General Hospital, Wang 720, Boston, MA, USA.
Balaji GoparajuNeurology Department, Massachusetts General Hospital, Wang 720, Boston, MA, USA.
M Brandon WestoverNeurology Department, Massachusetts General Hospital, Wang 720, Boston, MA, USA.
Jimeng SunSchool of Computational Science and Engineering, Georgia Institute of Technology, Atlanta, GA, USA.
Matt T BianchiNeurology Department, Massachusetts General Hospital, Wang 720, Boston, MA, USA.

Funding

Reducing Disparities among Kidney Transplant RecipientsR01MD011682 · NIMHD · EMORY UNIVERSITY · PI ADAMS, ANDREW B, PATZER, RACHEL E · 2017 to 2021
$2.4M
Quantitative Monitoring and Control of Sedation and Pain in the ICU EnvironmentK23NS090900 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI WESTOVER, MICHAEL BRANDON · 2014 to 2018
$988k
Interpretable Deep Learning Model for Longitudinal Electronic Health Records and Applications to Heart Failure PredictionR56HL138415 · NHLBI · GEORGIA INSTITUTE OF TECHNOLOGY · PI ZHANG, CHAO · 2017 to 2017
$756k
NHLBI NIH HHS R56 HL138415NIMHD NIH HHS R01 MD011682NINDS NIH HHS K23 NS090900
6 · The paper itself

Abstract

Objectives: Scoring laboratory polysomnography (PSG) data remains a manual task of visually annotating 3 primary categories: sleep stages, sleep disordered breathing, and limb movements. Attempts to automate this process have been hampered by the complexity of PSG signals and physiological heterogeneity between patients. Deep neural networks, which have recently achieved expert-level performance for other complex medical tasks, are ideally suited to PSG scoring, given sufficient training data. Methods: We used a combination of deep recurrent and convolutional neural networks (RCNN) for supervised learning of clinical labels designating sleep stages, sleep apnea events, and limb movements. The data for testing and training were derived from 10 000 clinical PSGs and 5804 research PSGs. Results: When trained on the clinical dataset, the RCNN reproduces PSG diagnostic scoring for sleep staging, sleep apnea, and limb movements with accuracies of 87.6%, 88.2% and 84.7% on held-out test data, a level of performance comparable to human experts. The RCNN model performs equally well when tested on the independent research PSG database. Only small reductions in accuracy were noted when training on limited channels to mimic at-home monitoring devices: frontal leads only for sleep staging, and thoracic belt signals only for the apnea-hypopnea index. Conclusions: By creating accurate deep learning models for sleep scoring, our work opens the path toward broader and more timely access to sleep diagnostics. Accurate scoring automation can improve the utility and efficiency of in-lab and at-home approaches to sleep diagnostics, potentially extending the reach of sleep expertise beyond specialty clinics.

Indexed as

ElectroencephalographyNeural Networks, ComputerClassificationDatasets as TopicHumansMachine LearningModels, BiologicalPolysomnographySleepSleep Apnea SyndromesSleep Stages

Identifiers

PMID30445569
PMCPMC6289549

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.