Evidence map›Paper›PMID 29029305›Full record

ArticleSleep2017

Large-Scale Automated Sleep Staging.

Haoqi Sun, Jian Jia, Balaji Goparaju, Guang-Bin Huang, Olga Sourina, Matt Travis Bianchi, M Brandon Westover

Abstract read
In one paragraph

Article in Sleep, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 51 papers.

0numbers the graph read from it
0cells of the map it votes in
51citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

51 citing papers in PubMed.

  1. Analytical amplitude/phase markers for neurological sleep apnea events.Neurobiology of sleep and circadian rhythms · 2026
    Article
  2. YASA automated sleep staging performance across seven nights of normal sleep and sleep restriction.Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine · 2026
    Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. [Research progress in electroencephalogram-based brain age prediction].Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi · 2025
    Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Functional extreme learning machine.Frontiers in computational neuroscience · 2023
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Haoqi SunEnergy Research Institute @ NTU, Interdisciplinary Graduate School, Nanyang Technological University, 639798, Singapore.
Jian JiaSchool of Mathematics, Northwest University, Xi'an, Shaanxi, 710127China.
Balaji GoparajuMassachusetts General Hospital, Neurology Department,Boston, MA.
Guang-Bin HuangSchool of Electrical and Electronic Engineering, Nanyang Technological University, 639798,Singapore.
Olga SourinaFraunhofer IDM @ NTU, Nanyang Technological University, 639798, Singapore.
Matt Travis BianchiMassachusetts General Hospital, Neurology Department,Boston, MA.
M Brandon WestoverMassachusetts General Hospital, Neurology Department,Boston, MA.

Funding

Quantitative Monitoring and Control of Sedation and Pain in the ICU EnvironmentK23NS090900 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI WESTOVER, MICHAEL BRANDON · 2014 to 2018
$988k
NINDS NIH HHS K23 NS090900
6 · The paper itself

Abstract

Study Objectives: Automated sleep staging has been previously limited by a combination of clinical and physiological heterogeneity. Both factors are in principle addressable with large data sets that enable robust calibration. However, the impact of sample size remains uncertain. The objectives are to investigate the extent to which machine learning methods can approximate the performance of human scorers when supplied with sufficient training cases and to investigate how staging performance depends on the number of training patients, contextual information, model complexity, and imbalance between sleep stage proportions. Methods: A total of 102 features were extracted from six electroencephalography (EEG) channels in routine polysomnography. Two thousand nights were partitioned into equal (n = 1000) training and testing sets for validation. We used epoch-by-epoch Cohen's kappa statistics to measure the agreement between classifier output and human scorer according to American Academy of Sleep Medicine scoring criteria. Results: Epoch-by-epoch Cohen's kappa improved with increasing training EEG recordings until saturation occurred (n = ~300). The kappa value was further improved by accounting for contextual (temporal) information, increasing model complexity, and adjusting the model training procedure to account for the imbalance of stage proportions. The final kappa on the testing set was 0.68. Testing on more EEG recordings leads to kappa estimates with lower variance. Conclusion: Training with a large data set enables automated sleep staging that compares favorably with human scorers. Because testing was performed on a large and heterogeneous data set, the performance estimate has low variance and is likely to generalize broadly.

Indexed as

AdultElectroencephalographyElectronic Data ProcessingFemaleHumansMachine LearningMaleMiddle AgedObserver VariationPolysomnographyReproducibility of ResultsSleepSleep Apnea SyndromesSleep Stagesbig dataEEGmachine learningsleep stages

Identifiers

PMID29029305
PMCPMC6251659

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.