Evidence map›Paper›PMID 37709595›Full record

ArticleSleep health2023

Performance evaluation of the open-source Yet Another Spindle Algorithm sleep staging algorithm against gold standard manual evaluation of polysomnographic records in adolescence.

Davide Benedetti, Emma Frati, Orsolya Kiss, Dilara Yuksel, Ugo Faraguna, Brant P Hasler, Peter L Franzen, Duncan B Clark, Fiona C Baker, Massimiliano de Zambotti

Open access · greenAbstract read
In one paragraph

Article in Sleep health, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
2.0field-weighted citation impact, top 13% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 8 citations in OpenAlex.

  1. YASA automated sleep staging performance across seven nights of normal sleep and sleep restriction.Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine · 2026
    Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 3 institutions in 2 countries.

Davide BenedettiCenter for Health Sciences, SRI International, Menlo Park, California, USA; Department of Translational Research and of New Surgical and Medical Technologies, University of Pisa, Pisa, Italy. Electronic address: d.benedetti5@studenti.unipi.it.
Emma FratiCenter for Health Sciences, SRI International, Menlo Park, California, USA; Columbia College, Columbia University, NYC, New York, USA.
Orsolya KissCenter for Health Sciences, SRI International, Menlo Park, California, USA.
Dilara YukselCenter for Health Sciences, SRI International, Menlo Park, California, USA.
Ugo FaragunaDepartment of Translational Research and of New Surgical and Medical Technologies, University of Pisa, Pisa, Italy; Department of Developmental Neuroscience, IRCCS Fondazione Stella Maris, Pisa, Italy.
Brant P HaslerDepartment of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA.
Peter L FranzenDepartment of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA.
Duncan B ClarkDepartment of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA.
Fiona C BakerCenter for Health Sciences, SRI International, Menlo Park, California, USA.
Massimiliano de ZambottiCenter for Health Sciences, SRI International, Menlo Park, California, USA.
SRI International · USUniversity of Pittsburgh · USUniversity of Pisa · IT

Funding

Sex Differences in Autonomic Nervous System Function and Depression Across AdolescenceU01AA021696 · NIAAA · SRI INTERNATIONAL · PI Fiona C Baker · 2012 to 2026
$12.2M
NCANDA Research Project Site: University of Pittsburgh (NCANDA-PITT)U01AA021690 · NIAAA · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI DUNCAN B. CLARK, BEATRIZ LUNA · 2012 to 2026
$7.6M
NIAAA NIH HHS U01 AA021690NIAAA NIH HHS U01 AA021696
6 · The paper itself

Abstract

GOAL AND

aimsTo evaluate an automatic sleep scoring algorithm against manual polysomnography sleep scoring. FOCUS METHOD/TECHNOLOGY: Yet Another Spindle Algorithm automatic sleep staging algorithm. REFERENCE METHOD/TECHNOLOGY: Manual sleep scoring. SAMPLE: 327 nights (151 healthy adolescents), from the NCANDA study.

designParticipants underwent one-to-three overnight polysomnography recordings, one consisting of an event-related-potential paradigm. CORE ANALYTICS: Epoch by Epoch and discrepancy analyses (Bland Altman plots) were conducted on the overall sample. ADDITIONAL ANALYTICS AND EXPLORATORY ANALYSES: Epoch by Epoch and discrepancy analysis were repeated separately on standard polysomnography nights and event-related potential nights. Regression models were estimated on age, sex, scorer, and site of recording, separately on standard polysomnography nights and event-related potential nights. CORE OUTCOMES: The Yet Another Spindle Algorithm sleep scoring algorithm's average sensitivity of 93.04% for Wake, 87.67% for N2, 84.46% for N3, 86.02% for rapid-eye-movement, and 40.39% for N1. Specificity was 96.75% for Wake, 97.31% for N1, 88.87% for N2, 97.99% for N3, and 97.70% for rapid-eye-movement. The Matthews Correlation Coefficient was highest in rapid-eye-movement sleep (0.85) while lowest in N1 (0.39). Cohen's Kappa mirrored Matthews Correlation Coefficient results. In Bland-Altman plots, the bias between Yet Another Spindle Algorithm and human scoring showed proportionality to the manual scoring measurement size. IMPORTANT ADDITIONAL OUTCOMES: Yet Another Spindle Algorithm performance was reduced in event-related-potential/polysomnography nights for N3 and rapid-eye-movement. According to the Matthews Correlation Coefficient, the Yet Another Spindle Algorithm performance was affected by younger age, male sex, recording sites, and scorers. CORE

conclusionResults support the use of Yet Another Spindle Algorithm to score adolescents' polysomnography sleep records, possibly with classification outcomes supervised by an expert scorer.

Indexed as

SleepSleep StagesAdolescentAlgorithmsHumansMalePolysomnographyReproducibility of ResultsAutomatic scoringPerformance evaluationPolysomnographySleepYASA

Identifiers

PMID37709595
PMCPMC11161906
OpenAlexW4386645335

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.