Evidence map›Paper›PMID 37573208›Full record

ArticleSleep health2023

Performance of an open machine learning model to classify sleep/wake from actigraphy across ∼24-hour intervals without knowledge of rest timing.

Daniel M Roberts, Margeaux M Schade, Lindsay Master, Vasant G Honavar, Nicole G Nahmod, Anne-Marie Chang, Daniel Gartenberg, Orfeu M Buxton

Erratum issuedOpen access · hybridAbstract read
In one paragraph

Article in Sleep health, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
2.6field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 10 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Observational
  7. Review
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors at 1 institution in 1 country.

Daniel M RobertsDepartment of Biobehavioral Health, The Pennsylvania State University, University Park, Pennsylvania, USA; Proactive Life, Inc, New York, New York, USA. Electronic address: danmroberts@gmail.com.
Margeaux M SchadeDepartment of Biobehavioral Health, The Pennsylvania State University, University Park, Pennsylvania, USA.
Lindsay MasterDepartment of Biobehavioral Health, The Pennsylvania State University, University Park, Pennsylvania, USA.
Vasant G HonavarFaculty of Data Sciences, College of Information Science and Technology, The Pennsylvania State University, University Park, Pennsylvania, USA.
Nicole G NahmodDepartment of Biobehavioral Health, The Pennsylvania State University, University Park, Pennsylvania, USA.
Anne-Marie ChangDepartment of Biobehavioral Health, The Pennsylvania State University, University Park, Pennsylvania, USA.
Daniel GartenbergProactive Life, Inc, New York, New York, USA.
Orfeu M BuxtonDepartment of Biobehavioral Health, The Pennsylvania State University, University Park, Pennsylvania, USA.
Pennsylvania State University · US

Funding

Institute for Clinical and Translational ResearchUL1TR001079 · NCATS · JOHNS HOPKINS UNIVERSITY · PI FORD, DANIEL ERNEST · 2013 to 2017
$60.1M
Penn State Clinical and Translational Science InstituteUL1TR002014 · NCATS · PENNSYLVANIA STATE UNIV HERSHEY MED CTR · PI KRASCHNEWSKI, JENNIFER L. · 2016 to 2025
$33.7M
Wake Forest Clinical and Translational Science AwardUL1TR001420 · NCATS · WAKE FOREST UNIVERSITY HEALTH SCIENCES · PI ARD, JAMY D, FOLEY, KRISTIE L · 2015 to 2023
$32.3M
Clinical and Translational Science AwardUL1TR000040 · NCATS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI GINSBERG, HENRY N · 2012 to 2015
$26.2M
Ambulatory Methods for Measuring Cognitive ChangeU2CAG060408 · NIA · PENNSYLVANIA STATE UNIVERSITY, THE · PI YABIKU, SCOTT THOMAS · 2018 to 2022
$14.9M
ASSOCIATION OF SLEEP DISORDERS WITH CARDIOVASCULAR HEALTH ACROSS ETHNIC GROUPSR01HL098433 · NHLBI · BRIGHAM AND WOMEN'S HOSPITAL · PI REDLINE, SUSAN S. · 2010 to 2015
$8.2M
National Sleep Research Resource (NSRR)R24HL114473 · NHLBI · BRIGHAM AND WOMEN'S HOSPITAL · PI REDLINE, SUSAN S., ZHANG, GUO-QIANG · 2013 to 2017
$7.5M
Business and regulatory development for Integrating sleep enhancement technology into clinical practiceR44AG056250 · NIA · PROACTIVE LIFE, INC. · PI GARTENBERG, DANIEL · 2020 to 2022
$2.5M
SUBCLINICAL CARDIOVASCULAR DISEASE STUDYN01HC095166 · HC · UNIVERSITY OF VERMONT &ST AGRIC COLLEGE · PI TRACY, RUSSELL P · 1999 to 2001
$758k
Non-pharmacological improvement of sleep structure in older peopleR43AG056250 · NIA · MOBILE SLEEP TECHNOLOGIES, LLC · PI GARTENBERG, DANIEL, GERASHCHENKO, DMITRY · 2017 to 2018
$696k
SUBCLINICAL CARDIOVASCULAR DISEASE STUDY-FIELD CENTERN01HC095162 · HC · JOHNS HOPKINS UNIVERSITY · PI SZKLO, MOYSES A · 1999 to 2000
$694k
SUBCLINICAL CARDIOVASCULAR DISEASE STUDY--FIELD CENTERN01HC095161 · HC · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI SHEA, STEVEN · 1999 to 2001
$642k
NCATS NIH HHS UL1 TR000040NCATS NIH HHS UL1 TR001079NCATS NIH HHS UL1 TR001420NCATS NIH HHS UL1 TR002014NHLBI NIH HHS HHSN268201500003CNHLBI NIH HHS HHSN268201500003INHLBI NIH HHS N01 HC095159NHLBI NIH HHS N01 HC095160NHLBI NIH HHS N01 HC095161NHLBI NIH HHS N01 HC095162NHLBI NIH HHS N01 HC095163NHLBI NIH HHS N01 HC095164NHLBI NIH HHS N01 HC095165NHLBI NIH HHS N01 HC095166NHLBI NIH HHS N01 HC095167NHLBI NIH HHS N01 HC095168NHLBI NIH HHS N01 HC095169NHLBI NIH HHS R01 HL098433NHLBI NIH HHS R24 HL114473NIA NIH HHS R43 AG056250NIA NIH HHS R44 AG056250NIA NIH HHS U2C AG060408
6 · The paper itself

Abstract

GOAL AND

aimsCommonly used actigraphy algorithms are designed to operate within a known in-bed interval. However, in free-living scenarios this interval is often unknown. We trained and evaluated a sleep/wake classifier that operates on actigraphy over ∼24-hour intervals, without knowledge of in-bed timing. FOCUS TECHNOLOGY: Actigraphy counts from ActiWatch Spectrum devices. REFERENCE TECHNOLOGY: Sleep staging derived from polysomnography, supplemented by observation of wakefulness outside of the staged interval. Classifications from the Oakley actigraphy algorithm were additionally used as performance reference. SAMPLE: Adults, sleeping in either a home or laboratory environment.

designMachine learning was used to train and evaluate a sleep/wake classifier in a supervised learning paradigm. The classifier is a temporal convolutional network, a form of deep neural network. CORE ANALYTICS: Performance was evaluated across ∼24 hours, and additionally restricted to only in-bed intervals, both in terms of epoch-by-epoch performance, and the discrepancy of summary statistics within the intervals. ADDITIONAL ANALYTICS AND EXPLORATORY ANALYSES: Performance of the trained model applied to the Multi-Ethnic Study of Atherosclerosis dataset. CORE OUTCOMES: Over ∼24 hours, the temporal convolutional network classifier produced the same or better performance as the Oakley classifier on all measures tested. When restricting analysis to the in-bed interval, the temporal convolutional network remained favorable on several metrics. IMPORTANT SUPPLEMENTAL OUTCOMES: Performance decreased on the Multi-Ethnic Study of Atherosclerosis dataset, especially when restricting analysis to the in-bed interval. CORE

conclusionA classifier using data labeled over ∼24-hour intervals allows for the continuous classification of sleep/wake without knowledge of in-bed intervals. Further development should focus on improving generalization performance.

Indexed as

ActigraphyAtherosclerosisAdultHumansPolysomnographyRestSleep24-hourActigraphyClassificationMachine learningWearables

Identifiers

PMID37573208
PMCPMC11005467
OpenAlexW4385732868

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.