Evidence map›Paper›PMID 33378539›Full record

ArticleSleep2021

Performance of seven consumer sleep-tracking devices compared with polysomnography.

Evan D Chinoy, Joseph A Cuellar, Kirbie E Huwa, Jason T Jameson, Catherine H Watson, Sara C Bessman, Dale A Hirsch, Adam D Cooper, Sean P A Drummond, Rachel R Markwald

3 registry-linked trialsAbstract read
In one paragraph

Article in Sleep, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 3 registered trials, which are not on this map. Cited by 215 papers, 7 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
215citing papers in PubMed, 7 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05456386 naunknown statusnot on this mapstarted 2022, after this paper: background citation

BioRhythm Health Coaching and Sleep Monitoring Program for Weight Loss

TypeinterventionalSponsorStephen HutchisonRan2022 to 2023Enrolled65ConditionsObesityArmsThe Circadian Rhythm Approach to Weight Loss (CRAWL)
NCT05703347 narecruitingnot on this mapstarted 2023, after this paper: background citation

Optimizing a Mobile Health Platform for Sleep Promotion and Obesity Prevention in Children

TypeinterventionalSponsorChildren's Hospital of PhiladelphiaRan2023 to 2027Enrolled5,000ConditionsInsufficient Sleep, ObesityArmsFixed sleep goal, Personalized sleep goal, Digital sleep health messaging without virtual study visit, Digital sleep health messaging with virtual study visit, Inactive Parent-Directed Loss-Framed Incentive
NCT07046429 narecruitingnot on this mapstarted 2025, after this paper: background citation

Effect of Supplemental Nightly Melatonin On REM and Cognition in Hepatic Encephalopathy (SNORE-HE) Trial

TypeinterventionalSponsorWeill Medical College of Cornell UniversityRan2025 to 2026Enrolled18ConditionsHepatic Encephalopathy, Covert Hepatic Encephalopathy, Cirrhosis, Sleep Disturbances and InsomniaArmsMelatonin tablet 3 mg once daily, Thiamine
3 · Its place in the literature

Who cites it

215 citing papers in PubMed, 7 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Performance of consumer wrist-worn sleep tracking devices compared to polysomnography: a meta-analysis.Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine · 2025
    Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Effects of inhaled aromatherapy on sleep quality and cognitive function in older adults: a randomised controlled trial.The journals of gerontology. Series A, Biological sciences and medical sciences · 2026
    Trial
  9. Trial
  10. Trial
  11. Trial
  12. Trial
  13. Comparing sleep measures in cancer survivors: self-reported sleep diary versus objective wearable sleep tracker.Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer · 2024
    Trial
  14. Long-term night-to-night variability of sleep-disordered breathing using a radar-based home sleep apnea test: a prospective cohort study.Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine · 2024
    Trial
  15. Early time-restricted eating advances sleep in late sleepers: a pilot randomized controlled trial.Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine · 2023
    Trial
  16. Trial
  17. Trial
  18. Review
  19. Article
  20. Article

155 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

10 authors.

Evan D ChinoySleep, Tactical Efficiency, and Endurance Laboratory, Warfighter Performance Department, Naval Health Research Center, San Diego, CA.ORCID 0000-0001-6613-6654
Joseph A CuellarSleep, Tactical Efficiency, and Endurance Laboratory, Warfighter Performance Department, Naval Health Research Center, San Diego, CA.
Kirbie E HuwaSleep, Tactical Efficiency, and Endurance Laboratory, Warfighter Performance Department, Naval Health Research Center, San Diego, CA.
Jason T JamesonSleep, Tactical Efficiency, and Endurance Laboratory, Warfighter Performance Department, Naval Health Research Center, San Diego, CA.
Catherine H WatsonSleep, Tactical Efficiency, and Endurance Laboratory, Warfighter Performance Department, Naval Health Research Center, San Diego, CA.
Sara C BessmanSleep, Tactical Efficiency, and Endurance Laboratory, Warfighter Performance Department, Naval Health Research Center, San Diego, CA.ORCID 0000-0002-3670-1189
Dale A HirschSleep, Tactical Efficiency, and Endurance Laboratory, Warfighter Performance Department, Naval Health Research Center, San Diego, CA.
Adam D CooperSleep, Tactical Efficiency, and Endurance Laboratory, Warfighter Performance Department, Naval Health Research Center, San Diego, CA.
Sean P A DrummondTurner Institute for Brain and Mental Health, Monash University, Melbourne, Victoria, Australia.ORCID 0000-0002-9815-626X
Rachel R MarkwaldSleep, Tactical Efficiency, and Endurance Laboratory, Warfighter Performance Department, Naval Health Research Center, San Diego, CA.ORCID 0000-0002-0432-3937

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

STUDY

objectivesConsumer sleep-tracking devices are widely used and becoming more technologically advanced, creating strong interest from researchers and clinicians for their possible use as alternatives to standard actigraphy. We, therefore, tested the performance of many of the latest consumer sleep-tracking devices, alongside actigraphy, versus the gold-standard sleep assessment technique, polysomnography (PSG).

methodsIn total, 34 healthy young adults (22 women; 28.1 ± 3.9 years, mean ± SD) were tested on three consecutive nights (including a disrupted sleep condition) in a sleep laboratory with PSG, along with actigraphy (Philips Respironics Actiwatch 2) and a subset of consumer sleep-tracking devices. Altogether, four wearable (Fatigue Science Readiband, Fitbit Alta HR, Garmin Fenix 5S, Garmin Vivosmart 3) and three nonwearable (EarlySense Live, ResMed S+, SleepScore Max) devices were tested. Sleep/wake summary and epoch-by-epoch agreement measures were compared with PSG.

resultsMost devices (Fatigue Science Readiband, Fitbit Alta HR, EarlySense Live, ResMed S+, SleepScore Max) performed as well as or better than actigraphy on sleep/wake performance measures, while the Garmin devices performed worse. Overall, epoch-by-epoch sensitivity was high (all ≥0.93), specificity was low-to-medium (0.18-0.54), sleep stage comparisons were mixed, and devices tended to perform worse on nights with poorer/disrupted sleep.

conclusionsConsumer sleep-tracking devices exhibited high performance in detecting sleep, and most performed equivalent to (or better than) actigraphy in detecting wake. Device sleep stage assessments were inconsistent. Findings indicate that many newer sleep-tracking devices demonstrate promising performance for tracking sleep and wake. Devices should be tested in different populations and settings to further examine their wider validity and utility.

Indexed as

ActigraphySleepAdultFemaleHumansPolysomnographyReproducibility of ResultsSleep StagesYoung Adultactigraphynearablesnoncontactpolysomnographysensorssleep technologyvalidationwearables

Identifiers

PMID33378539
PMCPMC8120339

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.