Evidence map›Paper›PMID 35513978›Full record

ArticleSleep health2022

Rigorous performance evaluation (previously, "validation") for informed use of new technologies for sleep health measurement.

Massimiliano de Zambotti, Luca Menghini, Michael A Grandner, Susan Redline, Ying Zhang, Meredith L Wallace, Orfeu M Buxton

Abstract read
In one paragraph

Article in Sleep health, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 30 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
30citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

30 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Article
  4. Article
  5. Consumer sleep technologies: what we know and what comes next.Sleep advances : a journal of the Sleep Research Society · 2026
    Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Optimizing wearable single-channel electroencephalography sleep staging in a heterogeneous sleep-disordered population using transfer learning.Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine · 2025
    Article
  12. Article
  13. Article
  14. A narrative review on in-flight use of consumer sleep technologies for aviation research.Sleep advances : a journal of the Sleep Research Society · 2025
    Review
  15. Article
  16. Article
  17. OSA diagnosis goes wearable: are the latest devices ready to shine?Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine · 2024
    Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Massimiliano de ZambottiCenter for Health Sciences, SRI International, CA, USA.
Luca MenghiniDepartment of Psychology, University of Bologna, Italy.
Michael A GrandnerSleep and Health Research Program, Department of Psychiatry, University of Arizona College of Medicine, Tucson, AZ, USA.
Susan RedlineDepartment of Medicine, Brigham and Women's Hospital, Boston, MA, USA; Harvard Medical School, Boston, MA, USA.
Ying ZhangDepartment of Medicine, Brigham and Women's Hospital, Boston, MA, USA.
Meredith L WallaceDepartment of Psychiatry, University of Pittsburgh, Pittsburgh, PA, USA.
Orfeu M BuxtonDepartment of Biobehavioral Health, The Pennsylvania State University, University Park, PA, USA. Electronic address: orfeu@psu.edu.

Funding

Subject Management and BiobankingP50DA046346 · NIDA · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI MEREDITH JOANNE LOTZ WALLACE · 2020 to 2026
$23.4M
NATIONAL SLEEP RESEARCH RESOURCE (NSRR)75N92019C00011 · NHLBI · BRIGHAM AND WOMEN'S HOSPITAL · PI REDLINE, SUSAN · 2019 to 2024
$6.5M
Business and regulatory development for Integrating sleep enhancement technology into clinical practiceR44AG056250 · NIA · PROACTIVE LIFE, INC. · PI GARTENBERG, DANIEL · 2020 to 2022
$2.5M
Non-pharmacological improvement of sleep structure in older peopleR43AG056250 · NIA · MOBILE SLEEP TECHNOLOGIES, LLC · PI GARTENBERG, DANIEL, GERASHCHENKO, DMITRY · 2017 to 2018
$696k
NHLBI NIH HHS 75N92019C00011NIA NIH HHS R43 AG056250NIA NIH HHS R44 AG056250NIDA NIH HHS P50 DA046346
6 · The paper itself

Abstract

New sleep technologies have become pervasive in the consumer space, and are becoming highly common in research and clinical sleep settings. The rapid, widespread use of largely unregulated and unstandardized technology has enabled the quantification of many different facets of sleep health, driving scientific discovery. As sleep scientists, it is our responsibility to inform principles and practices for proper evaluation of any new technology used in the clinical and research settings, and by consumers. A current lack of standardized methods for evaluating technology performance challenges the rigor of our scientific methods for accurate representation of the sleep health facets of interest. This special article describes the rationale and priorities of an interdisciplinary effort for rigorous, standardized, and rapid performance evaluation (previously, "validation") of new sleep and sleep disorders related technologies of all kinds (eg, devices or algorithms), including an associated article template for a new initiative for publication in Sleep Health of empirical studies systematically evaluating the performance of new sleep technologies. A structured article type should streamline manuscript development and enable more rapid writing, review, and publication. The goal is to promote rapid and rigorous evaluation and dissemination of new sleep technology, to enhance sleep research integrity, and to standardize terminology used in Rigorous Performance Evaluation papers to prevent misinterpretation while facilitating comparisons across technologies.

Indexed as

SleepSleep Wake DisordersHumansPolysomnographyTechnologyActigraphyAlgorithmsMachine learningPerformance evaluationsSensorsWearables

Identifiers

PMID35513978
PMCPMC9338437

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.