Evidence map›Paper›PMID 41380032›Full record

ArticleJMIR formative research2025

Comparison and Validation of Actigraphy Algorithms Using a Large Community Dataset: Algorithm Validation Study.

Darshan Panesar, Aashish Vichare, Jason Goncalves, Robyn Stremler

Abstract readValidation StudyComparative Study
In one paragraph

Article in JMIR formative research, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Darshan PanesarApplied Psychology and Human Development, Ontario Institute for Studies in Education, University of Toronto, 252 Bloor Street West, Toronto, ON, M5S 1V6, Canada, 1 416 934 4503.ORCID 0000-0003-1174-4438
Aashish VichareIndependent Researcher, Vancouver, BC, Canada.ORCID 0009-0008-1058-5985
Jason GoncalvesIndependent Researcher, Toronto, ON, Canada.ORCID 0009-0006-5778-2295
Robyn StremlerLawrence Bloomberg Faculty of Nursing, University of Toronto, Toronto, ON, Canada.ORCID 0000-0002-8800-2857

Funding

Institute for Clinical and Translational ResearchUL1TR001079 · NCATS · JOHNS HOPKINS UNIVERSITY · PI FORD, DANIEL ERNEST · 2013 to 2017
$60.1M
Wake Forest Clinical and Translational Science AwardUL1TR001420 · NCATS · WAKE FOREST UNIVERSITY HEALTH SCIENCES · PI ARD, JAMY D, FOLEY, KRISTIE L · 2015 to 2023
$32.3M
Clinical and Translational Science AwardUL1TR000040 · NCATS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI GINSBERG, HENRY N · 2012 to 2015
$26.2M
SUBCLINICAL CARDIOVASCULAR DISEASE COORDINATING CENTERN01HC95159 · NHLBI · UNIVERSITY OF WASHINGTON · PI KRONMAL, RICHARD A · 2007 to 2014
$19.6M
ASSOCIATION OF SLEEP DISORDERS WITH CARDIOVASCULAR HEALTH ACROSS ETHNIC GROUPSR01HL098433 · NHLBI · BRIGHAM AND WOMEN'S HOSPITAL · PI REDLINE, SUSAN S. · 2010 to 2015
$8.2M
SUBCLINICAL CARDIOVASCULAR DISEASE STUDY--FIELD CENTERN01HC95160 · NHLBI · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI WATSON, KAROL · 2007 to 2015
$7.7M
National Sleep Research Resource (NSRR)R24HL114473 · NHLBI · BRIGHAM AND WOMEN'S HOSPITAL · PI REDLINE, SUSAN S., ZHANG, GUO-QIANG · 2013 to 2017
$7.5M
SUBCLINICAL CARDIOVASCULAR DISEASE STUDY-FIELD CENTERN01HC95164 · NHLBI · NORTHWESTERN UNIVERSITY AT CHICAGO · PI LIU, KIANG · 2007 to 2015
$7.0M
SUBCLINICAL CARDIOVASCULAR DISEASE STUDY--FIELD CENTERN01HC95161 · NHLBI · COLUMBIA UNIV NEW YORK MORNINGSIDE · PI SHEA, STEVEN · 2007 to 2014
$6.4M
SUBCLINICAL CARDIOVASCULAR DISEASE STUDY--FIELD CENTERN01HC95165 · NHLBI · WAKE FOREST UNIVERSITY HEALTH SCIENCES · PI BURKE, GREGORY L · 2007 to 2014
$6.3M
SUBCLINICAL CARDIOVASCULAR DISEASE STUDY--FIELD CENTERN01HC95163 · NHLBI · UNIVERSITY OF MINNESOTA · PI FOLSOM, AARON R · 2007 to 2014
$6.1M
TITLE: MULTI-ETHNIC STUDY OF ATHEROSCLEROSIS (MESA)N01HC95162 · NHLBI · JOHNS HOPKINS UNIVERSITY · PI POST, WENDY · 2007 to 2015
$6.0M
NCATS NIH HHS UL1 TR000040NCATS NIH HHS UL1 TR001079NCATS NIH HHS UL1 TR001420NHLBI NIH HHS 75N92019R002NHLBI NIH HHS HHSN268201500003INHLBI NIH HHS N01HC95159NHLBI NIH HHS N01HC95160NHLBI NIH HHS N01HC95161NHLBI NIH HHS N01HC95162NHLBI NIH HHS N01HC95163NHLBI NIH HHS N01HC95164NHLBI NIH HHS N01HC95165NHLBI NIH HHS N01HC95166NHLBI NIH HHS N01HC95167NHLBI NIH HHS N01HC95168NHLBI NIH HHS N01HC95169NHLBI NIH HHS R01 HL098433NHLBI NIH HHS R24 HL114473
6 · The paper itself

Abstract

Background: For decades, the measurement of sleep and wake has relied upon watch-based actigraphy as an alternative to expensive, obtrusive clinical monitoring. At the time of this publication, we have relied upon a handful of algorithms to score actigraphy data as sleep or wake. However, these algorithms have largely been tested and validated with only small samples of young, healthy individuals. Objective: This study aimed to establish the accuracy and agreement of conventional and traditional actigraphy algorithms against polysomnography, the clinical standard, using the diverse Multi-Ethnic Study of Atherosclerosis (MESA) sleep dataset. As a secondary objective, we examined algorithm and polysomnography agreement for key sleep metrics including total sleep time (TST), sleep efficiency (SE), and wake after sleep onset (WASO). Methods: We assessed 5 well-established algorithms, including Cole-Kripke, University of California San Diego (UCSD) scoring, Kripke 2010, Philips-Respironics, and Sadeh, with and without rescoring across 1440 individuals (Mage=mean 69.36, SD 8.97) from the MESA sleep dataset. We conducted epoch-by-epoch comparisons assessing accuracy, confusion matrix analyses, receiver operator characteristic curves (ROC), area under the curve (AUC), and Bland-Altman analyses for agreement. Results: Primary results indicated all algorithms demonstrated accuracy between 78%-80% with the highest accuracy by the Kripke 2010 (80%) algorithm followed closely by the Cole-Kripke (80%) and Philips-Respironics (80%-79%) algorithms. In addition, moderate Cohen κ agreement and moderate positive Matthews correlations were demonstrated by all algorithms. Further, all algorithms demonstrated significant mean difference across sleep metrics. Conclusions: The findings of this study establish that these traditional actigraphy algorithms can, with high accuracy, detect sleep and wake in large, diverse population samples, including older adults or populations at risk of health conditions. However, these algorithms may carry difficulty for precise assessment of sleep metrics, especially in cases of sleep disorders or irregular sleep.

Indexed as

ActigraphyAlgorithmsSleepAgedAged, 80 and overFemaleHumansMaleMiddle AgedPolysomnographyReproducibility of ResultsaccelerometeractigraphyalgorithmM.E.S.A.Multi-Ethnic Study of Atherosclerosispolysomnographysleepsleep disordersleep monitoringwake

Identifiers

PMID41380032
PMCPMC12697920

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.