Evidence map›Paper›PMID 33801763›Full record

ArticleSensors (Basel, Switzerland)2021

The Importance of Real-World Validation of Machine Learning Systems in Wearable Exercise Biofeedback Platforms: A Case Study.

Rob Argent, Antonio Bevilacqua, Alison Keogh, Ailish Daly, Brian Caulfield

Open access · goldAbstract read
In one paragraph

Article in Sensors (Basel, Switzerland), 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 2 pooled it
5.4field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 2 syntheses or guidelines pooled it, 29 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Review
  5. Article
  6. Seven Things to Know About Exercise Classification With Inertial Sensing Wearables.IEEE journal of biomedical and health informatics · 2024
    Article
  7. Review
  8. State-of-the-Art Sensors Research in Ireland.Sensors (Basel, Switzerland) · 2022
    Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 1 institution in 1 country.

Rob ArgentInsight Centre for Data Analytics, University College Dublin, D04 V1W8 Dublin, Ireland.ORCID 0000-0002-3522-9409
Antonio BevilacquaInsight Centre for Data Analytics, University College Dublin, D04 V1W8 Dublin, Ireland.
Alison KeoghInsight Centre for Data Analytics, University College Dublin, D04 V1W8 Dublin, Ireland.
Ailish DalyBeacon Hospital, D18 AK68 Dublin, Ireland.
Brian CaulfieldInsight Centre for Data Analytics, University College Dublin, D04 V1W8 Dublin, Ireland.
University College Dublin · IE

Funding

H2020 Marie Skłodowska-Curie Actions 676201Science Foundation Ireland 12/RC/2289_P2
6 · The paper itself

Abstract

Machine learning models are being utilized to provide wearable sensor-based exercise biofeedback to patients undertaking physical therapy. However, most systems are validated at a technical level using lab-based cross validation approaches. These results do not necessarily reflect the performance levels that patients and clinicians can expect in the real-world environment. This study aimed to conduct a thorough evaluation of an example wearable exercise biofeedback system from laboratory testing through to clinical validation in the target setting, illustrating the importance of context when validating such systems. Each of the various components of the system were evaluated independently, and then in combination as the system is designed to be deployed. The results show a reduction in overall system accuracy between lab-based cross validation (>94%), testing on healthy participants (

Indexed as

Wearable Electronic DevicesBiofeedback, PsychologyExerciseHealthy VolunteersHumansMachine Learningbiofeedbackbiomedical technologyexercise therapyhuman factorsinertial measurement unitmachine learningwearables

Identifiers

PMID33801763
PMCPMC8037109
OpenAlexW3141268668

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.