Evidence map›Paper›PMID 35890959›Full record

ArticleSensors (Basel, Switzerland)2022

Development of Smartphone Application for Markerless Three-Dimensional Motion Capture Based on Deep Learning Model.

Yukihiko Aoyagi, Shigeki Yamada, Shigeo Ueda, Chifumi Iseki, Toshiyuki Kondo, Keisuke Mori, Yoshiyuki Kobayashi, Tadanori Fukami, Minoru Hoshimaru, Masatsune Ishikawa and 1 more

Abstract read
In one paragraph

Article in Sensors (Basel, Switzerland), 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Yukihiko AoyagiDigital Standard Co., Ltd., Osaka 536-0013, Japan.
Shigeki YamadaDepartment of Neurosurgery, Shiga University of Medical Science, Otsu 520-2192, Japan.ORCID 0000-0001-7158-5569
Shigeo UedaShin-Aikai Spine Center, Katano Hospital, Katano 576-0043, Japan.
Chifumi IsekiDivision of Neurology and Clinical Neuroscience, Department of Internal Medicine III, Yamagata University School of Medicine, Yamagata 990-9585, Japan.
Toshiyuki KondoDivision of Neurology and Clinical Neuroscience, Department of Internal Medicine III, Yamagata University School of Medicine, Yamagata 990-9585, Japan.
Keisuke MoriSchool of Medicine, Shiga University of Medical Science, Otsu 520-2192, Japan.ORCID 0000-0003-0072-5741
Yoshiyuki KobayashiHuman Augmentation Research Center, National Institute of Advanced Industrial Science and Technology (AIST), Kashiwa II Campus, University of Tokyo, Kashiwa 277-0882, Japan.
Tadanori FukamiDepartment of Informatics and Electronics, Faculty of Engineering, Yamagata University, Yamagata 992-8510, Japan.
Minoru HoshimaruShin-Aikai Spine Center, Katano Hospital, Katano 576-0043, Japan.
Masatsune IshikawaNormal Pressure Hydrocephalus Center, Rakuwakai Otowa Hospital, Kyoto 607-8062, Japan.
Yasuyuki OhtaDivision of Neurology and Clinical Neuroscience, Department of Internal Medicine III, Yamagata University School of Medicine, Yamagata 990-9585, Japan.

Funding

G-7 Scholarship Foundation noneJapan Society for the Promotion of Science 21K09098Osaka Gas Group Welfare Foundation noneTaiju Life Social Welfare Foundation none
6 · The paper itself

Abstract

To quantitatively assess pathological gait, we developed a novel smartphone application for full-body human motion tracking in real time from markerless video-based images using a smartphone monocular camera and deep learning. As training data for deep learning, the original three-dimensional (3D) dataset comprising more than 1 million captured images from the 3D motion of 90 humanoid characters and the two-dimensional dataset of COCO 2017 were prepared. The 3D heatmap offset data consisting of 28 × 28 × 28 blocks with three red-green-blue colors at the 24 key points of the entire body motion were learned using the convolutional neural network, modified ResNet34. At each key point, the hottest spot deviating from the center of the cell was learned using the tanh function. Our new iOS application could detect the relative tri-axial coordinates of the 24 whole-body key points centered on the navel in real time without any markers for motion capture. By using the relative coordinates, the 3D angles of the neck, lumbar, bilateral hip, knee, and ankle joints were estimated. Any human motion could be quantitatively and easily assessed using a new smartphone application named Three-Dimensional Pose Tracker for Gait Test (TDPT-GT) without any body markers or multipoint cameras.

Indexed as

Deep LearningBiomechanical PhenomenaGaitHumansMotionSmartphonedeep learningmarkerless motion capturemotion trackingquantitative gait assessmentsmartphone device

Identifiers

PMID35890959
PMCPMC9322512

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.