Evidence map›Paper›PMID 33277527›Full record

ArticleScientific reports2020

Feature replacement methods enable reliable home video analysis for machine learning detection of autism.

Emilie Leblanc, Peter Washington, Maya Varma, Kaitlyn Dunlap, Yordan Penev, Aaron Kline, Dennis P Wall

Abstract read
In one paragraph

Article in Scientific reports, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. [A review of studies on visual behavior analysis aided diagnosis of autism spectrum disorders].Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi · 2023
    Review
  8. Article
  9. Session Introduction: TOWARDS ETHICAL BIOMEDICAL INFORMATICS: LEARNING FROM OLELO NOEAU, HAWAIIAN PROVERBS.Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing · 2023
    Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Emilie LeblancDepartment of Pediatrics, Stanford University, Palo Alto, CA, 94305, USA.
Peter WashingtonDepartment of Bioengineering, Stanford University, Palo Alto, CA, 94305, USA.
Maya VarmaDepartment of Computer Science, Stanford University, Palo Alto, CA, 94305, USA.
Kaitlyn DunlapDepartment of Pediatrics, Stanford University, Palo Alto, CA, 94305, USA.
Yordan PenevDepartment of Pediatrics, Stanford University, Palo Alto, CA, 94305, USA.
Aaron KlineDepartment of Pediatrics, Stanford University, Palo Alto, CA, 94305, USA.
Dennis P WallDepartment of Pediatrics, Stanford University, Palo Alto, CA, 94305, USA. dpwall@stanford.edu.

Funding

Creating an artificial intelligence therapy-to-data feedback loop for child developmental healthcareR01LM013083 · NLM · STANFORD UNIVERSITY · PI WALL, DENNIS PAUL · 2019 to 2022
$2.6M
QuBBD: Wearable artificial intelligence for bid data-driven healthcare in child development R01EB025025 · NIBIB · STANFORD UNIVERSITY · PI WALL, DENNIS PAUL · 2017 to 2019
$1.1M
Evaluation of machine learning to mobilize detection and therapy of developmental delay in childrenR21HD091500 · NICHD · STANFORD UNIVERSITY · PI WALL, DENNIS PAUL · 2017 to 2018
$432k
NIBIB NIH HHS R01 EB025025NICHD NIH HHS R21 HD091500NIH HHS 1R21HD091500-01NLM NIH HHS R01 LM013083
6 · The paper itself

Abstract

Autism Spectrum Disorder is a neuropsychiatric condition affecting 53 million children worldwide and for which early diagnosis is critical to the outcome of behavior therapies. Machine learning applied to features manually extracted from readily accessible videos (e.g., from smartphones) has the potential to scale this diagnostic process. However, nearly unavoidable variability in video quality can lead to missing features that degrade algorithm performance. To manage this uncertainty, we evaluated the impact of missing values and feature imputation methods on two previously published autism detection classifiers, trained on standard-of-care instrument scoresheets and tested on ratings of 140 children videos from YouTube. We compare the baseline method of listwise deletion to classic univariate and multivariate techniques. We also introduce a feature replacement method that, based on a score, selects a feature from an expanded dataset to fill-in the missing value. The replacement feature selected can be identical for all records (general) or automatically adjusted to the record considered (dynamic). Our results show that general and dynamic feature replacement methods achieve a higher performance than classic univariate and multivariate methods, supporting the hypothesis that algorithmic management can maintain the fidelity of video-based diagnostics in the face of missing values and variable video quality.

Indexed as

Machine LearningAlgorithmsAutism Spectrum DisorderAutistic DisorderEarly DiagnosisFemaleHumansMaleMultivariate Analysis

Identifiers

PMID33277527
PMCPMC7719177

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.