Evidence map›Paper›PMID 32319961›Full record

ArticleJournal of medical Internet research2020

Toward Continuous Social Phenotyping: Analyzing Gaze Patterns in an Emotion Recognition Task for Children With Autism Through Wearable Smart Glasses.

Anish Nag, Nick Haber, Catalin Voss, Serena Tamura, Jena Daniels, Jeffrey Ma, Bryan Chiang, Shasta Ramachandran, Jessey Schwartz, Terry Winograd and 2 more

Open access · goldAbstract read
In one paragraph

Article in Journal of medical Internet research, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed, 3 pooled it
4.0field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed, 3 syntheses or guidelines pooled it, 52 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Review
  6. Review
  7. Review
  8. Review
  9. Article
  10. Article
  11. Article
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Selection of trustworthy crowd workers for telemedical diagnosis of pediatric autism spectrum disorder.Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing · 2021
    Article
  18. Article
  19. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors at 4 institutions in 1 country.

Anish NagUniversity of California, Berkeley, CA, United States.ORCID 0000-0002-0574-3722
Nick Haber *Graduate School of Education, Stanford University, Stanford, CA, United States.ORCID 0000-0001-8804-7804
Catalin VossDepartment of Computer Science, Stanford University, Stanford, CA, United States.ORCID 0000-0001-6480-7020
Serena TamuraUC San Francisco, San Francisco, CA, United States.ORCID 0000-0002-3090-2385
Jena DanielsMedable, Inc, Palo Alto, CA, United States.ORCID 0000-0002-7912-8482
Jeffrey MaDepartments of Pediatrics, Biomedical Data Science, Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, United States.ORCID 0000-0002-3646-3547
Bryan ChiangDepartments of Pediatrics, Biomedical Data Science, Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, United States.ORCID 0000-0002-5706-3964
Shasta RamachandranDepartments of Pediatrics, Biomedical Data Science, Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, United States.ORCID 0000-0002-6102-241X
Jessey SchwartzDepartments of Pediatrics, Biomedical Data Science, Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, United States.ORCID 0000-0003-4916-7891
Terry WinogradDepartment of Computer Science, Stanford University, Stanford, CA, United States.ORCID 0000-0003-4435-7215
Carl FeinsteinDepartments of Pediatrics, Biomedical Data Science, Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, United States.ORCID 0000-0003-1213-5749
Dennis P WallDepartments of Pediatrics, Biomedical Data Science, Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, United States.ORCID 0000-0002-7889-9146
Stanford University · USAlbemarle (United States) · USUniversity of California, Berkeley · USUniversity of California, San Francisco · US

Funding

Creating an artificial intelligence therapy-to-data feedback loop for child developmental healthcareR01LM013083 · NLM · STANFORD UNIVERSITY · PI WALL, DENNIS PAUL · 2019 to 2022
$2.6M
QuBBD: Wearable artificial intelligence for bid data-driven healthcare in child development R01EB025025 · NIBIB · STANFORD UNIVERSITY · PI WALL, DENNIS PAUL · 2017 to 2019
$1.1M
Evaluation of machine learning to mobilize detection and therapy of developmental delay in childrenR21HD091500 · NICHD · STANFORD UNIVERSITY · PI WALL, DENNIS PAUL · 2017 to 2018
$432k
NIBIB NIH HHS R01 EB025025NICHD NIH HHS R21 HD091500NLM NIH HHS R01 LM013083
6 · The paper itself

Abstract

backgroundSeveral studies have shown that facial attention differs in children with autism. Measuring eye gaze and emotion recognition in children with autism is challenging, as standard clinical assessments must be delivered in clinical settings by a trained clinician. Wearable technologies may be able to bring eye gaze and emotion recognition into natural social interactions and settings.

objectiveThis study aimed to test: (1) the feasibility of tracking gaze using wearable smart glasses during a facial expression recognition task and (2) the ability of these gaze-tracking data, together with facial expression recognition responses, to distinguish children with autism from neurotypical controls (NCs).

methodsWe compared the eye gaze and emotion recognition patterns of 16 children with autism spectrum disorder (ASD) and 17 children without ASD via wearable smart glasses fitted with a custom eye tracker. Children identified static facial expressions of images presented on a computer screen along with nonsocial distractors while wearing Google Glass and the eye tracker. Faces were presented in three trials, during one of which children received feedback in the form of the correct classification. We employed hybrid human-labeling and computer vision-enabled methods for pupil tracking and world-gaze translation calibration. We analyzed the impact of gaze and emotion recognition features in a prediction task aiming to distinguish children with ASD from NC participants.

resultsGaze and emotion recognition patterns enabled the training of a classifier that distinguished ASD and NC groups. However, it was unable to significantly outperform other classifiers that used only age and gender features, suggesting that further work is necessary to disentangle these effects.

conclusionsAlthough wearable smart glasses show promise in identifying subtle differences in gaze tracking and emotion recognition patterns in children with and without ASD, the present form factor and data do not allow for these differences to be reliably exploited by machine learning systems. Resolving these challenges will be an important step toward continuous tracking of the ASD phenotype.

Indexed as

AdolescentAutism Spectrum DisorderChildEmotionsFemaleHumansMalePhenotypeSmart GlassesWearable Electronic Devicesartificial intelligenceautism spectrum disorderdigital therapyeye trackingmachine learningprecision healthtranslational medicinewearable technologies

Identifiers

PMID32319961
PMCPMC7203617
OpenAlexW3006292513

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.