Evidence map›Paper›PMID 38037663›Full record

ArticleCEUR workshop proceedings2023

Comparison of Human Experts and AI in Predicting Autism from Facial Behavior.

Evangelos Sariyanidi, Casey J Zampella, Ellis DeJardin, John D Herrington, Robert T Schultz, Birkan Tunc

Open access · greenAbstract read
In one paragraph

Article in CEUR workshop proceedings, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed, 1 pooled it
0.9field-weighted citation impact, top 27% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 1 synthesis or guideline pooled it, 5 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Review
  4. Article
  5. Review
  6. Article
  7. Beyond FACS: Data-driven Facial Expression Dictionaries, with Application to Predicting Autism.Proceedings of the ... International Conference on Automatic Face and Gesture Recognition. IEEE International Conference on Automatic Face & Gesture Recognition · 2025
    Article
  8. Detecting Autism from Head Movements using Kinesics.Proceedings of the ... ACM International Conference on Multimodal Interaction. ICMI (Conference) · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 1 institution in 1 country.

Evangelos SariyanidiCenter for Autism Research, The Children's Hospital of Philadelphia, United States.
Casey J ZampellaCenter for Autism Research, The Children's Hospital of Philadelphia, United States.
Ellis DeJardinCenter for Autism Research, The Children's Hospital of Philadelphia, United States.
John D HerringtonCenter for Autism Research, The Children's Hospital of Philadelphia, United States.
Robert T SchultzCenter for Autism Research, The Children's Hospital of Philadelphia, United States.
Birkan TuncCenter for Autism Research, The Children's Hospital of Philadelphia, United States.
California University of Pennsylvania · US

Funding

The Intellectual and Developmental Disabilities Research Center (IDDRC) at CHOP/PennP50HD105354 · NICHD · CHILDREN'S HOSP OF PHILADELPHIA · PI ERIC D MARSH, ROBERT Thomas SCHULTZ · 2021 to 2026
$9.2M
A computer vision toolbox for computational analysis of nonverbal social communicationR01MH122599 · NIMH · CHILDREN'S HOSP OF PHILADELPHIA · PI Birkan Tunc · 2020 to 2026
$4.5M
Predicting Autism and Social Functioning from Computer Vision Analyses of Motor Synchrony During Dyadic InteractionsR01MH118327 · NIMH · CHILDREN'S HOSP OF PHILADELPHIA · PI SCHULTZ, ROBERT THOMAS · 2019 to 2023
$3.7M
Novel computer vision-based assessment of infant-caregiver synchrony as an early level II screening tool for autismR21HD102078 · NICHD · CHILDREN'S HOSP OF PHILADELPHIA · PI SCHULTZ, ROBERT THOMAS · 2019 to 2020
$484k
NICHD NIH HHS P50 HD105354NICHD NIH HHS R21 HD102078NIMH NIH HHS R01 MH118327NIMH NIH HHS R01 MH122599
6 · The paper itself

Abstract

Advances in computational behavior analysis via artificial intelligence (AI) promise to improve mental healthcare services by providing clinicians with tools to assist diagnosis or measurement of treatment outcomes. This potential has spurred an increasing number of studies in which automated pipelines predict diagnoses of mental health conditions. However, a fundamental question remains unanswered: How do the predictions of the AI algorithms correspond and compare with the predictions of humans? This is a critical question if AI technology is to be used as an assistive tool, because the utility of an AI algorithm would be negligible if it provides little information beyond what clinicians can readily infer. In this paper, we compare the performance of 19 human raters (8 autism experts and 11 non-experts) and that of an AI algorithm in terms of predicting autism diagnosis from short (3-minute) videos of

Indexed as

assistive healthcare technologiesautismdigital phenotyping

Identifiers

PMID38037663
PMCPMC10687770
OpenAlexW4389244588

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.