Evidence map›Paper›PMID 42202278›Full record

ArticleJournal of medical Internet research2026

Detection of Microbehavior Intervals for Predicting Mental Health: Clinically Relevant and Advanced Multimodal Temporal Analysis.

Sapir Gershov, Charlotte E Hilberdink, Yiwen Zhao, Sarah B Birnbaum, Victoria Mueller, Stephen P Wall, Katharina Schultebraucks

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Sapir GershovDepartment of Psychiatry, Grossman School of Medicine, New York University, New York, NY, United States.ORCID https://orcid.org/0000-0003-0907-4367
Charlotte E HilberdinkDepartment of Psychiatry, Grossman School of Medicine, New York University, New York, NY, United States.ORCID https://orcid.org/0000-0003-4204-5920
Yiwen ZhaoDepartment of Psychiatry, Grossman School of Medicine, New York University, New York, NY, United States.ORCID https://orcid.org/0009-0001-9376-8689
Sarah B BirnbaumDepartment of Psychiatry, Grossman School of Medicine, New York University, New York, NY, United States.ORCID https://orcid.org/0009-0001-4563-0124
Victoria MuellerDepartment of Psychiatry, Grossman School of Medicine, New York University, New York, NY, United States.ORCID https://orcid.org/0009-0005-2913-7718
Stephen P WallDepartment of Emergency Medicine, Grossman School of Medicine, New York University, New York, NY, United States.ORCID https://orcid.org/0000-0003-3965-5074
Katharina SchultebraucksDepartment of Psychiatry, Grossman School of Medicine, New York University, New York, NY, United States.ORCID https://orcid.org/0000-0001-5085-8249

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundHealth care workers (HCWs) face sustained psychological demands that place them at heightened risk for burnout and posttraumatic stress disorder (PTSD). However, assessing psychological distress in this population remains challenging because of stigma, underreporting, and the limitations of self-report tools. Although nonverbal behaviors such as facial expressions and gaze hold diagnostic promise, most approaches overlook the fine-grained, temporal fluctuations in these signals. In this study, we focused on microbehavior intervals-brief, involuntary changes in multimodal nonverbal signals-that emerge during emotion-eliciting interviews.

objectiveThis study aimed to determine whether microbehavior intervals improve the discrimination of psychological distress profiles among HCWs with symptoms of burnout and PTSD.

methodsHCWs participated in a semistructured interview that included 5 work-related, emotionally charged questions and that was recorded via Webex (online video platform). Participants also completed validated questionnaires for burnout (Maslach Burnout Inventory General Survey 9-item) and PTSD (PTSD checklist for Diagnostic and Statistical Manual, 5th edition). Recordings were analyzed with computer vision models to generate time-series data of facial expressions, head movement, gaze, body posture, and hand gestures. An unsupervised anomaly detection model (MOMENT [a Family of Open Time-Series Foundation Models]) isolated microbehavior intervals without requiring manual labels. Features derived from these intervals were used to train a deep learning classifier that predicted 4 symptom classes of psychological distress: "moderate-severe burnout," "subthreshold-provisional PTSD," "burnout+PTSD," and "resilient." We conducted an ablation study by systematically removing one behavioral data stream at a time. Finally, we conducted an explainability analysis to characterize the features driving model predictions.

resultsWe analyzed 258 interview recordings from 151 HCWs. Per interview, an average of 19.65 (SD 6.01) microbehavior intervals were detected, each lasting an average of 1.31 (SD 1.10) seconds. The classifier demonstrated robust performance across classes, achieving a macro- F

conclusionsFocusing on microbehavior intervals yields a scalable, interpretable, and annotation-free framework for detecting psychological distress from nonverbal signals. By moving from whole-video features to fine-grained multimodal temporal modeling, we successfully captured subtle, involuntary fluctuations in nonverbal responses to emotion-eliciting questions. This multimodal approach enables an objective, robust, and explainable assessment of psychological distress and offers a promising complement to conventional psychometric assessments.

Indexed as

Burnout, ProfessionalHealth PersonnelMental HealthStress Disorders, Post-TraumaticAdultFacial ExpressionFemaleHumansMaleMiddle Agedanomaly detectionburnouthealth care workersmultimodalposttraumatic stress disorderPTSD

Identifiers

PMID42202278
PMCPMC13254507

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.