Evidence map›Paper›PMID 36127689›Full record

ArticleBMC health services research2022

Enhancing the quality of cognitive behavioral therapy in community mental health through artificial intelligence generated fidelity feedback (Project AFFECT): a study protocol.

Torrey A Creed, Leah Salama, Roisin Slevin, Michael Tanana, Zac Imel, Shrikanth Narayanan, David C Atkins

Registry-linked trialOpen access · goldAbstract read
In one paragraph

Article in BMC health services research, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT05340738 (Enhancing the Quality of CBT in Community Mental Health Through AI-generated Fidelity Feedback), which is not on this map. Cited by 18 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
18citing papers in PubMed, 1 pooled it
5.3field-weighted citation impact, top 4% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05340738 nacompletednot on this mapstarted 2023, after this paper: background citation

Enhancing the Quality of CBT in Community Mental Health Through AI-generated Fidelity Feedback

TypeinterventionalSponsorUniversity of PennsylvaniaRan2023 to 2026Enrolled449ConditionsCognitive Behavioral Therapy, TherapyArmsLyssnCBT
3 · Its place in the literature

Who cites it

18 citing papers in PubMed, 1 synthesis or guideline pooled it, 43 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Characterizing Fidelity Monitoring Practices in Community Behavioral Health Care.The journal of behavioral health services & research · 2026
    Article
  10. Article
  11. Review
  12. Article
  13. Article
  14. Article
  15. Review
  16. Observational
  17. Article
  18. The Future of Psychotherapy Training.Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 5 institutions in 1 country.

Torrey A CreedPerelman School of Medicine, University of Pennsylvania, Philadelphia, USA.
Leah SalamaPerelman School of Medicine, University of Pennsylvania, Philadelphia, USA.
Roisin SlevinLyssn.io, Inc, Seattle, USA.
Michael TananaLyssn.io, Inc, Seattle, USA.
Zac ImelLyssn.io, Inc, Seattle, USA.
Shrikanth NarayananLyssn.io, Inc, Seattle, USA.
David C AtkinsLyssn.io, Inc, Seattle, USA. datkins@uw.edu.ORCID http://orcid.org/0000-0002-5781-9880
Seattle University · USLynn University · USUniversity of Pennsylvania · USUniversity of Southern California · USUniversity of Utah · US

Funding

Enhancing the quality of CBT in community mental health through AI-generated fidelity feedbackR42MH128101 · NIMH · LYSSN.IO, INC. · PI ATKINS, DAVID CHARLES, CREED, TORREY A. · 2021 to 2024
$2.6M
NIMH NIH HHS R42 MH128101NIMH NIH HHS R42MH128101
6 · The paper itself

Abstract

backgroundEach year, millions of Americans receive evidence-based psychotherapies (EBPs) like cognitive behavioral therapy (CBT) for the treatment of mental and behavioral health problems. Yet, at present, there is no scalable method for evaluating the quality of psychotherapy services, leaving EBP quality and effectiveness largely unmeasured and unknown. Project AFFECT will develop and evaluate an AI-based software system to automatically estimate CBT fidelity from a recording of a CBT session. Project AFFECT is an NIMH-funded research partnership between the Penn Collaborative for CBT and Implementation Science and Lyssn.io, Inc. ("Lyssn") a start-up developing AI-based technologies that are objective, scalable, and cost efficient, to support training, supervision, and quality assurance of EBPs. Lyssn provides HIPAA-compliant, cloud-based software for secure recording, sharing, and reviewing of therapy sessions, which includes AI-generated metrics for CBT. The proposed tool will build from and be integrated into this core platform.

methodsPhase I will work from an existing software prototype to develop a LyssnCBT user interface geared to the needs of community mental health (CMH) agencies. Core activities include a user-centered design focus group and interviews with community mental health therapists, supervisors, and administrators to inform the design and development of LyssnCBT. LyssnCBT will be evaluated for usability and implementation readiness in a final stage of Phase I. Phase II will conduct a stepped-wedge, hybrid implementation-effectiveness randomized trial (N = 1,875 clients) to evaluate the effectiveness of LyssnCBT to improve therapist CBT skills and client outcomes and reduce client drop-out. Analyses will also examine the hypothesized mechanism of action underlying LyssnCBT. DISCUSSION: Successful execution will provide automated, scalable CBT fidelity feedback for the first time ever, supporting high-quality training, supervision, and quality assurance, and providing a core technology foundation that could support the quality delivery of a range of EBPs in the future.

trial registrationClinicalTrials.gov; NCT05340738 ; approved 4/21/2022.

Indexed as

Artificial IntelligenceCognitive Behavioral TherapyFeedbackHumansMental HealthPsychotherapyUnited StatesArtificial intelligenceCognitive behavioral therapyCommunity mental healthCompetenceFidelityImplementation scienceSupervisionTechnologyTrainingUser-centered design

Identifiers

PMID36127689
PMCPMC9487132
OpenAlexW4296786061

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.