ArticleAdministration and policy in mental health2015
Blending Qualitative and Computational Linguistics Methods for Fidelity Assessment: Experience with the Familias Unidas Preventive Intervention.
Article in Administration and policy in mental health, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
19 citing papers in PubMed, 1 synthesis or guideline pooled it.
- Towards text mining therapeutic change: A systematic review of text-based methods for Therapeutic Change Process Research.PloS one · 2019Pooled it
- Capitalizing on natural language processing (NLP) to automate the evaluation of coach implementation fidelity in guided digital cognitive-behavioral therapy (GdCBT).Psychological medicine · 2025Trial
- An individually tailored family-centered intervention for pediatric obesity in primary care: study protocol of a randomized type II hybrid effectiveness-implementation trial (Raising Healthy Children study).Implementation science : IS · 2018Trial
- Factors associated with the implementation of the Familias Unidas intervention in a type 3 translational trial.Translational behavioral medicine · 2016Trial
- Common Elements Approaches to Implementation Research and Practice: Methods and Integration with Intervention Science.Global implementation research and applications · 2023Article
- Implementation methodology from a social systems informatics and engineering perspective applied to a parenting training program.Families, systems & health : the journal of collaborative family healthcare · 2021Article
- Sustainability planning in the US response to the opioid crisis: An examination using expert and text mining approaches.PloS one · 2021Article
- Measurement of sustainment of prevention programs and initiatives: the sustainment measurement system scale.Implementation science : IS · 2020Article
- Three Flavorings for a Soup to Cure what Ails Mental Health Services.Administration and policy in mental health · 2020Article
- Redesigning Implementation Measurement for Monitoring and Quality Improvement in Community Delivery Settings.The journal of primary prevention · 2019Article
- The Family Check-Up 4 Health (FCU4Health): Applying Implementation Science Frameworks to the Process of Adapting an Evidence-Based Parenting Program for Prevention of Pediatric Obesity and Excess Weight Gain in Primary Care.Frontiers in public health · 2018Article
- Accelerating Digital Mental Health Research From Early Design and Creation to Successful Implementation and Sustainment.Journal of medical Internet research · 2017Article
- Increasing the Delivery of Preventive Health Services in Public Education.American journal of preventive medicine · 2016Article
- Automatic classification of communication logs into implementation stages via text analysis.Implementation science : IS · 2016Article
- Human Subjects Protection and Technology in Prevention Science: Selected Opportunities and Challenges.Prevention science : the official journal of the Society for Prevention Research · 2016Article
- "It sounds like...": A natural language processing approach to detecting counselor reflections in motivational interviewing.Journal of counseling psychology · 2016Article
- Introduction. Special Issue Overview: Optimizing Mixed Methods for Implementation Research in Large Systems.Administration and policy in mental health · 2015Article
- A machine learning approach to improve implementation monitoring of family-based preventive interventions in primary care.Implementation research and practiceArticle
- Effectiveness and Efficiency of Observationally Assessing Fidelity to a Family-Centered Child Intervention: A Quasi-Experimental Study.Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53Observational
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
8 authors.
Funding
Abstract
Careful fidelity monitoring and feedback are critical to implementing effective interventions. A wide range of procedures exist to assess fidelity; most are derived from observational assessments (Schoenwald and Garland, Psycholog Assess 25:146-156, 2013). However, these fidelity measures are resource intensive for research teams in efficacy/effectiveness trials, and are often unattainable or unmanageable for the host organization to rate when the program is implemented on a large scale. We present a first step towards automated processing of linguistic patterns in fidelity monitoring of a behavioral intervention using an innovative mixed methods approach to fidelity assessment that uses rule-based, computational linguistics to overcome major resource burdens. Data come from an effectiveness trial of the Familias Unidas intervention, an evidence-based, family-centered preventive intervention found to be efficacious in reducing conduct problems, substance use and HIV sexual risk behaviors among Hispanic youth. This computational approach focuses on "joining," which measures the quality of the working alliance of the facilitator with the family. Quantitative assessments of reliability are provided. Kappa scores between a human rater and a machine rater for the new method for measuring joining reached 0.83. Early findings suggest that this approach can reduce the high cost of fidelity measurement and the time delay between fidelity assessment and feedback to facilitators; it also has the potential for improving the quality of intervention fidelity ratings.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.