Evidence map›Paper›PMID 31631470›Full record

ArticleJournal of evaluation in clinical practice2020

Costs of preparing to implement a virtual reality job interview training programme in a community mental health agency: A budget impact analysis.

Matthew J Smith, Andrea K Graham, Rachel Sax, E-Shawn Spencer, Lisa A Razzano, Justin D Smith, Neil Jordan

Open access · bronzeAbstract read
In one paragraph

Article in Journal of evaluation in clinical practice, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 1 pooled it
2.3field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 1 synthesis or guideline pooled it, 18 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Implementation Preparation Costs of Virtual Interview Training in Pre-Employment Transition Services: A Budget Impact Analysis.Journal of special education technology : a publication of Utah State University, the Association for Special Education Technology, and the Technology and Media Division of the Council for Exceptional Children · 2024
    Article
  4. Article
  5. Article
  6. Impact of Virtual Reality Cognitive and Motor Exercises on Brain Health.International journal of environmental research and public health · 2023
    Review
  7. Article
  8. Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 4 institutions in 1 country.

Matthew J SmithSchool of Social Work, University of Michigan, Ann Arbor, Michigan.ORCID https://orcid.org/0000-0002-0079-1477
Andrea K GrahamDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois.
Rachel SaxDepartment of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois.
E-Shawn SpencerThresholds Inc, Chicago, Illinois.
Lisa A RazzanoThresholds Inc, Chicago, Illinois.
Justin D SmithDepartment of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois.
Neil JordanDepartment of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois.
Northwestern University · USThresholds · USUniversity of Illinois Chicago · USUniversity of Michigan · US

Funding

Virtual Reality Job Interview Training to Enhance Supported Employment for Adults with SMIR01MH110524 · NIMH · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI SMITH, MATTHEW JAMES · 2016 to 2019
$1.8M
Testing Intervention Strategies for Addressing Obesity and Binge EatingK01DK116925 · NIDDK · NORTHWESTERN UNIVERSITY AT CHICAGO · PI GRAHAM, ANDREA KASS · 2018 to 2022
$799k
Analysis of Behavioral Interventions for Pediatric ObesityF32HD089586 · NICHD · UNIVERSITY OF CHICAGO · PI GRAHAM, ANDREA KASS · 2016 to 2017
$106k
NICHD NIH HHS F32 HD089586NIDDK NIH HHS K01 DK116925NIMH NIH HHS R01 MH110524
6 · The paper itself

Abstract

RATIONAL, AIMS AND

objectivesIndividual Placement and Support (IPS) is an evidence based strategy for facilitating employment among adults with severe mental illness (SMI) where staff may lead mock job interviews to prepare clients for real-world interviews (a method with limited scalability and cost effectiveness). A virtual reality job interview training program (VR-JIT)-delivered via the internet-has demonstrated efficacy for increasing employment among adults with SMI. Now, VR-JIT is being implemented with a community mental health agency (CMHA) and evaluated for its effectiveness within IPS. This study is a budget impact analysis, evaluating the costs of preparing a CMHA to implement VR-JIT.

methodImplementation preparation occurred over 7 months from October 1, 2016 to April 30, 2017. CMHA staff (n = 15) and external research partners (n = 3) tracked their hours completing implementation preparation activities. Salaries plus a 28% fringe benefit rate were used to derive a per-hour salary amount for each individual and applied to each activity. Non-labor equipment costs were obtained from purchase receipts. A budget impact analysis evaluated the expenditures associated with preparing the CMHA to implement VRJIT.

resultsThe total implementation preparation costs equaled $25,482. Labor costs equaled $22,882 and non-labor costs equaled $2,600. In total, 655 person-hours were spent preparing for VR-JIT implementation (e.g., preparing lab space, training, and supervising operations).

conclusionsThis study presents an initial evaluation of the budget impact of preparing to implement VR-JIT in a CMHA. Cost considerations for future implementation preparation will be discussed. Given that the cost to prepare to implement an intervention can hinder its adoption, results provide an important analysis for decision-makers that may enhance uptake. Future work will determine the cost-effectiveness of VR-JIT implemented within IPS. This study is registered at http://clinicaltrials.gov, NCT = 03049813, "Virtual Reality Job Interview Training: An Enhancement to Supported Employment in Severe Mental Illness."

Indexed as

Mental DisordersVirtual RealityAdultEmploymentHumansInservice TrainingMental Healthbudget impact analysiscommunity mental healthhealth economicsimplementation costvirtual reality job interview training

Identifiers

PMID31631470
PMCPMC7167372
OpenAlexW2981612230

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.