Evidence map›Paper›PMID 27905909›Full record

ArticleBMC psychiatry2016

Development of a measure of model fidelity for mental health Crisis Resolution Teams.

Brynmor Lloyd-Evans, Gary R Bond, Torleif Ruud, Ada Ivanecka, Richard Gray, David Osborn, Fiona Nolan, Claire Henderson, Oliver Mason, Nicky Goater and 13 more

Abstract readEvaluation Study
In one paragraph

Article in BMC psychiatry, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 37 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
37citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

37 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Acute psychiatric care: approaches to increasing the range of services and improving access and quality of care.World psychiatry : official journal of the World Psychiatric Association (WPA) · 2022
    Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

23 authors.

Brynmor Lloyd-EvansDivision of Psychiatry, UCL, 149 Tottenham Court Road, London, W1T 7NF, UK. b.lloyd-evans@ucl.ac.uk.ORCID http://orcid.org/0000-0001-9866-788X
Gary R BondDepartment of Psychiatry, Dartmouth Psychiatric Research Center, Geisel School of Medicine at Dartmouth, Lebanon, NH, 03766, USA.
Torleif RuudDivision Mental Health Services, Akershus University Hospital, Lørenskog, Norway.
Ada IvaneckaMental Health Sciences Department, University of the West of England, Coldharbour Lane, Bristol, BS16 1QY, UK.
Richard GrayMental Health Sciences Department, University of the West of England, Coldharbour Lane, Bristol, BS16 1QY, UK.
David OsbornDivision of Psychiatry, UCL, 149 Tottenham Court Road, London, W1T 7NF, UK.
Fiona NolanResearch Department of Clinical, Education and Health Psychology, University College London Gower Street, London, WC1E 6BT, UK.
Claire HendersonInstitute of Psychiatry, Psychology and Neuroscience, Kings College London, 16 De Crespigny Park, London, SE5 8AF, UK.
Oliver MasonResearch Department of Clinical, Education and Health Psychology, University College London Gower Street, London, WC1E 6BT, UK.
Nicky GoaterWest London Mental Health NHS Trust, Uxbridge Road, Southall, London, UB1 3EU, UK.
Kathleen KellyOxfordshire Healthcare NHS Foundation Trust, Barnes Unit, John Radcliffe Hospital, Oxford, OX3 9DU, UK.
Gareth AmblerDepartment of Statistical Science, UCL, Gower Street, London, WC1E 6BT, UK.
Nicola MorantDivision of Psychiatry, UCL, 149 Tottenham Court Road, London, W1T 7NF, UK.
Steve OnyettOnyett Entero Ltd, care of University of the West of England, Health and Life Sciences Coldharbour Ln, Bristol, BS16 1QY, UK.
Danielle LambDivision of Psychiatry, UCL, 149 Tottenham Court Road, London, W1T 7NF, UK.
Sarah FahmyDivision of Psychiatry, UCL, 149 Tottenham Court Road, London, W1T 7NF, UK.
Ellie BrownMental Health Sciences Department, University of the West of England, Coldharbour Lane, Bristol, BS16 1QY, UK.
Beth PatersonDivision of Psychiatry, UCL, 149 Tottenham Court Road, London, W1T 7NF, UK.
Angela SweeneyDivision of Psychiatry, UCL, 149 Tottenham Court Road, London, W1T 7NF, UK.
David HindleDivision of Psychiatry, UCL, 149 Tottenham Court Road, London, W1T 7NF, UK.
Kate FullartonDivision of Psychiatry, UCL, 149 Tottenham Court Road, London, W1T 7NF, UK.
Johanna FrerichsDivision of Psychiatry, UCL, 149 Tottenham Court Road, London, W1T 7NF, UK.
Sonia JohnsonDivision of Psychiatry, UCL, 149 Tottenham Court Road, London, W1T 7NF, UK.

Funding

Department of Health RP-PG-0109-10078
6 · The paper itself

Abstract

backgroundCrisis Resolution Teams (CRTs) provide short-term intensive home treatment to people experiencing mental health crisis. Trial evidence suggests CRTs can be effective at reducing hospital admissions and increasing satisfaction with acute care. When scaled up to national level however, CRT implementation and outcomes have been variable. We aimed to develop and test a fidelity scale to assess adherence to a model of best practice for CRTs, based on best available evidence.

methodsA concept mapping process was used to develop a CRT fidelity scale. Participants (n = 68) from a range of stakeholder groups prioritised and grouped statements (n = 72) about important components of the CRT model, generated from a literature review, national survey and qualitative interviews. These data were analysed using Ariadne software and the resultant cluster solution informed item selection for a CRT fidelity scale. Operational criteria and scoring anchor points were developed for each item. The CORE CRT fidelity scale was then piloted in 75 CRTs in the UK to assess the range of scores achieved and feasibility for use in a 1-day fidelity review process. Trained reviewers (n = 16) rated CRT service fidelity in a vignette exercise to test the scale's inter-rater reliability.

resultsThere were high levels of agreement within and between stakeholder groups regarding the most important components of the CRT model. A 39-item measure of CRT model fidelity was developed. Piloting indicated that the scale was feasible for use to assess CRT model fidelity and had good face validity. The wide range of item scores and total scores across CRT services in the pilot demonstrate the measure can distinguish lower and higher fidelity services. Moderately good inter-rater reliability was found, with an estimated correlation between individual ratings of 0.65 (95% CI: 0.54 to 0.76).

conclusionsThe CORE CRT Fidelity Scale has been developed through a rigorous and systematic process. Promising initial testing indicates its value in assessing adherence to a model of CRT best practice and to support service improvement monitoring and planning. Further research is required to establish its psychometric properties and international applicability.

Indexed as

Crisis InterventionHumansMental DisordersMental HealthMental Health ServicesPsychometricsQuality Indicators, Health CareReproducibility of ResultsSurveys and QuestionnairesAcute careCrisis Resolution TeamFidelityImplementationMental health services

Identifiers

PMID27905909
PMCPMC5133753

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.