Evidence map›Paper›PMID 39846013›Full record

ArticleMethodsX2025

Reinventing the evaluation wheel: COGwheel's co-designed digital innovation using the Qualtrics heat map.

Mel Giugni, Alyssa R Morse, Scott J Fitzpatrick, Heather Lamb, Amelia Gulliver, Alison L Calear, Vida Bliokas, Fiona Shand, Cassandra Chakouch, Bronwen Edwards and 14 more

Abstract read
PubMed Full text at PMC Publisher
In one paragraph

Article in MethodsX, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

24 authors.

Mel GiugniCentre for Mental Health Research, The Australian National University, Canberra, Australia.
Alyssa R MorseCentre for Mental Health Research, The Australian National University, Canberra, Australia.
Scott J FitzpatrickCentre for Mental Health Research, The Australian National University, Canberra, Australia.
Heather LambCentre for Mental Health Research, The Australian National University, Canberra, Australia.
Amelia GulliverCentre for Mental Health Research, The Australian National University, Canberra, Australia.
Alison L CalearCentre for Mental Health Research, The Australian National University, Canberra, Australia.
Vida BliokasSchool of Psychology, University of Wollongong, Wollongong, Australia.
Fiona ShandBlack Dog Institute, University of New South Wales, Sydney, Australia.
Cassandra ChakouchBlack Dog Institute, University of New South Wales, Sydney, Australia.
Bronwen EdwardsRoses in the Ocean, Brisbane, Australia.
Louise A EllisAustralian Institute of Health Innovation, Macquarie University, Sydney, Australia.
Purity GojACT Health Directorate, Canberra, Australia.
Melissa LeeACT Health Directorate, Canberra, Australia.
Merkitta MainSouth Western Sydney Local Health District, Sydney, Australia.
Benn MillerTowards Zero Suicides Initiatives, South Western Sydney Local Health District, Sydney, Australia.
Glenda WebbTowards Zero Suicides Initiatives, South Western Sydney Local Health District, Sydney, Australia.
Ginny SargentPopulation Health Exchange, The Australian National University, Australian Capital Territory, Australia.
Helen SkeatPopulation Health Exchange, The Australian National University, Australian Capital Territory, Australia.
Kelly StewartSonder, Adelaide, Australia.
Kelly WellsAdelaide Primary Health Network, Adelaide, Australia.
Carolyn McKayAdelaide Primary Health Network, Adelaide, Australia.
Stride Safe Space TeamStride, Sydney, Australia (For details of the Stride Safe Space Team, visit https://stride.com.au).
Erin StewartIndependent Consultant, Canberra, Australia.
Michelle BanfieldCentre for Mental Health Research, The Australian National University, Canberra, Australia.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

The involvement of service-users, clinicians, and other health service end-users is recognised as an essential part of health and medical research. This collaborative approach can significantly contribute to methodological advancements including the development of research instruments and measures that ensure their suitability for research participants. The current paper details the co-design, development and implementation of the novel, digitised COGwheel (Co-designed Outcomes for Guests Evaluation Wheel). COGwheel is a brief, user-friendly digital instrument based on the Evaluation Wheel. It uses Qualtrics' heatmap function to maximise ease of use for participants, alongside secure data collection, ease of analysis and simple interpretation. COGwheel was developed to evaluate peer-led, non-clinical 'safe spaces' for people experiencing emotional distress and/or suicidal crisis. However, the model has broader potential to be applied to other types of measures where it is essential to prioritise participant accessibility, comprehension, and ease of use. •COGwheel is a brief, user-friendly digital instrument based on the Evaluation Wheel (Evaluation Support Scotland), that was co-designed by people with lived experience of suicidal crisis or distress.•COGwheel addresses a significant gap in current evaluation methods, providing a novel digital instrument that also enhances accessibility and relevance for both participants and researchers.•Utilising Qualtrics' heatmap function, COGwheel enhances meaningful participant engagement and streamlines data collection, ensuring data security, interpretability, and efficient analysis.

Indexed as

Co-designCo-evaluationCOGwheel – Co-designed Outcomes for Guests Evaluation WheelConsumer experienceEmotional distressEvaluation wheelOutcome measureStrength-based assessmentSuicide

Identifiers

PMID39846013
PMCPMC11751559

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.