Evidence map›Paper›PMID 38774052›Full record

ArticleFrontiers in public health2024

A mixed methods analysis of existing assessment and evaluation tools (AETs) for mental health applications.

Sarah Ahmed, Chris Trimmer, Wishah Khan, Andrew Tuck, Terri Rodak, Branka Agic, Kelsey Kavic, Sapna Wadhawan, Maureen Abbott, M Omair Husain and 4 more

Abstract read
In one paragraph

Article in Frontiers in public health, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Sarah AhmedCentre for Addiction and Mental Health (CAMH), Toronto, ON, Canada.
Chris TrimmerCentre for Addiction and Mental Health (CAMH), Toronto, ON, Canada.
Wishah KhanCentre for Addiction and Mental Health (CAMH), Toronto, ON, Canada.
Andrew TuckCentre for Addiction and Mental Health (CAMH), Toronto, ON, Canada.
Terri RodakCentre for Addiction and Mental Health (CAMH), Toronto, ON, Canada.
Branka AgicCentre for Addiction and Mental Health (CAMH), Toronto, ON, Canada.
Kelsey KavicMental Health Commission of Canada, Ottawa, ON, Canada.
Sapna WadhawanMental Health Commission of Canada, Ottawa, ON, Canada.
Maureen AbbottMental Health Commission of Canada, Ottawa, ON, Canada.
M Omair HusainCentre for Addiction and Mental Health (CAMH), Toronto, ON, Canada.
M Ishrat HusainCentre for Addiction and Mental Health (CAMH), Toronto, ON, Canada.
Kwame McKenzieCentre for Addiction and Mental Health (CAMH), Toronto, ON, Canada.
Yuri QuintanaHarvard Medical School, Harvard University, Boston, MA, United States.
Farooq NaeemCentre for Addiction and Mental Health (CAMH), Toronto, ON, Canada.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Introduction: Mental health Applications (MH Apps) can potentially improve access to high-quality mental health care. However, the recent rapid expansion of MH Apps has created growing concern regarding their safety and effectiveness, leading to the development of AETs (Assessment and Evaluation Tools) to help guide users. This article provides a critical, mixed methods analysis of existing AETs for MH Apps by reviewing the criteria used to evaluate MH Apps and assessing their effectiveness as evaluation tools. Methods: To identify relevant AETs, gray and scholarly literature were located through stakeholder consultation, Internet searching via Google and a literature search of bibliographic databases Medline, APA PsycInfo, and LISTA. Materials in English that provided a tool or method to evaluate MH Apps and were published from January 1, 2000, to January 26, 2021 were considered for inclusion. Results: Thirteen relevant AETs targeted for MH Apps met the inclusion criteria. The qualitative analysis of AETs and their evaluation criteria revealed that despite purporting to focus on MH Apps, the included AETs did not contain criteria that made them more specific to MH Apps than general health applications. There appeared to be very little agreed-upon terminology in this field, and the focus of selection criteria in AETs is often IT-related, with a lesser focus on clinical issues, equity, and scientific evidence. The quality of AETs was quantitatively assessed using the AGREE II, a standardized tool for evaluating assessment guidelines. Three out of 13 AETs were deemed 'recommended' using the AGREE II. Discussion: There is a need for further improvements to existing AETs. To realize the full potential of MH Apps and reduce stakeholders' concerns, AETs must be developed within the current laws and governmental health policies, be specific to mental health, be feasible to implement and be supported by rigorous research methodology, medical education, and public awareness.

Indexed as

Mobile ApplicationsHumansMental HealthMental Health Servicesdigital healthevaluationguidelinesmental healthmobile apps

Identifiers

PMID38774052
PMCPMC11106355

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.