Evidence map›Paper›PMID 27363519›Full record

SynthesisJournal of medical Internet research2016

Evaluation Methods for Assessing Users' Psychological Experiences of Web-Based Psychosocial Interventions: A Systematic Review.

Jacqueline Susan Feather, Moira Howson, Linda Ritchie, Philip D Carter, David Tudor Parry, Jane Koziol-McLain

Abstract readSystematic Review
In one paragraph

Synthesis in Journal of medical Internet research, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Digital Patient Experience: Umbrella Systematic Review.Journal of medical Internet research · 2022
    Pooled it
  3. Trial
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Jacqueline Susan FeatherCentre for Interdisciplinary Trauma Research, Department of Psychology, Auckland University of Technology, Auckland, New Zealand. jackie.feather@aut.ac.nz.ORCID 0000-0002-3448-0191
David Tudor ParryORCID 0000-0003-2812-047X
Jane Koziol-McLainORCID 0000-0003-3453-023X

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe use of Web-based interventions to deliver mental health and behavior change programs is increasingly popular. They are cost-effective, accessible, and generally effective. Often these interventions concern psychologically sensitive and challenging issues, such as depression or anxiety. The process by which a person receives and experiences therapy is important to understanding therapeutic process and outcomes. While the experience of the patient or client in traditional face-to-face therapy has been evaluated in a number of ways, there appeared to be a gap in the evaluation of patient experiences of therapeutic interventions delivered online. Evaluation of Web-based artifacts has focused either on evaluation of experience from a computer Web-design perspective through usability testing or on evaluation of treatment effectiveness. Neither of these methods focuses on the psychological experience of the person while engaged in the therapeutic process.

objectiveThis study aimed to investigate what methods, if any, have been used to evaluate the in situ psychological experience of users of Web-based self-help psychosocial interventions.

methodsA systematic literature review was undertaken of interdisciplinary databases with a focus on health and computer sciences. Studies that met a predetermined search protocol were included.

resultsAmong 21 studies identified that examined psychological experience of the user, only 1 study collected user experience in situ. The most common method of understanding users' experience was through semistructured interviews conducted posttreatment or questionnaires administrated at the end of an intervention session. The questionnaires were usually based on standardized tools used to assess user experience with traditional face-to-face treatment.

conclusionsThere is a lack of methods specified in the literature to evaluate the interface between Web-based mental health or behavior change artifacts and users. Main limitations in the research were the nascency of the topic and cross-disciplinary nature of the field. There is a need to develop and deliver methods of understanding users' psychological experiences while using an intervention.

Indexed as

InternetOutcome and Process Assessment, Health CareTelemedicineAnxietyDepressionHumansMental DisordersMental HealthPsychotherapySurveys and QuestionnairesTreatment OutcomeUser-Computer Interfacecomputer systemseHealtheHealth evaluationmedical informatics applicationspsychology, clinicalusabilityusability testingWeb-basedweb browser

Identifiers

PMID27363519
PMCPMC4945819

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.