Evidence map›Paper›PMID 27582341›Full record

ArticleJournal of medical Internet research2016

Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions.

Leif Boß, Dirk Lehr, Dorota Reis, Christiaan Vis, Heleen Riper, Matthias Berking, David Daniel Ebert

3 registry-linked trialsAbstract read
In one paragraph

Article in Journal of medical Internet research, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 3 registered trials, which are not on this map. Cited by 167 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
167citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04573465 nacompletednot on this mapstarted 2020, after this paper: background citation

Pilot Evaluation of Peer-support Coaching to Increase Adherence to Online Self-help for College Mental Health

TypeinterventionalSponsorUtah State UniversityRan2020 to 2021Enrolled236ConditionsTreatment AdherenceArmsPhone Coaching, Text Message Coaching, ACT Guide
NCT06246708 nacompletednot on this mapstarted 2024, after this paper: background citation

Cultural Adaptation of a Self-help App for Grieving Syrian Refugees in Switzerland. A Feasibility and Acceptability Pilot-RCT

TypeinterventionalSponsorUniversity of ZurichRan2024 to 2024Enrolled30ConditionsBereavementArmsSelf-help app with information for grieving Syrian Refugees, Wait-list
NCT06324695 nacompletednot on this mapstarted 2024, after this paper: background citation

DEVISE - Development and Evaluation of an Online Intervention to Reduce Self-stigma in People With Visible Chronic Skin Diseases: a Randomized Controlled Trial

TypeinterventionalSponsorUniversitätsklinikum Hamburg-EppendorfRan2024 to 2025Enrolled298ConditionsPsoriasis, Alopecia Areata, Hidradenitis Suppurativa, VitiligoArmsHautKompass
3 · Its place in the literature

Who cites it

167 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Trial
  10. Trial
  11. Trial
  12. Trial
  13. Trial
  14. Trial
  15. Trial
  16. A Three-Armed Randomized Controlled Trial to Evaluate the Effectiveness, Acceptance, and Negative Effects ofInternational journal of environmental research and public health · 2023
    Trial
  17. Trial
  18. Trial
  19. Trial
  20. Trial

107 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Leif BoßDivision of Online Health Training, Innovation Incubator, Leuphana University of Lueneburg, Lueneburg, Germany. boss@leuphana.de.ORCID 0000-0001-9012-0839
David Daniel EbertORCID 0000-0001-6820-0146

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe perspective of users should be taken into account in the evaluation of Web-based health interventions. Assessing the users' satisfaction with the intervention they receive could enhance the evidence for the intervention effects. Thus, there is a need for valid and reliable measures to assess satisfaction with Web-based health interventions.

objectiveThe objective of this study was to analyze the reliability, factorial structure, and construct validity of the Client Satisfaction Questionnaire adapted to Internet-based interventions (CSQ-I).

methodsThe psychometric quality of the CSQ-I was analyzed in user samples from 2 separate randomized controlled trials evaluating Web-based health interventions, one from a depression prevention intervention (sample 1, N=174) and the other from a stress management intervention (sample 2, N=111). At first, the underlying measurement model of the CSQ-I was analyzed to determine the internal consistency. The factorial structure of the scale and the measurement invariance across groups were tested by multigroup confirmatory factor analyses. Additionally, the construct validity of the scale was examined by comparing satisfaction scores with the primary clinical outcome.

resultsMultigroup confirmatory analyses on the scale yielded a one-factorial structure with a good fit (root-mean-square error of approximation =.09, comparative fit index =.96, standardized root-mean-square residual =.05) that showed partial strong invariance across the 2 samples. The scale showed very good reliability, indicated by McDonald omegas of .95 in sample 1 and .93 in sample 2. Significant correlations with change in depressive symptoms (r=-.35, P<.001) and perceived stress (r=-.48, P<.001) demonstrated the construct validity of the scale.

conclusionsThe proven internal consistency, factorial structure, and construct validity of the CSQ-I indicate a good overall psychometric quality of the measure to assess the user's general satisfaction with Web-based interventions for depression and stress management. Multigroup analyses indicate its robustness across different samples. Thus, the CSQ-I seems to be a suitable measure to consider the user's perspective in the overall evaluation of Web-based health interventions.

Indexed as

Patient SatisfactionPersonal SatisfactionAdultAgedFemaleHumansInternetMalePsychometricsRandomized Controlled Trials as TopicReproducibility of ResultsSurveys and Questionnairesclinical effectivenessevaluationInternetmental healthpersonal satisfaction

Identifiers

PMID27582341
PMCPMC5023944

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.