Evidence map›Paper›PMID 23768141›Full record

ArticleBMC health services research2013

Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P).

Clazien Bouwmans, Kim De Jong, Reinier Timman, Moniek Zijlstra-Vlasveld, Christina Van der Feltz-Cornelis, Siok Tan Swan, Leona Hakkaart-van Roijen

4 registry-linked trialsAbstract readValidation Study
In one paragraph

Article in BMC health services research, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 4 registered trials, which are not on this map. Cited by 267 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
267citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03473535 naunknown statusnot on this mapstarted 2020, after this paper: background citation

The BEACON Study: Protocol for a Pilot Randomized Controlled Trial of Smartphone-assisted Problem Solving Therapy in Men Who Present With Intentional Self-harm to Emergency Departments in Ontario

TypeinterventionalSponsorUniversity of OttawaRan2020 to 2024Enrolled100ConditionsIntentional Self-Harm, SuicideArmsBEACON + Problem Solving Therapy, Problem-Solving Therapy
NCT04237714 naunknown statusnot on this mapstarted 2020, after this paper: background citation

Cultural Adaptation of the Smile is Fun Program for the Treatment of Depression in the Ecuadorian Public Health Care System: A Study Protocol for a Randomized Controlled Trial

TypeinterventionalSponsorUniversity of ValenciaRan2020 to 2021Enrolled153ConditionsDepressionArmsSmiling is fun
NCT06316804 naactive not recruitingnot on this mapstarted 2024, after this paper: background citation

Design and Feasibility of a Mobile Mental Health Stigma Reduction Intervention Among Black Adults With Depression and Anxiety

TypeinterventionalSponsorMassachusetts General HospitalRan2024 to 2027Enrolled90ConditionsAnxiety, Depression, Health Knowledge, Attitudes, Practice, StigmatizationArmsVideo Intervention 1, Video Intervention 2, Video Intervention 3
NCT07636122 nanot yet recruitingnot on this mapstarted 2026, after this paper: background citation

Internet-delivered Psychological Treatment of Functional Gastrointestinal Disorders - A Danish Feasibility Study

TypeinterventionalSponsorUniversity of AarhusRan2026 to 2027Enrolled30ConditionsFunctional Gastrointestinal Disorders (FGID)ArmsI-CBT
3 · Its place in the literature

Who cites it

267 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Trial
  10. Economic evaluation of intensive home treatment in comparison to care as usual alongside a randomised controlled trial.The European journal of health economics : HEPAC : health economics in prevention and care · 2025
    Trial
  11. Trial
  12. Trial
  13. Trial
  14. Trial
  15. Trial
  16. Functional improvement by behavioural activation for depressed older adults.European psychiatry : the journal of the Association of European Psychiatrists · 2023
    Trial
  17. Trial
  18. Trial
  19. Trial
  20. Trial

207 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Clazien BouwmansInstitute for Medical Technology Assessment, Erasmus University Rotterdam, PO Box 1738, 3000 DR Rotterdam, The Netherlands. bouwmans@bmg.eur.nl
Kim De Jong
Reinier Timman
Moniek Zijlstra-Vlasveld
Christina Van der Feltz-Cornelis
Siok Tan Swan
Leona Hakkaart-van Roijen

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundPatient self-report allows collecting comprehensive data for the purpose of performing economic evaluations. The aim of the current study was to assess the feasibility, reliability and a part of the construct validity of a commonly applied questionnaire on healthcare utilization and productivity losses in patients with a psychiatric disorder (TiC-P).

methodsData were derived alongside two clinical trials performed in the Netherlands in patients with mental health problems. The response rate, average time of filling out the questionnaire and proportions of missing values were used as indicators of feasibility of the questionnaire. Test-retest analyses were performed including Cohen's kappa and intra class correlation coefficients to assess reliability of the data. The construct validity was assessed by comparing patient reported data on contacts with psychotherapists and reported data on long-term absence from work with data derived from registries.

resultsThe response rate was 72%. The mean time needed for filling out the first TiC-P was 9.4 minutes. The time needed for filling out the questionnaire was 2.3 minutes less for follow up measurements. Proportions of missing values were limited (< 2.4%) except for medication for which in 10% of the cases costs could not be calculated. Cohen's kappa was satisfactory to almost perfect for most items related to healthcare consumption and satisfactory for items on absence from work and presenteeism. Comparable results were shown by the ICCs on variables measuring volumes of medical consumption and productivity losses indicating good reliability of the questionnaire.Absolute agreement between patient-reported data and data derived from medical registrations of the psychotherapists was satisfactory. Accepting a margin of +/- seven days, the agreement on reported and registered data on long-term absence from work was satisfactory. The validity of self-reported data using the TiC-P is promising.

conclusionsThe results indicate that the TiC-P is a feasible and reliable instrument for collecting data on medical consumption and productivity losses in patients with mild to moderate mental health problems. Additionally, the construct validity of questions related to contacts with psychotherapist and long-term absence from work was satisfactory.

Indexed as

Quality of LifeAbsenteeismAdultDelivery of Health CareEfficiencyFeasibility StudiesFemaleHealth Care CostsHumansMaleMental DisordersMiddle AgedNetherlandsPsychometricsReproducibility of ResultsSurveys and Questionnaires

Identifiers

PMID23768141
PMCPMC3694473

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.