Evidence map›Paper›PMID 25365169›Full record

Trial reportPloS one2014

The effect of including an opt-out option in discrete choice experiments.

Jorien Veldwijk, Mattijs S Lambooij, Esther W de Bekker-Grob, Henriëtte A Smit, G Ardine de Wit

Registry-linked trialAbstract readMulticenter StudyRandomized Controlled Trial
In one paragraph

Trial report in PloS one, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT05449561 (Beyond Efficacy- Eliciting Preference for Face-to-face and Internet-based Psychotherapy Among People with Depression), which is not on this map. Cited by 110 papers, 7 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
110citing papers in PubMed, 7 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05449561 completednot on this mapstarted 2022, after this paper: background citation

Beyond Efficacy- Eliciting Preference for Face-to-face and Internet-based Psychotherapy Among People with Depression: Using Discrete Choice Experiment to Advance Future Service Implementation

TypeobservationalSponsorChinese University of Hong KongRan2022 to 2023Enrolled20ConditionsDepression
3 · Its place in the literature

Who cites it

110 citing papers in PubMed, 7 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Preferences for Genetic Testing to Predict the Risk of Developing Hereditary Cancer: A Systematic Review of Discrete Choice Experiments.Medical decision making : an international journal of the Society for Medical Decision Making · 2024
    Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Trial
  9. Trial
  10. Trial
  11. Trial
  12. Article
  13. Article
  14. Article
  15. Article
  16. Valuing health and wellbeing using discrete choice experiment: exploring feasibility, design effect and international preference similarity.The European journal of health economics : HEPAC : health economics in prevention and care · 2026
    Article
  17. Article
  18. Review
  19. Time preferences and COVID-19 vaccination uptake.The European journal of health economics : HEPAC : health economics in prevention and care · 2026
    Article
  20. Article

50 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Jorien VeldwijkCentre for Nutrition, Prevention and Health Services, National Institute for Public Health and the Environment, Bilthoven, The Netherlands; Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands.
Mattijs S LambooijCentre for Nutrition, Prevention and Health Services, National Institute for Public Health and the Environment, Bilthoven, The Netherlands.
Esther W de Bekker-GrobDepartment of Public Health, Erasmus MC, University Medical Center, Rotterdam, The Netherlands.
Henriëtte A SmitJulius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands.
G Ardine de WitCentre for Nutrition, Prevention and Health Services, National Institute for Public Health and the Environment, Bilthoven, The Netherlands; Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveto determine to what extent the inclusion of an opt-out option in a DCE may have an effect on choice behaviour and therefore might influence the attribute level estimates, the relative importance of the attributes and calculated trade-offs.

methods781 Dutch Type 2 Diabetes Mellitus patients completed a questionnaire containing nine choice tasks with an opt-out option and nice forced choice tasks. Mixed-logit models were used to estimate the relative importance of the five lifestyle program related attributes that were included. Willingness to pay (WTP) values were calculated and it was tested whether results differed between respondents who answered the choice tasks with an opt-out option in the first or second part of the questionnaire.

results21.4% of the respondents always opted out. Respondents who were given the opt-out option in the first part of the questionnaire as well as lower educated respondents significantly more often opted out. For both the forced and unforced choice model, different attributes showed significant estimates, the relative importance of the attributes was equal. However, due to differences in relative importance weights, the WTP values for the PA schedule differed significantly between both datasets.

conclusionsResults show differences in opting out based on the location of the opt-out option and respondents' educational level; this resulted in small differences between the forced and unforced choice model. Since respondents seem to learn from answering forced choice tasks, a dual response design might result in higher data quality compared to offering a direct opt-out option. Future research should empirically explore how choice sets should be presented to make them as easy and less complex as possible in order to reduce the proportion of respondents that opts-out due to choice task complexity. Moreover, future research should debrief respondents to examine the reasons for choosing the opt-out alternative.

Indexed as

Choice BehaviorDiabetes Mellitus, Type 2Surveys and QuestionnairesAdultAgedFemaleHumansMaleMiddle AgedNetherlands

Identifiers

PMID25365169
PMCPMC4218820

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.