Evidence map›Paper›PMID 30565338›Full record

Trial reportHealth economics2019

Attribute level overlap (and color coding) can reduce task complexity, improve choice consistency, and decrease the dropout rate in discrete choice experiments.

Marcel F Jonker, Bas Donkers, Esther de Bekker-Grob, Elly A Stolk

Abstract readRandomized Controlled Trial
In one paragraph

Trial report in Health economics, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 66 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
66citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

66 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Using Separate Single-Outcome Risk Presentations Instead of Integrated Multioutcome Formats Improves Comprehension in Discrete Choice Experiments.Medical decision making : an international journal of the Society for Medical Decision Making · 2024
    Trial
  5. Trial
  6. Trial
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Unraveling acceptance of healthcare innovations in neurorehabilitation: results from a discrete choice experiment.The European journal of health economics : HEPAC : health economics in prevention and care · 2026
    Article
  13. Article
  14. Understanding decision-making strategies in discrete choice experiment tasks when valuing health states that include duration, a cognitive interview study with Australian adults.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2026
    Article
  15. Review
  16. Optimizing presentation formats for SF-6Dv2 health status valuation: a qualitative study using cognitive interviews.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2025
    Article
  17. Does context matter? A discrete choice experiment investigating the impact of palliative context on EQ-5D-5L health state valuation.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2025
    Article
  18. Article
  19. Article
  20. Article

6 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Marcel F JonkerErasmus Choice Modelling Centre, Erasmus University, Rotterdam, The Netherlands.ORCID 0000-0001-8433-1402
Bas DonkersErasmus Choice Modelling Centre, Erasmus University, Rotterdam, The Netherlands.
Esther de Bekker-GrobErasmus Choice Modelling Centre, Erasmus University, Rotterdam, The Netherlands.
Elly A StolkErasmus Choice Modelling Centre, Erasmus University, Rotterdam, The Netherlands.

Funding

EuroQol Research Foundation
6 · The paper itself

Abstract

A randomized controlled discrete choice experiment (DCE) with 3,320 participating respondents was used to investigate the individual and combined impact of level overlap and color coding on task complexity, choice consistency, survey satisfaction scores, and dropout rates. The systematic differences between the study arms allowed for a direct comparison of dropout rates and cognitive debriefing scores and accommodated the quantitative comparison of respondents' choice consistency using a heteroskedastic mixed logit model. Our results indicate that the introduction of level overlap made it significantly easier for respondents to identify the differences and choose between the choice options. As a stand-alone design strategy, attribute level overlap reduced the dropout rate by 30%, increased the level of choice consistency by 30%, and avoided learning effects in the initial choice tasks of the DCE. The combination of level overlap and color coding was even more effective: It reduced the dropout rate by 40% to 50% and increased the level of choice consistency by more than 60%. Hence, we can recommend attribute level overlap, with color coding to amplify its impact, as a standard design strategy in DCEs.

Indexed as

Choice BehaviorPatient DropoutsPatient PreferenceAdultFemaleHumansMaleMiddle AgedSurveys and Questionnaireschoice consistencyconjoint analysisdiscrete choice experimenttask complexity

Identifiers

PMID30565338
PMCPMC6590347

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.