Evidence map›Paper›PMID 29243044›Full record

ArticleQuality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation2018

Conversion of standard retrospective patient-reported outcomes to momentary versions: cognitive interviewing reveals varying degrees of momentary compatibility.

Victor Brun Boesen, Stine Birk Nissen, Mogens Groenvold, Jakob Bue Bjorner, Laszlo Hegedüs, Steen Joop Bonnema, Åse Krogh Rasmussen, Ulla Feldt-Rasmussen, Torquil Watt

Abstract read
PubMed Publisher
In one paragraph

Article in Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Understanding data visualization techniques in qualitative studies used to develop and validate patient-reported outcome measures: a targeted literature review.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2025
    Review
  2. Article
  3. Opening the contextual black box: a case for idiographic experience sampling of context for clinical applications.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2025
    Article
  4. Assessing and accounting for measurement in intensive longitudinal studies: current practices, considerations, and avenues for improvement.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2024
    Article
  5. Evaluation of Pressing Issues in Ecological Momentary Assessment.Annual review of clinical psychology · 2023
    Review
  6. Article
  7. Review
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Victor Brun BoesenDepartment of Endocrinology, Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark.
Stine Birk NissenDepartment of Public Health, University of Copenhagen, Copenhagen, Denmark.
Mogens GroenvoldDepartment of Public Health, University of Copenhagen, Copenhagen, Denmark.
Jakob Bue BjornerDepartment of Public Health, University of Copenhagen, Copenhagen, Denmark.
Laszlo HegedüsDepartment of Endocrinology and Metabolism, Odense University Hospital, Odense, Denmark.
Steen Joop BonnemaDepartment of Endocrinology and Metabolism, Odense University Hospital, Odense, Denmark.
Åse Krogh RasmussenDepartment of Endocrinology, Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark.
Ulla Feldt-RasmussenDepartment of Endocrinology, Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark.
Torquil WattDepartment of Endocrinology, Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark. Torquil.Watt@regionh.dk.ORCID 0000-0002-6001-7440

Funding

Styrelsen for Forskning og Innovation (DK) grant 271-09-0143
6 · The paper itself

Abstract

purposeThe purpose of this study was to adapt different domains of an existing retrospective questionnaire to momentary versions, to use and assess cognitive interviewing for evaluating the new versions, and to compare momentary compatibility (i.e. an item's potential to be validly converted to a momentary version) across different scales.

methodsInitial momentary versions of retrospective patient-reported outcomes were produced by converting present perfect tense wording to present tense wording. Cognitive interviews were conducted iteratively with 21 patients to determine which reference period they actually employed, and to identify problems with new, revised versions. A think-aloud interview protocol was supplemented with non-specific concurrent and specific retrospective probing. The momentary compatibility of each item was evaluated by calculating the proportion of interviews wherein momentary reference periods were identified; problems were categorized according to cognitive aspects of survey methodology taxonomy. The efficiency of various cognitive interviewing techniques was determined by evaluating whether applied reference periods were identified by think-aloud alone or by supplementary probes.

resultsThe momentary compatibility varied from 5 to 100% across items. Cognitive interviews revealed potential problems of various severities in the majority of items. Think-aloud alone was sufficient at determining the applied reference period in one-third of the cases, and the efficiency of additional concurrent and retrospective probing was 50 and 94%, respectively.

conclusionsCognitive interviewing techniques proved useful for developing and evaluating momentary items. Researchers should be aware of the applied reference period and of emerging problems when evaluating adapted momentary items, since not all concepts are suitable. We recommend the proposed method in future adaptations of existing instruments.

Indexed as

Patient Reported Outcome MeasuresAdultAgedAged, 80 and overFemaleHumansMaleMiddle AgedQuality of LifeRetrospective StudiesSurveys and QuestionnairesYoung AdultCognitive interviewingEcological momentary assessmentsPatient-reported outcomesQuality-of-life measurementThyroid diseases

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.