Evidence map›Paper›PMID 39630393›Full record

ArticleQuality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation2025

The comprehensibility continuum: a novel method for analysing comprehensibility of patient reported outcome measures.

Victoria Gale, Philip A Powell, Jill Carlton

Abstract read
In one paragraph

Article in Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Young children (6-7 years) can meaningfully participate in cognitive interviews assessing comprehensibility in health-related quality of life domains: a qualitative study.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2025
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Victoria GaleSchool of Medicine and Population Health, University of Sheffield, Sheffield, UK. vargale1@sheffield.ac.uk.ORCID http://orcid.org/0000-0001-7472-2039
Philip A PowellSchool of Medicine and Population Health, University of Sheffield, Sheffield, UK.ORCID http://orcid.org/0000-0003-1169-3431
Jill CarltonSchool of Medicine and Population Health, University of Sheffield, Sheffield, UK.ORCID http://orcid.org/0000-0002-9373-7663

Funding

SF-6D Royalty Income This work is part of a PhD project funded by SF-6D royalty income
6 · The paper itself

Abstract

purposeEvidence of comprehensibility is frequently required during the development of patient reported outcome measures (PROMs); the respondent's interpretation of PROM items needs to align with intended meanings. Cognitive interviews are recommended for investigating PROM comprehensibility, yet guidance for analysis is lacking. Consequently, the quality and trustworthiness of cognitive interview data and analysis is threatened, as there is no clear procedure detailing how analysts can systematically, and consistently, identify evidence that respondent interpretations align/misalign with intended meanings.

methodsThis paper presents a novel, structured approach to comprehensibility analysis - the 'Comprehensibility Continuum' - that builds upon existing cognitive interview guidance.

resultsThe Comprehensibility Continuum comprises a structured rating scale to code depth of alignment between intended item meaning and respondent interpretation and consists of five main stages: before cognitive interviews are conducted, researchers must (1) Define intended meanings of PROM items; and (2) Determine comprehensibility thresholds for both participant- and item-level. After conducting interviews, they (3) Prepare data by transcribing interviews 'intelligent' verbatim; (4) Code transcripts using the Comprehensibility Continuum scale in iterative sets, assigning an overall code for each item at participant-level; and (5) Compare participant-level codes across all participants to determine overall item comprehensibility, such that decisions can be made to retain, modify, or remove items.

conclusionQuality in qualitative data analysis is achieved through rigorous methods that are clearly described and justified. Given insufficiency in guidelines, cognitive interviewers must reflect on how best to demonstrate PROM comprehensibility systematically and consistently from interview data, and the Comprehensibility Continuum method offers a potential solution.

Indexed as

ComprehensionPatient Reported Outcome MeasuresHumansInterviews as TopicQuality of LifeSurveys and QuestionnairesAnalysisCognitive interviewContent validityPatient-reported outcomes measures

Identifiers

PMID39630393
PMCPMC11982068

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.