Evidence map›Paper›PMID 35260261›Full record

Trial reportPatient education and counseling2022

Psychometric assessment of the consideRATE questions, a new measure of serious illness experience, with an online simulation study.

Catherine H Saunders, Marie-Anne Durand, Kathryn B Kirkland, Meredith A MacMartin, Amber E Barnato, Glyn Elwyn

3 registry-linked trialsAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Patient education and counseling, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 3 registered trials, which are not on this map. Cited by 7 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT07024953 nanot yet recruitingnot on this mapstarted 2026, after this paper: background citation

Setting the Agenda: A Pilot Stepped Wedge Cluster Randomized Trial of a Structured Clinical Visit Agenda-Setting Intervention for Rural-Residing People With Advanced Chronic Kidney Disease

TypeinterventionalSponsorDartmouth-Hitchcock Medical CenterRan2026 to 2028Enrolled108ConditionsChronic Kidney Disease Stage 4, Chronic Kidney Disease Stage 5ArmsChronic Kidney Disease Structured Agenda-Setting Tool
NCT07127666 nanot yet recruitingnot on this mapstarted 2026, after this paper: background citation

Centering Children and Care Partners in Complex Pediatric Hospital Stays: Evaluation of a Structured Inpatient Agenda-setting Intervention for Multidisciplinary Family Meetings

TypeinterventionalSponsorDartmouth-Hitchcock Medical CenterRan2026 to 2026Enrolled20ConditionsMedical ComplexityArmsStructured Agenda-Setting Tool
NCT07221604 narecruitingnot on this mapstarted 2026, after this paper: background citation

Setting the Agenda: An Open Pilot of a Structured Clinical Visit Agenda-Setting Intervention for Rural-Residing People With Advanced Chronic Kidney Disease

TypeinterventionalSponsorDartmouth-Hitchcock Medical CenterRan2026 to 2026Enrolled30ConditionsChronic Kidney Disease Stage 4ArmsChronic Kidney Disease Structured Agenda-Setting Tool
3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Catherine H SaundersThe Dartmouth Institute for Health Policy & Clinical Practice, Dartmouth College, One Medical Center Drive, Lebanon, USA; Dartmouth-Hitchcock Medical Center, One Medical Center Drive, Lebanon, USA. Electronic address: catherinehylassaunders@gmail.com.
Marie-Anne DurandThe Dartmouth Institute for Health Policy & Clinical Practice, Dartmouth College, One Medical Center Drive, Lebanon, USA. Electronic address: Marie-Anne.Durand@dartmouth.edu.
Kathryn B KirklandThe Dartmouth Institute for Health Policy & Clinical Practice, Dartmouth College, One Medical Center Drive, Lebanon, USA; Dartmouth-Hitchcock Medical Center, One Medical Center Drive, Lebanon, USA. Electronic address: Kathryn.B.Kirkland@hitchcock.org.
Meredith A MacMartinDartmouth-Hitchcock Medical Center, One Medical Center Drive, Lebanon, USA. Electronic address: Meredith.A.MacMartin@hitchcock.org.
Amber E BarnatoThe Dartmouth Institute for Health Policy & Clinical Practice, Dartmouth College, One Medical Center Drive, Lebanon, USA; Dartmouth-Hitchcock Medical Center, One Medical Center Drive, Lebanon, USA. Electronic address: Amber.Barnato@dartmouth.edu.
Glyn ElwynThe Dartmouth Institute for Health Policy & Clinical Practice, Dartmouth College, One Medical Center Drive, Lebanon, USA. Electronic address: glynelwyn@gmail.com.

Funding

Training Geriatric Mental Health Services ResearchersT32MH073553 · NIMH · DARTMOUTH-HITCHCOCK CLINIC · PI BRUCE, MARTHA L · 2005 to 2019
$6.4M
RESEARCH TRAINING IN GERIATRIC MOOD DISORDERST32MH019132 · NIMH · WEILL MEDICAL COLL OF CORNELL UNIV · PI GUNNING, FAITH M · 1990 to 2025
$3.4M
NIMH NIH HHS T32 MH019132NIMH NIH HHS T32 MH073553
6 · The paper itself

Abstract

objectiveTo assess the psychometric properties of the consideRATE questions, a measure of serious illness experience.

methodsWe recruited people at least 50 years old via paid panels online, with US-Census-based quotas. We randomized participants to a patient experience story at two time points. Participants completed a series of measures, including the consideRATE questions. We assessed convergent (Pearson's correlation), discriminative (one-way ANOVA with Tukey's test for multiple comparisons) and divergent (Pearson's correlation) validity. We also assessed intra-rater reliability (intra-class correlation) and responsiveness to change (t-tests).

resultsWe included 809 individuals in our analysis. We established convergent validity (r = 0.77; p < 0.001); discriminative validity (bad/neutral stories [mean diff=0.4; p < 0.001]; neutral/ good stories [mean diff=1.3; p < 0.001]) and moderate divergent validity (r = 0.57; p < 0.001). We established sensitivity to change in all stories (bad/good [mean diff=1.52; p < 0.001]; good/bad [mean diff= -1.68; p < 0.001]; neutral/bad [mean diff= -0.57; p < 0.001]; good/neutral [mean diff= -1.11; p < 0.001]; neutral/good [mean diff= 1.1; p < 0.001]) but one (bad/neutral [mean diff= 0.4; p < 0.07]). Intra-rater reliability was demonstrated between time points (r = 0.77; p < 0.001).

conclusionsthe consideRATE questions were reliable and valid in a simulated online test. PRACTICE IMPLICATIONS: the consideRATE questions may be a practical way to measure serious illness experience and the effectiveness of interventions to improve it.

Indexed as

PsychometricsHumansMiddle AgedReproducibility of ResultsPatient-reported experience measurePatient-reported outcome measurePsychometric assessmentSerious illnessSurvey

Identifiers

PMID35260261
PMCPMC11487583

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.