Evidence map›Paper›PMID 24447633›Full record

SynthesisBMC medical research methodology2014

A critical analysis of test-retest reliability in instrument validation studies of cancer patients under palliative care: a systematic review.

Carlos Eduardo Paiva, Eliane Marçon Barroso, Estela Cristina Carneseca, Cristiano de Pádua Souza, Felipe Thomé Dos Santos, Rossana Verónica Mendoza López, Sakamoto Bianca Ribeiro Paiva

Registry-linked trialAbstract readSystematic Review
In one paragraph

Synthesis in BMC medical research methodology, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT04932317 (Oral Symptom Assessment Scale), which is not on this map. Cited by 72 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
72citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04932317 completednot on this mapstarted 2021, after this paper: background citation

Oral Symptom Assessment Scale (OSAS): Validity and Reliability

TypeobservationalSponsorOur Lady's Hospice and Care ServicesRan2021 to 2022Enrolled54ConditionsNeoplasms
3 · Its place in the literature

Who cites it

72 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Prediction of neoadjuvant chemotherapy efficacy in patients with HER2-low breast cancer based on ultrasound radiomics.Cancer imaging : the official publication of the International Cancer Imaging Society · 2025
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. The Oral Symptom Assessment Scale (OSAS): criterion validation with the EORTC QLQ-OH15 and reliability testing.Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer · 2023
    Article
  20. Article

12 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Carlos Eduardo PaivaDepartment of Clinical Oncology, Barretos Cancer Hospital, Barretos, São Paulo CEP 14784-400, Brazil. caredupai@gmail.com.
Eliane Marçon Barroso
Estela Cristina Carneseca
Cristiano de Pádua Souza
Felipe Thomé Dos Santos
Rossana Verónica Mendoza López
Sakamoto Bianca Ribeiro Paiva

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundPatient-reported outcome validation needs to achieve validity and reliability standards. Among reliability analysis parameters, test-retest reliability is an important psychometric property. Retested patients must be in a clinically stable condition. This is particularly problematic in palliative care (PC) settings because advanced cancer patients are prone to a faster rate of clinical deterioration. The aim of this study was to evaluate the methods by which multi-symptom and health-related qualities of life (HRQoL) based on patient-reported outcomes (PROs) have been validated in oncological PC settings with regards to test-retest reliability.

methodsA systematic search of PubMed (1966 to June 2013), EMBASE (1980 to June 2013), PsychInfo (1806 to June 2013), CINAHL (1980 to June 2013), and SCIELO (1998 to June 2013), and specific PRO databases was performed. Studies were included if they described a set of validation studies. Studies were included if they described a set of validation studies for an instrument developed to measure multi-symptom or multidimensional HRQoL in advanced cancer patients under PC. The COSMIN checklist was used to rate the methodological quality of the study designs.

resultsWe identified 89 validation studies from 746 potentially relevant articles. From those 89 articles, 31 measured test-retest reliability and were included in this review. Upon critical analysis of the overall quality of the criteria used to determine the test-retest reliability, 6 (19.4%), 17 (54.8%), and 8 (25.8%) of these articles were rated as good, fair, or poor, respectively, and no article was classified as excellent. Multi-symptom instruments were retested over a shortened interval when compared to the HRQoL instruments (median values 24 hours and 168 hours, respectively; p = 0.001). Validation studies that included objective confirmation of clinical stability in their design yielded better results for the test-retest analysis with regard to both pain and global HRQoL scores (p < 0.05). The quality of the statistical analysis and its description were of great concern.

conclusionTest-retest reliability has been infrequently and poorly evaluated. The confirmation of clinical stability was an important factor in our analysis, and we suggest that special attention be focused on clinical stability when designing a PRO validation study that includes advanced cancer patients under PC.

Indexed as

Palliative CareChecklistHumansNeoplasmsQuality of LifeReproducibility of ResultsSelf ReportSurveys and Questionnaires

Identifiers

PMID24447633
PMCPMC3899385

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.