Evidence map›Paper›PMID 27484996›Full record

ReviewSystematic reviews2016

Checklist to operationalize measurement characteristics of patient-reported outcome measures.

David O Francis, Melissa L McPheeters, Meaghan Noud, David F Penson, Irene D Feurer

Abstract readReview
In one paragraph

Review in Systematic reviews, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 41 papers, 8 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
41citing papers in PubMed, 8 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

41 citing papers in PubMed, 8 syntheses or guidelines pooled it.

  1. Pooled it
  2. Needs assessment instruments for family caregivers of cancer patients receiving palliative care: a systematic review.Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer · 2022
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Measurement properties of self-report questionnaires on health-related quality of life and functional health status in dysphonia: a systematic review using the COSMIN taxonomy.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2019
    Pooled it
  7. Patient-reported outcome measures in dysphagia: a systematic review of instrument development and validation.Diseases of the esophagus : official journal of the International Society for Diseases of the Esophagus · 2017
    Pooled it
  8. Pooled it
  9. Trial
  10. Article
  11. Article
  12. Review
  13. Article
  14. Review
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

David O FrancisDepartment of Otolaryngology, Vanderbilt University Medical Center, Medical Center East, Suite 7302, 1215, 21st Avenue South, Nashville, TN, 37212, USA. david.o.francis@vanderbilt.edu.
Melissa L McPheetersVanderbilt Evidence-based Practice Center, Institute for Medicine and Public Health, Vanderbilt University Medical Center, Nashville, 37232, TN, USA.
Meaghan NoudDepartment of Otolaryngology, Vanderbilt University Medical Center, Medical Center East, Suite 7302, 1215, 21st Avenue South, Nashville, TN, 37212, USA.
David F PensonCenter for Surgical Quality and Outcomes Research, Institute for Medicine and Public Health, Vanderbilt University Medical Center, Nashville, 37232, TN, USA.
Irene D FeurerCenter for Surgical Quality and Outcomes Research, Institute for Medicine and Public Health, Vanderbilt University Medical Center, Nashville, 37232, TN, USA.

Funding

Developing an Outcome Measuring Unilateral Vocal Fold Paralysis DisabilityK23DC013559 · NIDCD · VANDERBILT UNIVERSITY MEDICAL CENTER · PI FRANCIS, DAVID O. · 2014 to 2018
$990k
NIDCD NIH HHS K23 DC013559NIDCD NIH HHS L30 DC012687
6 · The paper itself

Abstract

backgroundThe purpose of this study was to advance a checklist of evaluative criteria designed to assess patient-reported outcome (PRO) measures' developmental measurement properties and applicability, which can be used by systematic reviewers, researchers, and clinicians with a varied range of expertise in psychometric measure development methodology.

methodsA directed literature search was performed to identify original studies, textbooks, consensus guidelines, and published reports that propose criteria for assessing the quality of PRO measures. Recommendations from these sources were iteratively distilled into a checklist of key attributes. Preliminary items underwent evaluation through 24 cognitive interviews with clinicians and quantitative researchers. Six measurement theory methodological novices independently applied the final checklist to assess six PRO measures encompassing a variety of methods, applications, and clinical constructs. Agreement between novice and expert scores was assessed.

resultsThe distillation process yielded an 18-item checklist with six domains: (1) conceptual model, (2) content validity, (3) reliability, (4) construct validity, (5) scoring and interpretation, and (6) respondent burden and presentation. With minimal instruction, good agreement in checklist item ratings was achieved between quantitative researchers with expertise in measurement theory and less experienced clinicians (mean kappa 0.70; range 0.66-0.87).

conclusionsWe present a simplified checklist that can help guide systematic reviewers, researchers, and clinicians with varied measurement theory expertise to evaluate the strengths and weakness of candidate PRO measures' developmental properties and the appropriateness for specific applications.

Indexed as

ChecklistPatient Reported Outcome MeasuresConsensusDimensional Measurement AccuracyHumansPsychometricsQuality of LifeReproducibility of Results

Identifiers

PMID27484996
PMCPMC4971647

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.