Evidence map›Paper›PMID 19804437›Full record

ReviewValue in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research

Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report.

Margaret Rothman, Laurie Burke, Pennifer Erickson, Nancy Kline Leidy, Donald L Patrick, Charles D Petrie

Abstract readReview
PubMed Publisher
In one paragraph

Review in Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 207 papers, 8 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
207citing papers in PubMed, 8 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

207 citing papers in PubMed, 8 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Patient-Reported Outcome Instruments for Physical Symptoms Among Patients Receiving Maintenance Dialysis: A Systematic Review.American journal of kidney diseases : the official journal of the National Kidney Foundation · 2015
    Pooled it
  8. Clinical Outcome Assessments: Conceptual Foundation-Report of the ISPOR Clinical Outcomes Assessment - Emerging Good Practices for Outcomes Research Task Force.Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research · 2015
    Guideline
  9. Trial
  10. Trial
  11. Trial
  12. Caregiver Meaningful Score Differences and Meaningful Score Regions for the Observer-Reported Communication Ability Measure for Individuals with Angelman Syndrome.Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research · 2026
    Article
  13. Article
  14. Review
  15. Item comprehension and content coverage of patient-reported outcome measures for long COVID: a qualitative study.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2026
    Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. Review

147 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

6 authors.

Margaret RothmanWW Patient-Reported Outcomes Center of Excellence, Johnson & Johnson Pharmaceutical Services, LLC, Raritan, NJ, USA.
Laurie Burke
Pennifer Erickson
Nancy Kline Leidy
Donald L Patrick
Charles D Petrie

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundPatient-reported outcome (PRO) instruments are used to evaluate the effect of medical products on how patients feel or function. This article presents the results of an ISPOR task force convened to address good clinical research practices for the use of existing or modified PRO instruments to support medical product labeling claims. The focus of the article is on content validity, with specific reference to existing or modified PRO instruments, because of the importance of content validity in selecting or modifying an existing PRO instrument and the lack of consensus in the research community regarding best practices for establishing and documenting this measurement property.

methodsTopics addressed in the article include: definition and general description of content validity; PRO concept identification as the important first step in establishing content validity; instrument identification and the initial review process; key issues in qualitative methodology; and potential threats to content validity, with three case examples used to illustrate types of threats and how they might be resolved. A table of steps used to identify and evaluate an existing PRO instrument is provided, and figures are used to illustrate the meaning of content validity in relationship to instrument development and evaluation. RESULTS & RECOMMENDATIONS: Four important threats to content validity are identified: unclear conceptual match between the PRO instrument and the intended claim, lack of direct patient input into PRO item content from the target population in which the claim is desired, no evidence that the most relevant and important item content is contained in the instrument, and lack of documentation to support modifications to the PRO instrument. In some cases, careful review of the threats to content validity in a specific application may be reduced through additional well documented qualitative studies that specifically address the issue of concern.

conclusionPublished evidence of the content validity of a PRO instrument for an intended application is often limited. Such evidence is, however, important to evaluating the adequacy of a PRO instrument for the intended application. This article provides an overview of key issues involved in assessing and documenting content validity as it relates to using existing instruments in the drug approval process.

Indexed as

Research DesignSurveys and QuestionnairesFocus GroupsHealth PolicyHumansInternationalityOutcome Assessment, Health CareQualitative ResearchQuality of LifeResearchValidation Studies as Topic

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.