Evidence map›Paper›PMID 37089994›Full record

ArticleImplementation research and practice

The psychometric and pragmatic evidence rating scale (PAPERS) for measure development and evaluation.

Cara C Lewis, Kayne D Mettert, Cameo F Stanick, Heather M Halko, Elspeth A Nolen, Byron J Powell, Bryan J Weiner

Abstract read
In one paragraph

Article in Implementation research and practice. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 50 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
50citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

50 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Pooled it
  2. Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2024
    Guideline
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Trial
  7. Educational Targets for Patient-Reported Outcomes and Caregiver-Reported Outcomes in Psycho-oncology Research.Journal of cancer education : the official journal of the American Association for Cancer Education · 2026
    Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Development and testing of the capacity of organisations for system practices scale.Health promotion journal of Australia : official journal of Australian Association of Health Promotion Professionals · 2025
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Cara C LewisKaiser Permanente Washington Health Research Institute, USA.ORCID https://orcid.org/0000-0001-8920-8075
Kayne D MettertKaiser Permanente Washington Health Research Institute, USA.ORCID https://orcid.org/0000-0003-1750-7863
Cameo F StanickHathaway-Sycamores Child and Family Services, USA.ORCID https://orcid.org/0000-0002-6076-3726
Heather M HalkoUniversity of Montana, USA.
Elspeth A NolenDepartment of Global Health, University of Washington, USA.
Byron J PowellBrown School and School of Medicine, Washington University in St. Louis, USA.ORCID https://orcid.org/0000-0001-5245-1186
Bryan J WeinerDepartment of Global Health, University of Washington, USA.

Funding

Advancing Implementation Science through Measure Development and EvaluationR01MH106510 · NIMH · TRUSTEES OF INDIANA UNIVERSITY · PI LEWIS, CARA CHARISSA · 2015 to 2017
$1.3M
NIMH NIH HHS R01 MH106510
6 · The paper itself

Abstract

To rigorously measure the implementation of evidence-based interventions, implementation science requires measures that have evidence of reliability and validity across different contexts and populations. Measures that can detect change over time and impact on outcomes of interest are most useful to implementers. Moreover, measures that fit the practical needs of implementers could be used to guide implementation outside of the research context. To address this need, our team developed a rating scale for implementation science measures that considers their psychometric and pragmatic properties and the evidence available. The Psychometric and Pragmatic Evidence Rating Scale (PAPERS) can be used in systematic reviews of measures, in measure development, and to select measures. PAPERS may move the field toward measures that inform robust research evaluations and practical implementation efforts.

Indexed as

implementationMeasurespragmaticpsychometricrating scale

Identifiers

PMID37089994
PMCPMC9981887

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.