Evidence map›Paper›PMID 32040158›Full record

ArticleJAMA internal medicine2020

Comparison of Payment Changes and Choosing Wisely Recommendations for Use of Low-Value Laboratory Tests in the United States and Canada.

James Henderson, Zachary Bouck, Rob Holleman, Cherry Chu, Mandi L Klamerus, Robin Santiago, R Sacha Bhatia, Eve A Kerr

Open access · bronzeAbstract read
In one paragraph

Article in JAMA internal medicine, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 30 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
30citing papers in PubMed, 2 pooled it
12.1field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

30 citing papers in PubMed, 2 syntheses or guidelines pooled it, 56 citations in OpenAlex.

  1. Inappropriate use of clinical practices in Canada: a systematic review.CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2022
    Pooled it
  2. Pooled it
  3. Article
  4. The impact of Choosing WiselyBMC health services research · 2025
    Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors at 4 institutions in 2 countries.

James HendersonConsulting for Statistics, Computing and Analytics Research, University of Michigan, Ann Arbor.
Zachary BouckInstitute for Health Systems Solutions and Virtual Care, Women's College Hospital, Toronto, Ontario, Canada.
Rob HollemanVeterans Affairs Center for Clinical Management Research, Ann Arbor, Michigan.
Cherry ChuInstitute for Health Systems Solutions and Virtual Care, Women's College Hospital, Toronto, Ontario, Canada.
Mandi L KlamerusVeterans Affairs Center for Clinical Management Research, Ann Arbor, Michigan.
Robin SantiagoInstitute for Health Systems Solutions and Virtual Care, Women's College Hospital, Toronto, Ontario, Canada.
R Sacha BhatiaInstitute for Health Systems Solutions and Virtual Care, Women's College Hospital, Toronto, Ontario, Canada.
Eve A KerrVeterans Affairs Center for Clinical Management Research, Ann Arbor, Michigan.
VA Center for Clinical Management Research · USWomen's College Hospital · CAPublic Health Ontario · CAUniversity of Michigan–Ann Arbor · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Importance: Evidence comparing the consequences of Choosing Wisely recommendations across health systems or with the consequences of recommendations plus policy change is lacking. Objectives: To compare changes in the use of 2 low-value laboratory tests after the release of Choosing Wisely recommendations across 3 health care jurisdictions and changes associated with a related policy change. Design, Setting, and Participants: This cross-sectional study was a population-based interrupted time series of adult patients (aged 18-64 years) who had primary care visits between January 1, 2010, and June 30, 2015, or established hypothyroidism between January 1, 2012, and June 30, 2015, across 3 health care delivery jurisdictions: Ontario, Canada; the US Veterans Health Administration; and the US employer-sponsored insurance market. Data analysis was performed from March 21, 2018, to October 31, 2019. Exposures: A December 2010 payment policy change that eliminated reimbursement of vitamin D screening in Ontario, Canada, and the subsequent release of Choosing Wisely recommendations against low-value use of vitamin D tests in February 2013 and triiodothyronine tests in October 2013 in the United States and both tests in October 2014 in Canada. Main Outcomes and Measures: Relative marginal effects (RMEs) comparing low-value testing rates after the release of Choosing Wisely recommendations with rates expected based on prerelease trends and the associated change in low-value vitamin D testing after the 2010 payment policy change in Ontario, Canada. Results: Of 54 223 448 total persons, 28 504 576 (52.6%) were female, with 17 895 458 persons (33.0%) aged 18 to 34 years, 11 101 985 (20.5%) aged 35 to 44 years, and 25 226 005 (46.5%) aged 45 to 64 years. The December 2010 policy eliminating reimbursement for low-value vitamin D screening in Ontario, Canada, was associated with a 92.7% (95% CI, 92.4%-93.0%) relative reduction in such screening. Corresponding Choosing Wisely recommendations were associated with smaller reductions: 4.5% (95% CI, 2.6%-6.3%) in Ontario, 13.8% (95% CI, 11.8%-15.9%) for US Veterans Health Administration, and 14.0% (95% CI, 12.8%-15.2%) for US employer-sponsored insurance. In contrast, low-value use of triiodothyronine testing did not change significantly in Ontario, Canada (RME, 0.3%; 95% CI, -1.4% to 2.0%) or the US Veterans Health Administration (RME, 0.7%; 95% CI, -4.7% to 6.4%) and increased (RME, 3.0%; 95% CI, 1.6%-4.4%) for US employer-sponsored insurance. Conclusions and Relevance: In this study, marginal reductions in the use of 2 low-value laboratory tests were associated with the release of related Choosing Wisely recommendations but a greater reduction in low-value vitamin D screening was associated with a previous payment policy change implemented in Ontario, Canada. These findings suggest that recommendations alone may be insufficient to significantly reduce use of low-value services and that pairing recommendations with policy changes may be more effective.

Indexed as

AdolescentAdultCanadaCross-Sectional StudiesDiagnostic Tests, RoutineFemaleHumansInterrupted Time Series AnalysisMaleMass ScreeningMiddle AgedOntarioPrimary Health CareTriiodothyronineUnited StatesVitamin DTriiodothyronineVitamin D

Identifiers

PMID32040158
PMCPMC7042826
OpenAlexW3004935867

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.