ArticleJAMA internal medicine2020
Comparison of Payment Changes and Choosing Wisely Recommendations for Use of Low-Value Laboratory Tests in the United States and Canada.
Article in JAMA internal medicine, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 30 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
30 citing papers in PubMed, 2 syntheses or guidelines pooled it, 56 citations in OpenAlex.
- Inappropriate use of clinical practices in Canada: a systematic review.CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2022Pooled it
- Overuse of diagnostic testing in healthcare: a systematic review.BMJ quality & safety · 2022Pooled it
- De-Implementing Low-Value Care in Dentistry: The Case for Choosing Wisely Campaigns.Community dentistry and oral epidemiology · 2026Article
- The impact of Choosing WiselyBMC health services research · 2025Article
- Low-Cost, High-Volume Health Services Contribute the Most to Unnecessary Health Spending due to Low-Value Care in Japan.medRxiv : the preprint server for health sciences · 2025Article
- Global Sociodemographic Disparities in Ischemic Heart Disease Mortality According to Sex, 1980 to 2021.Circulation. Cardiovascular quality and outcomes · 2025Article
- Primary Care Physician Characteristics and Low-Value Care Provision in Japan.JAMA health forum · 2025Article
- Clinical impact of Choosing Wisely Canada hepatology recommendations: an interrupted time-series analysis using data from GEMINI.BMJ open quality · 2025Article
- Article
- How Medical Students Benefit from Participating in a Longitudinal Resource Stewardship Medical Education Program (STARS): An International Descriptive Evaluation.Journal of general internal medicine · 2025Article
- Rethinking the Impact of Single Continuing Educational Activities: Navigating Complexity Through Insights from Real-World Evaluation and Contemporary Literature.Journal of CME · 2025Article
- Identifying Strategies to Reduce Low-Value Preoperative Testing for Low-Risk Procedures: a Qualitative Study of Facilities with High or Recently Improved Levels of Testing.Journal of general internal medicine · 2023Article
- The impact of performance feedback reports on physician ordering behavior in the use of computed tomography pulmonary angiography (CTPA).Emergency radiology · 2023Article
- Impact of Active Disinvestment on Decision-Making for Surgery in Patients With Subacromial Pain Syndrome: A Qualitative Semi-structured Interview Study Among Hospital Sales Managers and Orthopedic Surgeons.International journal of health policy and management · 2023Article
- Improving healthcare value: Lessons learned from the first decade of Choosing Wisely®.Journal of hospital medicine · 2023Article
- A Policy Approach to Reducing Low-Value Device-Based Procedure Use.The Milbank quarterly · 2022Article
- Assessing patient, physician, and practice characteristics predicting the use of low-value services.Health services research · 2022Article
- Organizational influences on the use of low-value care in primary health care - a qualitative interview study with physicians in Sweden.Scandinavian journal of primary health care · 2022Article
- Is Low-value Testing Before Low-risk Hand Surgery Associated With Increased Downstream Healthcare Use and Reimbursements? A National Claims Database Analysis.Clinical orthopaedics and related research · 2022Article
- Diagnostic Value of Anti-Nuclear Antibodies: Results From Korean University-Affiliated Hospitals.Journal of Korean medical science · 2022Article
Corrections and comments
- Commented on by
Authors and funding
8 authors at 4 institutions in 2 countries.
Funding
No grant is acknowledged in the PubMed record.
Abstract
Importance: Evidence comparing the consequences of Choosing Wisely recommendations across health systems or with the consequences of recommendations plus policy change is lacking. Objectives: To compare changes in the use of 2 low-value laboratory tests after the release of Choosing Wisely recommendations across 3 health care jurisdictions and changes associated with a related policy change. Design, Setting, and Participants: This cross-sectional study was a population-based interrupted time series of adult patients (aged 18-64 years) who had primary care visits between January 1, 2010, and June 30, 2015, or established hypothyroidism between January 1, 2012, and June 30, 2015, across 3 health care delivery jurisdictions: Ontario, Canada; the US Veterans Health Administration; and the US employer-sponsored insurance market. Data analysis was performed from March 21, 2018, to October 31, 2019. Exposures: A December 2010 payment policy change that eliminated reimbursement of vitamin D screening in Ontario, Canada, and the subsequent release of Choosing Wisely recommendations against low-value use of vitamin D tests in February 2013 and triiodothyronine tests in October 2013 in the United States and both tests in October 2014 in Canada. Main Outcomes and Measures: Relative marginal effects (RMEs) comparing low-value testing rates after the release of Choosing Wisely recommendations with rates expected based on prerelease trends and the associated change in low-value vitamin D testing after the 2010 payment policy change in Ontario, Canada. Results: Of 54 223 448 total persons, 28 504 576 (52.6%) were female, with 17 895 458 persons (33.0%) aged 18 to 34 years, 11 101 985 (20.5%) aged 35 to 44 years, and 25 226 005 (46.5%) aged 45 to 64 years. The December 2010 policy eliminating reimbursement for low-value vitamin D screening in Ontario, Canada, was associated with a 92.7% (95% CI, 92.4%-93.0%) relative reduction in such screening. Corresponding Choosing Wisely recommendations were associated with smaller reductions: 4.5% (95% CI, 2.6%-6.3%) in Ontario, 13.8% (95% CI, 11.8%-15.9%) for US Veterans Health Administration, and 14.0% (95% CI, 12.8%-15.2%) for US employer-sponsored insurance. In contrast, low-value use of triiodothyronine testing did not change significantly in Ontario, Canada (RME, 0.3%; 95% CI, -1.4% to 2.0%) or the US Veterans Health Administration (RME, 0.7%; 95% CI, -4.7% to 6.4%) and increased (RME, 3.0%; 95% CI, 1.6%-4.4%) for US employer-sponsored insurance. Conclusions and Relevance: In this study, marginal reductions in the use of 2 low-value laboratory tests were associated with the release of related Choosing Wisely recommendations but a greater reduction in low-value vitamin D screening was associated with a previous payment policy change implemented in Ontario, Canada. These findings suggest that recommendations alone may be insufficient to significantly reduce use of low-value services and that pairing recommendations with policy changes may be more effective.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.