Evidence map›Paper›PMID 37170381›Full record

ArticleImplementation science communications2023

Data envelopment analysis to evaluate the efficiency of tobacco treatment programs in the NCI Moonshot Cancer Center Cessation Initiative.

Kathryn Pluta, Sarah D Hohl, Heather D'Angelo, Jamie S Ostroff, Donna Shelley, Yasmin Asvat, Li-Shiun Chen, K Michael Cummings, Neely Dahl, Andrew T Day and 24 more

Abstract read
In one paragraph

Article in Implementation science communications, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. NCI-Designated Cancer Centers' Policies and Practices with regard to Alcohol and Cancer: A Call to Lead.Cancer epidemiology, biomarkers & prevention : a publication of the American Association for Cancer Research, cosponsored by the American Society of Preventive Oncology · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

34 authors.

Kathryn PlutaDepartment of Health Outcomes and Biomedical Informatics, University of Florida College of Medicine, 2004 Mowry Rd, Gainesville, FL, 32610, USA.
Sarah D HohlUniversity of Wisconsin Carbone Cancer Center, 600 Highland Ave, Madison, WI, 53705, USA.
Heather D'AngeloNational Cancer Institute, 9609 Medical Center Dr, Rockville, MD, 20850, USA.
Jamie S OstroffMemorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA.
Donna ShelleyNew York University School of Global Public Health, 708 Broadway, New York, NY, 10003, USA.
Yasmin AsvatRush University Medical Center and Rush Cancer Center, 1725 W Harrison St, Suite 1010, Chicago, IL, 60612, USA.
Li-Shiun ChenWashington University Siteman Cancer Center, 4921 Parkview Pl, St. Louis, MO, 63110, USA.
K Michael CummingsMedical University of South Carolina, 171 Ashley Ave, Charleston, SC, 29425, USA.
Neely DahlUniversity of Virginia Comprehensive Cancer Center, 1240 Lee St, Charlottesville, VA, 22903, USA.
Andrew T DayUniversity of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX, 75390, USA.
Linda FleisherFox Chase Cancer Center, 333 Cottman Ave, Philadelphia, PA, 19111, USA.
Adam O GoldsteinUniversity of North Carolina Lineberger Cancer Center, 450 West Dr, Chapel Hill, NC, 27599, USA.
Rashelle HayesVirginia Commonwealth University Department of Psychiatry, 501 N 2Nd St, Suite 400B, Richmond, VA, 23219, USA.
Brian HitsmanNorthwestern University Feinberg School of Medicine and Lurie Comprehensive Cancer Center of Northwestern University, 420 E Superior St, Chicago, IL, 60611, USA.
Deborah Hudson BucklesIndiana University Simon Comprehensive Cancer Center, 535 Barnhill Dr, Indianapolis, IN, USA.
Andrea C KingUniversity of Chicago Medicine Comprehensive Cancer Center, 5758 S Maryland Dr, Chicago, IL, 60637, USA.
Cho Y LamHuntsman Cancer Institute, University of Utah, 1950 Circle of Hope Dr, Salt Lake City, UT, 84112, USA.
Katie LenhoffOne Medical Center Drive, Dartmouth-Hitchcock Norris Cotton Cancer Center, Lebanon, NH, 03756, USA.
Arnold H LevinsonUniversity of Colorado Comprehensive Cancer Center, 1665 North Aurora Court, Aurora, 200480045, USA.
Mara MinionUniversity of Wisconsin Carbone Cancer Center, 600 Highland Ave, Madison, WI, 53705, USA.
Cary PresantCity of Hope Comprehensive Cancer Center and Beckman Research Institute, 1500 E Duarte Rd, Duarte, CA, 91010, USA.
Judith J ProchaskaStanford Cancer Institute, Stanford University, 265 Campus Dr, Ste G2103, Stanford, CA, 94305, USA.
Kimberly ShoenbillUniversity of North Carolina Lineberger Cancer Center, 450 West Dr, Chapel Hill, NC, 27599, USA.
Vani SimmonsH. Lee Moffitt Cancer Center, 3011 Holly Dr, Tampa, FL, 33612, USA.
Kathryn TaylorGeorgetown University Lombardi Comprehensive Cancer Center, 3800 Reservoir Rd NW, Washington, DC, 20007, USA.
Hilary TindleVanderbilt University Medical Center Vanderbilt-Ingram Cancer Center, 2220 Pierce Ave, Nashville, TN, 37232, USA.
Elisa TongUniversity of California Davis Comprehensive Cancer Center, 2279 45Th St, Sacramento, CA, 95817, USA.
Justin S WhitePhilip R. Lee Institute for Health Policy Studies, University of California San Francisco, 490 Illinois St, Floor 7, San Francisco, CA, 94158, USA.
Kara P WisemanUniversity of Virginia Comprehensive Cancer Center, 1240 Lee St, Charlottesville, VA, 22903, USA.
Graham W WarrenMedical University of South Carolina, 171 Ashley Ave, Charleston, SC, 29425, USA.
Timothy B BakerSchool of Medicine and Public Health, University of Wisconsin, 750 Highland Ave, Madison, WI, 53705, USA.
Betsy RollandUniversity of Wisconsin Carbone Cancer Center, 600 Highland Ave, Madison, WI, 53705, USA.
Michael C FioreUniversity of Wisconsin Carbone Cancer Center, 600 Highland Ave, Madison, WI, 53705, USA.
Ramzi G SalloumDepartment of Health Outcomes and Biomedical Informatics, University of Florida College of Medicine, 2004 Mowry Rd, Gainesville, FL, 32610, USA. rsalloum@ufl.edu.ORCID http://orcid.org/0000-0002-8139-2418

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI SELWYN M VICKERS · 1985 to 2026
$347.4M
Washington University Center for Cellular ImagingP30CA091842 · NCI · WASHINGTON UNIVERSITY · PI TIMOTHY J. EBERLEIN · 2001 to 2026
$128.0M
Transforming The Treatment of Tobacco Use in Health Care: Seizing The Potential of the Electronic Health Record to Deliver Comprehensive Chronic Care Treatment for SmokingR35CA197573 · NCI · UNIVERSITY OF WISCONSIN-MADISON · PI MICHAEL C FIORE · 2015 to 2026
$10.7M
NCI NIH HHS 17GZSK0031NCI NIH HHS P30 CA008748NCI NIH HHS P30 CA091842NCI NIH HHS R35 CA197573
6 · The paper itself

Abstract

backgroundThe Cancer Center Cessation Initiative (C3I) is a National Cancer Institute (NCI) Cancer Moonshot Program that supports NCI-designated cancer centers developing tobacco treatment programs for oncology patients who smoke. C3I-funded centers implement evidence-based programs that offer various smoking cessation treatment components (e.g., counseling, Quitline referrals, access to medications). While evaluation of implementation outcomes in C3I is guided by evaluation of reach and effectiveness (via RE-AIM), little is known about technical efficiency-i.e., how inputs (e.g., program costs, staff time) influence implementation outcomes (e.g., reach, effectiveness). This study demonstrates the application of data envelopment analysis (DEA) as an implementation science tool to evaluate technical efficiency of C3I programs and advance prioritization of implementation resources.

methodsDEA is a linear programming technique widely used in economics and engineering for assessing relative performance of production units. Using data from 16 C3I-funded centers reported in 2020, we applied input-oriented DEA to model technical efficiency (i.e., proportion of observed outcomes to benchmarked outcomes for given input levels). The primary models used the constant returns-to-scale specification and featured cost-per-participant, total full-time equivalent (FTE) effort, and tobacco treatment specialist effort as model inputs and reach and effectiveness (quit rates) as outcomes.

resultsIn the DEA model featuring cost-per-participant (input) and reach/effectiveness (outcomes), average constant returns-to-scale technical efficiency was 25.66 (SD = 24.56). When stratified by program characteristics, technical efficiency was higher among programs in cohort 1 (M = 29.15, SD = 28.65, n = 11) vs. cohort 2 (M = 17.99, SD = 10.16, n = 5), with point-of-care (M = 33.90, SD = 28.63, n = 9) vs. no point-of-care services (M = 15.59, SD = 14.31, n = 7), larger (M = 33.63, SD = 30.38, n = 8) vs. smaller center size (M = 17.70, SD = 15.00, n = 8), and higher (M = 29.65, SD = 30.99, n = 8) vs. lower smoking prevalence (M = 21.67, SD = 17.21, n = 8).

conclusionMost C3I programs assessed were technically inefficient relative to the most efficient center benchmark and may be improved by optimizing the use of inputs (e.g., cost-per-participant) relative to program outcomes (e.g., reach, effectiveness). This study demonstrates the appropriateness and feasibility of using DEA to evaluate the relative performance of evidence-based programs.

Indexed as

CancerData envelopment analysisEfficiencyImplementation costsImplementation scienceProgram performanceSmoking cessationTobacco treatment

Identifiers

PMID37170381
PMCPMC10173908

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.