Evidence map›Paper›PMID 24799456›Full record

ArticleMedical decision making : an international journal of the Society for Medical Decision Making2015

Identifying best-fitting inputs in health-economic model calibration: a Pareto frontier approach.

Eva A Enns, Lauren E Cipriano, Cyrena T Simons, Chung Yin Kong

Abstract read
In one paragraph

Article in Medical decision making : an international journal of the Society for Medical Decision Making, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed.

  1. A Tutorial on Discrete Event Simulation Models Using a Cost-Effectiveness Analysis Example in R.Medical decision making : an international journal of the Society for Medical Decision Making · 2026
    Article
  2. Review
  3. Article
  4. Review
  5. An Introductory Tutorial on Cohort State-Transition Models in R Using a Cost-Effectiveness Analysis Example.Medical decision making : an international journal of the Society for Medical Decision Making · 2023
    Article
  6. A Tutorial on Time-Dependent Cohort State-Transition Models in R Using a Cost-Effectiveness Analysis Example.Medical decision making : an international journal of the Society for Medical Decision Making · 2023
    Article
  7. Article
  8. Article
  9. Multiobjective Calibration of Disease Simulation Models Using Gaussian Processes.Medical decision making : an international journal of the Society for Medical Decision Making · 2019
    Article
  10. Nonidentifiability in Model Calibration and Implications for Medical Decision Making.Medical decision making : an international journal of the Society for Medical Decision Making · 2018
    Article
  11. Microsimulation Modeling for Health Decision Sciences Using R: A Tutorial.Medical decision making : an international journal of the Society for Medical Decision Making · 2018
    Article
  12. Article
  13. Article
  14. Article
  15. Validation Is Necessary but Insufficient.Medical decision making : an international journal of the Society for Medical Decision Making · 2015
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Eva A EnnsUniversity of Minnesota School of Public Health, Division of Health Policy and Management, Minneapolis, MN (EAE)
Lauren E CiprianoIvey Business School, University of Western Ontario, London, ON, Canada (LEC)
Cyrena T SimonsStanford University Medical School, Stanford, CA (CTS)
Chung Yin KongInstitute for Technology Assessment, Massachusetts General Hospital, Boston, MA (CYK)

Funding

Applications of Multi-Criteria Optimization (AMCO) to Cancer Simulation ModelingK25CA133141 · NCI · MASSACHUSETTS GENERAL HOSPITAL · PI KONG, CHUNG YIN · 2009 to 2013
$844k
NCI NIH HHS K25 CA133141NCI NIH HHS K25CA133141
6 · The paper itself

Abstract

backgroundTo identify best-fitting input sets using model calibration, individual calibration target fits are often combined into a single goodness-of-fit (GOF) measure using a set of weights. Decisions in the calibration process, such as which weights to use, influence which sets of model inputs are identified as best-fitting, potentially leading to different health economic conclusions. We present an alternative approach to identifying best-fitting input sets based on the concept of Pareto-optimality. A set of model inputs is on the Pareto frontier if no other input set simultaneously fits all calibration targets as well or better.

methodsWe demonstrate the Pareto frontier approach in the calibration of 2 models: a simple, illustrative Markov model and a previously published cost-effectiveness model of transcatheter aortic valve replacement (TAVR). For each model, we compare the input sets on the Pareto frontier to an equal number of best-fitting input sets according to 2 possible weighted-sum GOF scoring systems, and we compare the health economic conclusions arising from these different definitions of best-fitting.

resultsFor the simple model, outcomes evaluated over the best-fitting input sets according to the 2 weighted-sum GOF schemes were virtually nonoverlapping on the cost-effectiveness plane and resulted in very different incremental cost-effectiveness ratios ($79,300 [95% CI 72,500-87,600] v. $139,700 [95% CI 79,900-182,800] per quality-adjusted life-year [QALY] gained). Input sets on the Pareto frontier spanned both regions ($79,000 [95% CI 64,900-156,200] per QALY gained). The TAVR model yielded similar results.

conclusionsChoices in generating a summary GOF score may result in different health economic conclusions. The Pareto frontier approach eliminates the need to make these choices by using an intuitive and transparent notion of optimality as the basis for identifying best-fitting input sets.

Indexed as

Decision Support TechniquesModels, EconometricQuality-Adjusted Life YearsAortic Valve StenosisCost-Benefit AnalysisEconomics, MedicalHumansMarkov ChainsSeverity of Illness IndexTranscatheter Aortic Valve Replacementcalibrationcalibration uncertaintyhealth-economic modelmodel uncertaintyparameter estimationparameter uncertaintyPareto frontier

Identifiers

PMID24799456
PMCPMC4277724

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.