Evidence map›Paper›PMID 35735216›Full record

ArticleMedical decision making : an international journal of the Society for Medical Decision Making2022

Metamodeling for Policy Simulations with Multivariate Outcomes.

Huaiyang Zhong, Margaret L Brandeau, Golnaz Eftekhari Yazdi, Jianing Wang, Shayla Nolen, Liesl Hagan, William W Thompson, Sabrina A Assoumou, Benjamin P Linas, Joshua A Salomon

Abstract read
In one paragraph

Article in Medical decision making : an international journal of the Society for Medical Decision Making, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Meta-Modeling as a Variance-Reduction Technique for Stochastic Model-Based Cost-Effectiveness Analyses.Medical decision making : an international journal of the Society for Medical Decision Making · 2025
    Article
  2. Emulator-Based Bayesian Calibration of the CISNET Colorectal Cancer Models.Medical decision making : an international journal of the Society for Medical Decision Making · 2024
    Article
  3. Emulator-based Bayesian calibration of the CISNET colorectal cancer models.medRxiv : the preprint server for health sciences · 2024
    Article
  4. Article
  5. When Is Mass Prophylaxis Cost-Effective for Epidemic Control? A Comparison of Decision Approaches.Medical decision making : an international journal of the Society for Medical Decision Making · 2022
    Article
  6. Personalization of Medical Treatment Decisions: Simplifying Complex Models while Maintaining Patient Health Outcomes.Medical decision making : an international journal of the Society for Medical Decision Making · 2022
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Huaiyang ZhongDepartment of Management Science and Engineering, Stanford University, Stanford, CA, USA.ORCID 0000-0002-2902-1644
Margaret L BrandeauDepartment of Management Science and Engineering, Stanford University, Stanford, CA, USA.
Golnaz Eftekhari YazdiSection of Infectious Diseases, Department of Medicine, Boston Medical Center, Boston, MA, USA.
Jianing WangSection of Infectious Diseases, Department of Medicine, Boston Medical Center, Boston, MA, USA.
Shayla NolenSection of Infectious Diseases, Department of Medicine, Boston Medical Center, Boston, MA, USA.
Liesl Hagan
William W ThompsonDivision of Viral Hepatitis, Center for Disease Control and Prevention, Atlanta, GA, USA.
Sabrina A AssoumouSection of Infectious Diseases, Department of Medicine, Boston Medical Center, Boston, MA, USA.
Benjamin P LinasSection of Infectious Diseases, Department of Medicine, Boston Medical Center, Boston, MA, USA.
Joshua A SalomonCenter for Health Policy and Center for Primary Care and Outcomes Research, Stanford University, Stanford, CA, USA.

Funding

Making Better Decisions: Policy Modeling for AIDS and Drug AbuseR01DA015612 · NIDA · STANFORD UNIVERSITY · PI OWENS, DOUGLAS K · 2002 to 2017
$9.4M
Making Better Decisions: Policy Modeling for AIDS and Drug AbuseR37DA015612 · NIDA · STANFORD UNIVERSITY · PI DOUGLAS K OWENS · 2019 to 2026
$6.3M
CDC HHSNCHHSTP CDC HHS U38 PS004644NIDA NIH HHS R01 DA015612NIDA NIH HHS R37 DA015612
6 · The paper itself

Abstract

purposeMetamodels are simplified approximations of more complex models that can be used as surrogates for the original models. Challenges in using metamodels for policy analysis arise when there are multiple correlated outputs of interest. We develop a framework for metamodeling with policy simulations to accommodate multivariate outcomes.

methodsWe combine 2 algorithm adaptation methods-multitarget stacking and regression chain with maximum correlation-with different base learners including linear regression (LR), elastic net (EE) with second-order terms, Gaussian process regression (GPR), random forests (RFs), and neural networks. We optimize integrated models using variable selection and hyperparameter tuning. We compare the accuracy, efficiency, and interpretability of different approaches. As an example application, we develop metamodels to emulate a microsimulation model of testing and treatment strategies for hepatitis C in correctional settings.

resultsOutput variables from the simulation model were correlated (average ρ = 0.58). Without multioutput algorithm adaptation methods, in-sample fit (measured by

conclusionsIn our example application, the choice of base learner had the largest impact on

Indexed as

AlgorithmsNeural Networks, ComputerHumansLinear ModelsNormal DistributionPolicymachine learningmetamodelingmodel interpretabilitysimulation modeling

Identifiers

PMID35735216
PMCPMC9452454

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.