Evidence map›Paper›PMID 29141153›Full record

ArticleMedical decision making : an international journal of the Society for Medical Decision Making2018

Using Observational Data to Calibrate Simulation Models.

Eleanor J Murray, James M Robins, George R Seage, Sara Lodi, Emily P Hyle, Krishna P Reddy, Kenneth A Freedberg, Miguel A Hernán

Abstract read
In one paragraph

Article in Medical decision making : an international journal of the Society for Medical Decision Making, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Complex systems models for causal inference in social epidemiology.Journal of epidemiology and community health · 2021
    Article
  10. Article
  11. The Challenges of Parameterizing Direct Effects in Individual-Level Simulation Models.Medical decision making : an international journal of the Society for Medical Decision Making · 2020
    Article
  12. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Eleanor J MurrayDepartment of Epidemiology, Harvard School of Public Health, Boston, MA, USA (EJM, JMR, GRS, SL, MAH).
James M RobinsDepartment of Epidemiology, Harvard School of Public Health, Boston, MA, USA (EJM, JMR, GRS, SL, MAH).
George R SeageDepartment of Epidemiology, Harvard School of Public Health, Boston, MA, USA (EJM, JMR, GRS, SL, MAH).
Sara LodiDepartment of Epidemiology, Harvard School of Public Health, Boston, MA, USA (EJM, JMR, GRS, SL, MAH).
Emily P HyleDivision of Infectious Disease, Massachusetts General Hospital, Boston, MA, USA (EPH, KAF).
Krishna P ReddyDivision of Pulmonary and Critical Care Medicine, Massachusetts General Hospital, Boston, MA, USA (KPR).
Kenneth A FreedbergDivision of Infectious Disease, Massachusetts General Hospital, Boston, MA, USA (EPH, KAF).
Miguel A HernánDepartment of Epidemiology, Harvard School of Public Health, Boston, MA, USA (EJM, JMR, GRS, SL, MAH).

Funding

The impact of HIV viral diversity and cellular immunity on HIV pathogenesisP30AI060354 · NIAID · HARVARD UNIVERSITY (MEDICAL SCHOOL) · PI ROBERT A. PARKER · 2004 to 2026
$94.4M
Development and application of a new simulation model for COVID-19R01AI042006 · NIAID · MASSACHUSETTS GENERAL HOSPITAL · PI Kenneth Alan Freedberg, Anne Neilan · 1998 to 2026
$12.9M
Pooling HIV Cohorts to Inform Clinical DecisionR01AI073127 · NIAID · HARVARD SCHOOL OF PUBLIC HEALTH · PI HERNAN, MIGUEL · 2007 to 2010
$1.5M
Calibration and Simulation of the Botswana Combination Prevention ProjectR01GM116525 · NIGMS · HARVARD SCHOOL OF PUBLIC HEALTH · PI SEAGE, GEORGE R · 2015 to 2017
$1.5M
Clinical and Economic Outcomes of HIV, Cigarette Smoking, and Smoking Cessation InterventionsK01DA042687 · NIDA · MASSACHUSETTS GENERAL HOSPITAL · PI REDDY, KRISHNA P · 2016 to 2020
$929k
Cardiovascular Disease in South African HIV Patients: Value of PreventionK01HL123349 · NHLBI · MASSACHUSETTS GENERAL HOSPITAL · PI HYLE, EMILY PARKER · 2016 to 2020
$896k
NHLBI NIH HHS K01 HL123349NIAID NIH HHS P30 AI060354NIAID NIH HHS R01 AI042006NIAID NIH HHS R01 AI073127NIDA NIH HHS K01 DA042687NIGMS NIH HHS R01 GM116525
6 · The paper itself

Abstract

backgroundIndividual-level simulation models are valuable tools for comparing the impact of clinical or public health interventions on population health and cost outcomes over time. However, a key challenge is ensuring that outcome estimates correctly reflect real-world impacts. Calibration to targets obtained from randomized trials may be insufficient if trials do not exist for populations, time periods, or interventions of interest. Observational data can provide a wider range of calibration targets but requires methods to adjust for treatment-confounder feedback. We propose the use of the parametric g-formula to estimate calibration targets and present a case-study to demonstrate its application.

methodsWe used the parametric g-formula applied to data from the HIV-CAUSAL Collaboration to estimate calibration targets for 7-y risks of AIDS and/or death (AIDS/death), as defined by the Center for Disease Control and Prevention under 3 treatment initiation strategies. We compared these targets to projections from the Cost-effectiveness of Preventing AIDS Complications (CEPAC) model for treatment-naïve individuals presenting to care in the following year ranges: 1996 to 1999, 2000 to 2002, or 2003 onwards.

resultsThe parametric g-formula estimated a decreased risk of AIDS/death over time and with earlier treatment. The uncalibrated CEPAC model successfully reproduced targets obtained via the g-formula for baseline 1996 to 1999, but over-estimated calibration targets in contemporary populations and failed to reproduce time trends in AIDS/death risk. Calibration to g-formula targets improved CEPAC model fit for contemporary populations.

conclusionIndividual-level simulation models are developed based on best available information about disease processes in one or more populations of interest, but these processes can change over time or between populations. The parametric g-formula provides a method for using observational data to obtain valid calibration targets and enables updating of simulation model inputs when randomized trials are not available.

Indexed as

Models, TheoreticalObservationPopulation HealthAdultCause of DeathFemaleHealth PromotionHIV InfectionsHumansMaleMiddle AgedMortalityagent-based modelcalibrationg-formulaHIV

Identifiers

PMID29141153
PMCPMC5771959

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.