Evidence map›Paper›PMID 31347104›Full record

ArticlePharmacoEconomics2019

The Challenge of Transparency and Validation in Health Economic Decision Modelling: A View from Mount Hood.

Seamus Kent, Frauke Becker, Talitha Feenstra, An Tran-Duy, Iryna Schlackow, Michelle Tew, Ping Zhang, Wen Ye, Shi Lizheng, William Herman and 8 more

Open access · hybridAbstract read
In one paragraph

Article in PharmacoEconomics, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers, 7 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
26citing papers in PubMed, 7 pooled it
12.6field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

26 citing papers in PubMed, 7 syntheses or guidelines pooled it, 41 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Trial
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Review
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors at 10 institutions in 6 countries.

Seamus KentHealth Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, UK.ORCID 0000-0001-7298-3163
Frauke BeckerHealth Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, UK.
Talitha FeenstraNational Institute for Public Health and the Environment (RIVM), Centre for Nutrition, Prevention and Health Services Research, Bilthoven, The Netherlands.
An Tran-DuyCentre for Health Policy, Melbourne School of Population and Global Health, The University of Melbourne, Melbourne, Australia.
Iryna SchlackowHealth Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, UK.
Michelle TewCentre for Health Policy, Melbourne School of Population and Global Health, The University of Melbourne, Melbourne, Australia.
Ping ZhangDivision of Diabetes Translation, Centres for Disease Control and Prevention, Atlanta, USA.
Wen YeSchool of Public Health, University of Michigan, Ann Arbor, USA.
Shi LizhengDepartment of Health Management and Policy, School of Public Health and Tropical Medicine, Tulane University, New Orleans, USA.
William HermanSchool of Public Health, University of Michigan, Ann Arbor, USA.
Phil McEwanCentre for Health Economics, Swansea University, Swansea, UK.
Wendelin SchrammGECKO Institute, Heilbronn University, Heilbronn, Germany.
Alastair GrayHealth Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, UK.
Jose LealHealth Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, UK.
Mark LamotteIQVIA, Zaventem, Belgium.
Michael WillisThe Swedish Institute for Health Economics, Lund, Sweden.
Andrew J PalmerCentre for Health Policy, Melbourne School of Population and Global Health, The University of Melbourne, Melbourne, Australia.
Philip ClarkeHealth Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, UK. philip.clarke@ndph.ox.ac.uk.
University of Oxford · GBThe University of Melbourne · AUUniversity of Michigan · USCenters for Disease Control and Prevention · USHeilbronn University · DESwansea University · GBSwedish Institute for Health Economics · SETulane University · USUniversity of Groningen · NLUniversity of Tasmania · AU

Funding

Regional Pilot And Feasibility Study Grants ProgramP30DK020572 · NIDDK · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI DAVID P OLSON · 2013 to 2026
$24.3M
Department of Health NIHR-BRC-1215-20008NIDDK NIH HHS P30 DK020572
6 · The paper itself

Abstract

Transparency in health economic decision modelling is important for engendering confidence in the models and in the reliability of model-based cost-effectiveness analyses. The Mount Hood Diabetes Challenge Network has taken a lead in promoting transparency through validation with biennial conferences in which diabetes modelling groups meet to compare simulated outcomes of pre-specified scenarios often based on the results of pivotal clinical trials. Model registration is a potential method for promoting transparency, while also reducing the duplication of effort. An important network initiative is the ongoing construction of a diabetes model registry (https://www.mthooddiabeteschallenge.com). Following the 2012 International Society for Pharmacoeconomics and Outcomes Research and the Society of Medical Decision Making (ISPOR-SMDM) guidelines, we recommend that modelling groups provide technical and non-technical documentation sufficient to enable model reproduction, but not necessarily provide the model code. We also request that modelling groups upload documentation on the methods and outcomes of validation efforts, and run reference case simulations so that model outcomes can be compared. In this paper, we discuss conflicting definitions of transparency in health economic modelling, and describe the ongoing development of a registry of economic models for diabetes through the Mount Hood Diabetes Challenge Network, its objectives and potential further developments, and highlight the challenges in its construction and maintenance. The support of key stakeholders such as decision-making bodies and journals is key to ensuring the success of this and other registries. In the absence of public funding, the development of a network of modellers is of huge value in enhancing transparency, whether through registries or other means.

Indexed as

Decision Support TechniquesModels, EconomicCost-Benefit AnalysisDecision MakingDiabetes MellitusEconomics, MedicalEconomics, PharmaceuticalHumansOutcome Assessment, Health CareRegistriesReproducibility of Results

Identifiers

PMID31347104
PMCPMC6860461
OpenAlexW2962981208

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.