Evidence map›Paper›PMID 38795956›Full record

ArticleValue in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research2024

Consolidated Health Economic Evaluation Reporting Standards for Interventions That Use Artificial Intelligence (CHEERS-AI).

Jamie Elvidge, Claire Hawksworth, Tuba Saygın Avşar, Antal Zemplenyi, Anastasia Chalkidou, Stavros Petrou, Zsuzsanna Petykó, Divya Srivastava, Gunjan Chandra, Julien Delaye and 8 more

Abstract read
In one paragraph

Article in Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 40 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
40citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

40 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Review
  14. Review
  15. Review
  16. Review
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors.

Jamie ElvidgeNational Institute for Health and Care Excellence (NICE), England, UK. Electronic address: jamie.elvidge@nice.org.uk.
Claire HawksworthNational Institute for Health and Care Excellence (NICE), England, UK.
Tuba Saygın AvşarNational Institute for Health and Care Excellence (NICE), England, UK.
Antal ZemplenyiCenter for Health Technology Assessment and Pharmacoeconomic Research, University of Pécs, Pécs, Hungary; University of Colorado Anschutz Medical Campus, Denver, CO, USA; Syreon Research Institute, Budapest, Hungary.
Anastasia ChalkidouNational Institute for Health and Care Excellence (NICE), England, UK.
Stavros PetrouNuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, England, UK.
Zsuzsanna PetykóSyreon Research Institute, Budapest, Hungary.
Divya SrivastavaDepartment of Health Policy, London School of Economics and Political Science, London, England, UK.
Gunjan ChandraBiomimetics and Intelligent Systems Group, University of Oulu, Oulu, Finland.
Julien DelayeEURORDIS, Brussels, Belgium.
Alastair DennistonInstitute of Inflammation and Ageing, University of Birmingham, Birmingham, England, UK.
Manuel GomesDepartment of Primary Care and Population Health, University College London, England, UK.
Saskia KniesNational Healthcare Institute (ZIN), Diemen, The Netherlands.
Petros NousiosDental and Pharmaceutical Benefits Agency (TLV), Stockholm, Sweden.
Pekka SiirtolaBiomimetics and Intelligent Systems Group, University of Oulu, Oulu, Finland.
Junfeng WangDivision of Pharmacoepidemiology and Clinical Pharmacology, Utrecht University, Utrecht, The Netherlands.
Dalia DawoudNational Institute for Health and Care Excellence (NICE), England, UK.
CHEERS-AI Steering Group

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesEconomic evaluations (EEs) are commonly used by decision makers to understand the value of health interventions. The Consolidated Health Economic Evaluation Reporting Standards (CHEERS 2022) provide reporting guidelines for EEs. Healthcare systems will increasingly see new interventions that use artificial intelligence (AI) to perform their function. We developed Consolidated Health Economic Evaluation Reporting Standards for Interventions that use AI (CHEERS-AI) to ensure EEs of AI-based health interventions are reported in a transparent and reproducible manner.

methodsPotential CHEERS-AI reporting items were informed by 2 published systematic literature reviews of EEs and a contemporary update. A Delphi study was conducted using 3 survey rounds to elicit multidisciplinary expert views on 26 potential items, through a 9-point Likert rating scale and qualitative comments. An online consensus meeting was held to finalize outstanding reporting items. A digital health patient group reviewed the final checklist from a patient perspective.

resultsA total of 58 participants responded to survey round 1, 42, and 31 of whom responded to rounds 2 and 3, respectively. Nine participants joined the consensus meeting. Ultimately, 38 reporting items were included in CHEERS-AI. They comprised the 28 original CHEERS 2022 items, plus 10 new AI-specific reporting items. Additionally, 8 of the original CHEERS 2022 items were elaborated on to ensure AI-specific nuance is reported.

conclusionsCHEERS-AI should be used when reporting an EE of an intervention that uses AI to perform its function. CHEERS-AI will help decision makers and reviewers to understand important AI-specific details of an intervention, and any implications for the EE methods used and cost-effectiveness conclusions.

Indexed as

Artificial IntelligenceDelphi TechniqueChecklistConsensusCost-Benefit AnalysisEconomics, MedicalHumansSurveys and Questionnairesartificial intelligenceCHEERS checklisthealth economic evaluationreporting guideline

Identifiers

PMID38795956
PMCPMC11343728

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.