Evidence map›Paper›PMID 36316665›Full record

ArticleBMC medical imaging2022

Value assessment of artificial intelligence in medical imaging: a scoping review.

Iben Fasterholdt, Mohammad Naghavi-Behzad, Benjamin S B Rasmussen, Tue Kjølhede, Mette Maria Skjøth, Malene Grubbe Hildebrandt, Kristian Kidholm

Erratum issuedAbstract readScoping Review
In one paragraph

Article in BMC medical imaging, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 14 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Integrating ethical analysis in health technology assessment: opportunities and challenges.International journal of technology assessment in health care · 2026
    Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Health technology assessment framework for artificial intelligence-based technologies.International journal of technology assessment in health care · 2024
    Article
  12. Article
  13. Article
  14. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

7 authors.

Iben FasterholdtCIMT - Centre for Innovative Medical Technology, Odense University Hospital, Sdr. Boulevard 29, Entrance 102, 4rd Floor, 5000, Odense C, Denmark. if@rsyd.dk.ORCID http://orcid.org/0000-0002-4088-5822
Mohammad Naghavi-BehzadDepartment of Clinical Research, University of Southern Denmark, Odense, Denmark.
Benjamin S B RasmussenDepartment of Clinical Research, University of Southern Denmark, Odense, Denmark.
Tue KjølhedeCIMT - Centre for Innovative Medical Technology, Odense University Hospital, Sdr. Boulevard 29, Entrance 102, 4rd Floor, 5000, Odense C, Denmark.
Mette Maria SkjøthDepartment of Dermatology and Allergy Centre, Odense University Hospital, Odense, Denmark.
Malene Grubbe HildebrandtCIMT - Centre for Innovative Medical Technology, Odense University Hospital, Sdr. Boulevard 29, Entrance 102, 4rd Floor, 5000, Odense C, Denmark.
Kristian KidholmCIMT - Centre for Innovative Medical Technology, Odense University Hospital, Sdr. Boulevard 29, Entrance 102, 4rd Floor, 5000, Odense C, Denmark.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundArtificial intelligence (AI) is seen as one of the major disrupting forces in the future healthcare system. However, the assessment of the value of these new technologies is still unclear, and no agreed international health technology assessment-based guideline exists. This study provides an overview of the available literature in the value assessment of AI in the field of medical imaging.

methodsWe performed a systematic scoping review of published studies between January 2016 and September 2020 using 10 databases (Medline, Scopus, ProQuest, Google Scholar, and six related databases of grey literature). Information about the context (country, clinical area, and type of study) and mentioned domains with specific outcomes and items were extracted. An existing domain classification, from a European assessment framework, was used as a point of departure, and extracted data were grouped into domains and content analysis of data was performed covering predetermined themes.

resultsSeventy-nine studies were included out of 5890 identified articles. An additional seven studies were identified by searching reference lists, and the analysis was performed on 86 included studies. Eleven domains were identified: (1) health problem and current use of technology, (2) technology aspects, (3) safety assessment, (4) clinical effectiveness, (5) economics, (6) ethical analysis, (7) organisational aspects, (8) patients and social aspects, (9) legal aspects, (10) development of AI algorithm, performance metrics and validation, and (11) other aspects. The frequency of mentioning a domain varied from 20 to 78% within the included papers. Only 15/86 studies were actual assessments of AI technologies. The majority of data were statements from reviews or papers voicing future needs or challenges of AI research, i.e. not actual outcomes of evaluations.

conclusionsThis review regarding value assessment of AI in medical imaging yielded 86 studies including 11 identified domains. The domain classification based on European assessment framework proved useful and current analysis added one new domain. Included studies had a broad range of essential domains about addressing AI technologies highlighting the importance of domains related to legal and ethical aspects.

Indexed as

AlgorithmsArtificial IntelligenceHumansArtificial intelligenceEvaluationMedical imagingScoping reviewValue assessment

Identifiers

PMID36316665
PMCPMC9620604

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.