Evidence map›Paper›PMID 38372762›Full record

ArticlePathologie (Heidelberg, Germany)2024

[The model transferability of AI in digital pathology : Potential and reality].

Robin S Mayer, Maximilian N Kinzler, Alexandra K Stoll, Steffen Gretser, Paul K Ziegler, Anna Saborowski, Henning Reis, Arndt Vogel, Peter J Wild, Nadine Flinner

Abstract readEnglish Abstract
In one paragraph

Article in Pathologie (Heidelberg, Germany), 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Review
  2. Review
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Robin S MayerUniversitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland.
Maximilian N KinzlerUniversitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland.
Alexandra K StollUniversitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland.
Steffen GretserUniversitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland.
Paul K ZieglerUniversitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland.
Anna SaborowskiKlinik für Gastroenterologie, Hepatologie, Infektiologie und Endokrinologie, Medizinische Hochschule Hannover, Hannover, Deutschland.
Henning ReisUniversitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland.
Arndt VogelKlinik für Gastroenterologie, Hepatologie, Infektiologie und Endokrinologie, Medizinische Hochschule Hannover, Hannover, Deutschland.
Peter J WildUniversitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland.
Nadine FlinnerUniversitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland. nadine.flinner@ukffm.de.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveArtificial intelligence (AI) holds the potential to make significant advancements in pathology. However, its actual implementation and certification for practical use are currently limited, often due to challenges related to model transferability. In this context, we investigate the factors influencing transferability and present methods aimed at enhancing the utilization of AI algorithms in pathology. MATERIALS AND

methodsVarious convolutional neural networks (CNNs) and vision transformers (ViTs) were trained using datasets from two institutions, along with the publicly available TCGA-MIBC dataset. These networks conducted predictions in urothelial tissue and intrahepatic cholangiocarcinoma (iCCA). The objective was to illustrate the impact of stain normalization, the influence of various artifacts during both training and testing, as well as the effects of the NoisyEnsemble method.

resultsWe were able to demonstrate that stain normalization of slides from different institutions has a significant positive effect on the inter-institutional transferability of CNNs and ViTs (respectively +13% and +10%). In addition, ViTs usually achieve a higher accuracy in the external test (here +1.5%). Similarly, we showcased how artifacts in test data can negatively affect CNN predictions and how incorporating these artifacts during training leads to improvements. Lastly, NoisyEnsembles of CNNs (better than ViTs) were shown to enhance transferability across different tissues and research questions (+7% Bladder, +15% iCCA). DISCUSSION: It is crucial to be aware of the transferability challenge: achieving good performance during development does not necessarily translate to good performance in real-world applications. The inclusion of existing methods to enhance transferability, such as stain normalization and NoisyEnsemble, and their ongoing refinement, is of importance.

Indexed as

Artificial IntelligenceNeural Networks, ComputerAlgorithmsArtifactsArtificial intelligenceCholangiocarcinomaComputer-assisted image interpretationDeep learningNeural networks, computer

Identifiers

PMID38372762
PMCPMC10901943

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.