Evidence map›Paper›PMID 39138215›Full record

ArticleNature communications2024

End-to-end reproducible AI pipelines in radiology using the cloud.

Dennis Bontempi, Leonard Nuernberg, Suraj Pai, Deepa Krishnaswamy, Vamsi Thiriveedhi, Ahmed Hosny, Raymond H Mak, Keyvan Farahani, Ron Kikinis, Andrey Fedorov and 1 more

Abstract read
In one paragraph

Article in Nature communications, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Review
  5. Review
  6. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Dennis BontempiArtificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA.ORCID 0000-0003-0775-5679
Leonard NuernbergArtificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Suraj PaiArtificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA.ORCID 0000-0001-8043-2230
Deepa KrishnaswamyDepartment of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA.ORCID 0000-0002-3235-1222
Vamsi ThiriveedhiDepartment of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA.
Ahmed HosnyArtificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Raymond H MakArtificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA.ORCID 0000-0002-8754-0565
Keyvan FarahaniNational Heart, Lung, and Blood Institute, National Institutes of Health, Bethesda, MD, USA.
Ron KikinisDepartment of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA.ORCID 0000-0001-7227-7058
Andrey FedorovDepartment of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA.
Hugo J W L AertsArtificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA. haerts@bwh.harvard.edu.ORCID 0000-0002-2122-2003

Funding

Training and DisseminationP41EB015902 · NIBIB · BRIGHAM AND WOMEN'S HOSPITAL · PI KIKINIS, RON, WESTIN, CARL-FREDRIK · 2012 to 2022
$20.9M
EC | EU Framework Programme for Research and Innovation H2020 | H2020 Priority Excellent Science | H2020 European Research Council (H2020 Excellent Science - European Research Council) 866504Foundation for the National Institutes of Health (Foundation for the National Institutes of Health, Inc.) HHSN261201500003lNCI NIH HHS HHSN261201500003CNCI NIH HHS HHSN261201500003INIBIB NIH HHS P41 EB015902
6 · The paper itself

Abstract

Artificial intelligence (AI) algorithms hold the potential to revolutionize radiology. However, a significant portion of the published literature lacks transparency and reproducibility, which hampers sustained progress toward clinical translation. Although several reporting guidelines have been proposed, identifying practical means to address these issues remains challenging. Here, we show the potential of cloud-based infrastructure for implementing and sharing transparent and reproducible AI-based radiology pipelines. We demonstrate end-to-end reproducibility from retrieving cloud-hosted data, through data pre-processing, deep learning inference, and post-processing, to the analysis and reporting of the final results. We successfully implement two distinct use cases, starting from recent literature on AI-based biomarkers for cancer imaging. Using cloud-hosted data and computing, we confirm the findings of these studies and extend the validation to previously unseen data for one of the use cases. Furthermore, we provide the community with transparent and easy-to-extend examples of pipelines impactful for the broader oncology field. Our approach demonstrates the potential of cloud resources for implementing, sharing, and using reproducible and transparent AI pipelines, which can accelerate the translation into clinical solutions.

Indexed as

Artificial IntelligenceCloud ComputingAlgorithmsDeep LearningHumansImage Processing, Computer-AssistedNeoplasmsRadiologyReproducibility of Results

Identifiers

PMID39138215
PMCPMC11322541

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.