Evidence map›Paper›PMID 37149669›Full record

ArticleScientific reports2023

Generalising uncertainty improves accuracy and safety of deep learning analytics applied to oncology.

Samual MacDonald, Helena Foley, Melvyn Yap, Rebecca L Johnston, Kaiah Steven, Lambros T Koufariotis, Sowmya Sharma, Scott Wood, Venkateswar Addala, John V Pearson and 4 more

Abstract read
In one paragraph

Article in Scientific reports, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Review
  2. Review
  3. Article
  4. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Samual MacDonaldMax Kelsen, Brisbane, QLD, Australia.
Helena FoleyMax Kelsen, Brisbane, QLD, Australia.
Melvyn YapMax Kelsen, Brisbane, QLD, Australia.
Rebecca L JohnstonQIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia.
Kaiah StevenMax Kelsen, Brisbane, QLD, Australia.
Lambros T KoufariotisQIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia.
Sowmya SharmaQIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia.
Scott WoodQIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia.
Venkateswar AddalaQIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia.
John V PearsonQIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia.
Fred RoostaARC Training Centre for Information Resilience (CIRES), Brisbane, Australia.
Nicola WaddellQIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia.
Olga KondrashovaQIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia. olga.kondrashova@qimrberghofer.edu.au.
Maciej TrzaskowskiMax Kelsen, Brisbane, QLD, Australia. m.trzaskowski@uq.edu.au.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Uncertainty estimation is crucial for understanding the reliability of deep learning (DL) predictions, and critical for deploying DL in the clinic. Differences between training and production datasets can lead to incorrect predictions with underestimated uncertainty. To investigate this pitfall, we benchmarked one pointwise and three approximate Bayesian DL models for predicting cancer of unknown primary, using three RNA-seq datasets with 10,968 samples across 57 cancer types. Our results highlight that simple and scalable Bayesian DL significantly improves the generalisation of uncertainty estimation. Moreover, we designed a prototypical metric-the area between development and production curve (ADP), which evaluates the accuracy loss when deploying models from development to production. Using ADP, we demonstrate that Bayesian DL improves accuracy under data distributional shifts when utilising 'uncertainty thresholding'. In summary, Bayesian DL is a promising approach for generalising uncertainty, improving performance, transparency, and safety of DL models for deployment in the real world.

Indexed as

Deep LearningBayes TheoremMedical OncologyReproducibility of ResultsUncertainty

Identifiers

PMID37149669
PMCPMC10164181

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.