Evidence map›Paper›PMID 37291435›Full record

ArticleNature biomedical engineering2023

Robust and data-efficient generalization of self-supervised machine learning for diagnostic imaging.

Shekoofeh Azizi, Laura Culp, Jan Freyberg, Basil Mustafa, Sebastien Baur, Simon Kornblith, Ting Chen, Nenad Tomasev, Jovana Mitrović, Patricia Strachan and 26 more

Abstract read
PubMed Publisher
In one paragraph

Article in Nature biomedical engineering, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 115 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
115citing papers in PubMed, 1 pooled it
37.2field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

115 citing papers in PubMed, 1 synthesis or guideline pooled it, 215 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Review
  4. Review
  5. Article
  6. Review
  7. Article
  8. Article
  9. Diagnostic accuracy of image-based deep learning for glaucomatous optic neuropathy detection: a systematic review and meta-analysis.Graefe's archive for clinical and experimental ophthalmology = Albrecht von Graefes Archiv fur klinische und experimentelle Ophthalmologie · 2026
    Article
  10. Review
  11. Article
  12. Article
  13. Autodidactic dense anatomical models.Medical image analysis · 2026
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

55 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

36 authors at 4 institutions in 2 countries.

Shekoofeh Azizi *Google Research, Mountain View, CA, USA. shekazizi@google.com.ORCID 0000-0002-7447-6031
Laura Culp *Google Research, Mountain View, CA, USA.
Jan Freyberg *Google Research, Mountain View, CA, USA.
Basil MustafaGoogle Research, Mountain View, CA, USA.
Sebastien BaurGoogle Research, Mountain View, CA, USA.
Simon KornblithGoogle Research, Mountain View, CA, USA.
Ting ChenGoogle Research, Mountain View, CA, USA.
Nenad TomasevDeepMind, London, UK.
Jovana MitrovićDeepMind, London, UK.
Patricia StrachanGoogle Research, Mountain View, CA, USA.
S Sara MahdaviGoogle Research, Mountain View, CA, USA.
Ellery WulczynGoogle Research, Mountain View, CA, USA.
Boris BabenkoGoogle Research, Mountain View, CA, USA.ORCID 0000-0002-3013-3678
Megan WalkerGoogle Research, Mountain View, CA, USA.
Aaron LohGoogle Research, Mountain View, CA, USA.
Po-Hsuan Cameron ChenGoogle Research, Mountain View, CA, USA.
Yuan LiuGoogle Research, Mountain View, CA, USA.
Pinal BavishiGoogle Research, Mountain View, CA, USA.
Scott Mayer McKinneyGoogle Research, Mountain View, CA, USA.
Jim WinkensGoogle Research, Mountain View, CA, USA.
Abhijit Guha RoyGoogle Research, Mountain View, CA, USA.
Zach BeaverGoogle Research, Mountain View, CA, USA.
Fiona RyanGeorgia Institute of Technology, Computer Science, Atlanta, GA, USA.
Justin KrogueGoogle Research, Mountain View, CA, USA.ORCID 0000-0002-6756-4877
Mozziyar EtemadiSchool of Medicine/School of Engineering, Northwestern University, Chicago, IL, USA.
Umesh TelangGoogle Research, Mountain View, CA, USA.ORCID 0000-0003-0217-1885
Yun LiuGoogle Research, Mountain View, CA, USA.ORCID 0000-0003-4079-8275
Lily PengGoogle Research, Mountain View, CA, USA.
Greg S CorradoGoogle Research, Mountain View, CA, USA.
Dale R WebsterGoogle Research, Mountain View, CA, USA.ORCID 0000-0002-3023-8824
David FleetGoogle Research, Mountain View, CA, USA.
Geoffrey HintonGoogle Research, Mountain View, CA, USA.
Neil HoulsbyGoogle Research, Mountain View, CA, USA.
Alan KarthikesalingamGoogle Research, Mountain View, CA, USA. alankarthi@google.com.
Mohammad NorouziGoogle Research, Mountain View, CA, USA.
Vivek NatarajanGoogle Research, Mountain View, CA, USA. natviv@google.com.
Google (United States) · USGoogle DeepMind (United Kingdom) · GBGeorgia Institute of Technology · USNorthwestern University · US

Funding

Cancer Research UK
6 · The paper itself

Abstract

Machine-learning models for medical tasks can match or surpass the performance of clinical experts. However, in settings differing from those of the training dataset, the performance of a model can deteriorate substantially. Here we report a representation-learning strategy for machine-learning models applied to medical-imaging tasks that mitigates such 'out of distribution' performance problem and that improves model robustness and training efficiency. The strategy, which we named REMEDIS (for 'Robust and Efficient Medical Imaging with Self-supervision'), combines large-scale supervised transfer learning on natural images and intermediate contrastive self-supervised learning on medical images and requires minimal task-specific customization. We show the utility of REMEDIS in a range of diagnostic-imaging tasks covering six imaging domains and 15 test datasets, and by simulating three realistic out-of-distribution scenarios. REMEDIS improved in-distribution diagnostic accuracies up to 11.5% with respect to strong supervised baseline models, and in out-of-distribution settings required only 1-33% of the data for retraining to match the performance of supervised models retrained using all available data. REMEDIS may accelerate the development lifecycle of machine-learning models for medical imaging.

Indexed as

Machine LearningSupervised Machine LearningDiagnostic Imaging

Identifiers

PMID37291435
OpenAlexW4379878309

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.