Evidence map›Paper›PMID 37857643›Full record

ArticleNature communications2023

Automatic correction of performance drift under acquisition shift in medical image classification.

Mélanie Roschewitz, Galvin Khara, Joe Yearsley, Nisha Sharma, Jonathan J James, Éva Ambrózay, Adam Heroux, Peter Kecskemethy, Tobias Rijken, Ben Glocker

Abstract read
In one paragraph

Article in Nature communications, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 20 papers.

0numbers the graph read from it
0cells of the map it votes in
20citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

20 citing papers in PubMed.

  1. Article
  2. Review
  3. Review
  4. Article
  5. Article
  6. Review
  7. Review
  8. Article
  9. Article
  10. Article
  11. Review
  12. Review
  13. Article
  14. [The analysis of invention patents in the field of artificial intelligent medical devices].Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi · 2025
    Review
  15. Article
  16. Observational
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Mélanie RoschewitzKheiron Medical Technologies, London, UK. mb121@imperial.ac.uk.ORCID http://orcid.org/0000-0002-6739-1638
Galvin KharaKheiron Medical Technologies, London, UK.
Joe YearsleyKheiron Medical Technologies, London, UK.
Nisha SharmaLeeds Teaching Hospital NHS Trust, Department of Radiology, Leeds, UK.
Jonathan J JamesNottingham University Hospitals NHS Trust, Nottingham City Hospital, Nottingham Breast Institute, Nottingham, UK.
Éva AmbrózayMaMMa Egészségügyi Zrt., Budapest, Hungary.
Adam HerouxKheiron Medical Technologies, London, UK.
Peter KecskemethyKheiron Medical Technologies, London, UK.
Tobias RijkenKheiron Medical Technologies, London, UK.ORCID http://orcid.org/0009-0005-1522-5418
Ben GlockerKheiron Medical Technologies, London, UK. b.glocker@imperial.ac.uk.ORCID http://orcid.org/0000-0002-4897-9356

Funding

Cancer Research UK 28396
6 · The paper itself

Abstract

Image-based prediction models for disease detection are sensitive to changes in data acquisition such as the replacement of scanner hardware or updates to the image processing software. The resulting differences in image characteristics may lead to drifts in clinically relevant performance metrics which could cause harm in clinical decision making, even for models that generalise in terms of area under the receiver-operating characteristic curve. We propose Unsupervised Prediction Alignment, a generic automatic recalibration method that requires no ground truth annotations and only limited amounts of unlabelled example images from the shifted data distribution. We illustrate the effectiveness of the proposed method to detect and correct performance drift in mammography-based breast cancer screening and on publicly available histopathology data. We show that the proposed method can preserve the expected performance in terms of sensitivity/specificity under various realistic scenarios of image acquisition shift, thus offering an important safeguard for clinical deployment.

Indexed as

Breast NeoplasmsMammographyFemaleHumansImage Processing, Computer-AssistedROC CurveSensitivity and SpecificitySoftware

Identifiers

PMID37857643
PMCPMC10587231

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.