Evidence map›Paper›PMID 37338353›Full record

ArticleRadiology2023

Combining Deep Learning and Handcrafted Radiomics for Classification of Suspicious Lesions on Contrast-enhanced Mammograms.

Manon P L Beuque, Marc B I Lobbes, Yvonka van Wijk, Yousif Widaatalla, Sergey Primakov, Michael Majer, Corinne Balleyguier, Henry C Woodruff, Philippe Lambin

Abstract read
PubMed Publisher
In one paragraph

Article in Radiology, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 38 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
38citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

38 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Review
  12. Article
  13. Article
  14. Review
  15. Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Breaking barriers: noninvasive AI model for BRAFInternational journal of computer assisted radiology and surgery · 2025
    Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

9 authors.

Manon P L BeuqueFrom the Department of Precision Medicine (M.P.L.B., Y.v.W., Y.W., S.P., H.C.W., P.L.) and Department of Radiology and Nuclear Medicine (M.B.I.L.), GROW School for Oncology and Reproduction, Maastricht University, Universiteitssingel 40, 6229 ER Maastricht, the Netherlands; Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, Maastricht, the Netherlands (M.B.I.L., H.C.W., P.L.); Department of Medical Imaging, Zuyderland Medical Center, Sittard-Geleen, the Netherlands (M.B.I.L.); Department of Imaging, Institut Gustave Roussy, Université Paris Saclay, Villejuif, France (M.M., C.B.); and Biomaps, UMR1281 INSERM, CEA, CNRS, Université Paris-Saclay, Villejuif, France (C.B.).ORCID 0000-0001-6804-5908
Marc B I LobbesFrom the Department of Precision Medicine (M.P.L.B., Y.v.W., Y.W., S.P., H.C.W., P.L.) and Department of Radiology and Nuclear Medicine (M.B.I.L.), GROW School for Oncology and Reproduction, Maastricht University, Universiteitssingel 40, 6229 ER Maastricht, the Netherlands; Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, Maastricht, the Netherlands (M.B.I.L., H.C.W., P.L.); Department of Medical Imaging, Zuyderland Medical Center, Sittard-Geleen, the Netherlands (M.B.I.L.); Department of Imaging, Institut Gustave Roussy, Université Paris Saclay, Villejuif, France (M.M., C.B.); and Biomaps, UMR1281 INSERM, CEA, CNRS, Université Paris-Saclay, Villejuif, France (C.B.).ORCID 0000-0002-2103-6956
Yvonka van WijkFrom the Department of Precision Medicine (M.P.L.B., Y.v.W., Y.W., S.P., H.C.W., P.L.) and Department of Radiology and Nuclear Medicine (M.B.I.L.), GROW School for Oncology and Reproduction, Maastricht University, Universiteitssingel 40, 6229 ER Maastricht, the Netherlands; Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, Maastricht, the Netherlands (M.B.I.L., H.C.W., P.L.); Department of Medical Imaging, Zuyderland Medical Center, Sittard-Geleen, the Netherlands (M.B.I.L.); Department of Imaging, Institut Gustave Roussy, Université Paris Saclay, Villejuif, France (M.M., C.B.); and Biomaps, UMR1281 INSERM, CEA, CNRS, Université Paris-Saclay, Villejuif, France (C.B.).
Yousif WidaatallaFrom the Department of Precision Medicine (M.P.L.B., Y.v.W., Y.W., S.P., H.C.W., P.L.) and Department of Radiology and Nuclear Medicine (M.B.I.L.), GROW School for Oncology and Reproduction, Maastricht University, Universiteitssingel 40, 6229 ER Maastricht, the Netherlands; Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, Maastricht, the Netherlands (M.B.I.L., H.C.W., P.L.); Department of Medical Imaging, Zuyderland Medical Center, Sittard-Geleen, the Netherlands (M.B.I.L.); Department of Imaging, Institut Gustave Roussy, Université Paris Saclay, Villejuif, France (M.M., C.B.); and Biomaps, UMR1281 INSERM, CEA, CNRS, Université Paris-Saclay, Villejuif, France (C.B.).
Sergey PrimakovFrom the Department of Precision Medicine (M.P.L.B., Y.v.W., Y.W., S.P., H.C.W., P.L.) and Department of Radiology and Nuclear Medicine (M.B.I.L.), GROW School for Oncology and Reproduction, Maastricht University, Universiteitssingel 40, 6229 ER Maastricht, the Netherlands; Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, Maastricht, the Netherlands (M.B.I.L., H.C.W., P.L.); Department of Medical Imaging, Zuyderland Medical Center, Sittard-Geleen, the Netherlands (M.B.I.L.); Department of Imaging, Institut Gustave Roussy, Université Paris Saclay, Villejuif, France (M.M., C.B.); and Biomaps, UMR1281 INSERM, CEA, CNRS, Université Paris-Saclay, Villejuif, France (C.B.).ORCID 0000-0002-3856-9740
Michael MajerFrom the Department of Precision Medicine (M.P.L.B., Y.v.W., Y.W., S.P., H.C.W., P.L.) and Department of Radiology and Nuclear Medicine (M.B.I.L.), GROW School for Oncology and Reproduction, Maastricht University, Universiteitssingel 40, 6229 ER Maastricht, the Netherlands; Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, Maastricht, the Netherlands (M.B.I.L., H.C.W., P.L.); Department of Medical Imaging, Zuyderland Medical Center, Sittard-Geleen, the Netherlands (M.B.I.L.); Department of Imaging, Institut Gustave Roussy, Université Paris Saclay, Villejuif, France (M.M., C.B.); and Biomaps, UMR1281 INSERM, CEA, CNRS, Université Paris-Saclay, Villejuif, France (C.B.).ORCID 0000-0003-3120-9176
Corinne BalleyguierFrom the Department of Precision Medicine (M.P.L.B., Y.v.W., Y.W., S.P., H.C.W., P.L.) and Department of Radiology and Nuclear Medicine (M.B.I.L.), GROW School for Oncology and Reproduction, Maastricht University, Universiteitssingel 40, 6229 ER Maastricht, the Netherlands; Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, Maastricht, the Netherlands (M.B.I.L., H.C.W., P.L.); Department of Medical Imaging, Zuyderland Medical Center, Sittard-Geleen, the Netherlands (M.B.I.L.); Department of Imaging, Institut Gustave Roussy, Université Paris Saclay, Villejuif, France (M.M., C.B.); and Biomaps, UMR1281 INSERM, CEA, CNRS, Université Paris-Saclay, Villejuif, France (C.B.).ORCID 0000-0002-0018-8731
Henry C Woodruff *From the Department of Precision Medicine (M.P.L.B., Y.v.W., Y.W., S.P., H.C.W., P.L.) and Department of Radiology and Nuclear Medicine (M.B.I.L.), GROW School for Oncology and Reproduction, Maastricht University, Universiteitssingel 40, 6229 ER Maastricht, the Netherlands; Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, Maastricht, the Netherlands (M.B.I.L., H.C.W., P.L.); Department of Medical Imaging, Zuyderland Medical Center, Sittard-Geleen, the Netherlands (M.B.I.L.); Department of Imaging, Institut Gustave Roussy, Université Paris Saclay, Villejuif, France (M.M., C.B.); and Biomaps, UMR1281 INSERM, CEA, CNRS, Université Paris-Saclay, Villejuif, France (C.B.).ORCID 0000-0001-7911-5123
Philippe Lambin *From the Department of Precision Medicine (M.P.L.B., Y.v.W., Y.W., S.P., H.C.W., P.L.) and Department of Radiology and Nuclear Medicine (M.B.I.L.), GROW School for Oncology and Reproduction, Maastricht University, Universiteitssingel 40, 6229 ER Maastricht, the Netherlands; Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, Maastricht, the Netherlands (M.B.I.L., H.C.W., P.L.); Department of Medical Imaging, Zuyderland Medical Center, Sittard-Geleen, the Netherlands (M.B.I.L.); Department of Imaging, Institut Gustave Roussy, Université Paris Saclay, Villejuif, France (M.M., C.B.); and Biomaps, UMR1281 INSERM, CEA, CNRS, Université Paris-Saclay, Villejuif, France (C.B.).ORCID 0000-0001-7961-0191

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background Handcrafted radiomics and deep learning (DL) models individually achieve good performance in lesion classification (benign vs malignant) on contrast-enhanced mammography (CEM) images. Purpose To develop a comprehensive machine learning tool able to fully automatically identify, segment, and classify breast lesions on the basis of CEM images in recall patients. Materials and Methods CEM images and clinical data were retrospectively collected between 2013 and 2018 for 1601 recall patients at Maastricht UMC+ and 283 patients at Gustave Roussy Institute for external validation. Lesions with a known status (malignant or benign) were delineated by a research assistant overseen by an expert breast radiologist. Preprocessed low-energy and recombined images were used to train a DL model for automatic lesion identification, segmentation, and classification. A handcrafted radiomics model was also trained to classify both human- and DL-segmented lesions. Sensitivity for identification and the area under the receiver operating characteristic curve (AUC) for classification were compared between individual and combined models at the image and patient levels. Results After the exclusion of patients without suspicious lesions, the total number of patients included in the training, test, and validation data sets were 850 (mean age, 63 years ± 8 [SD]), 212 (62 years ± 8), and 279 (55 years ± 12), respectively. In the external data set, lesion identification sensitivity was 90% and 99% at the image and patient level, respectively, and the mean Dice coefficient was 0.71 and 0.80 at the image and patient level, respectively. Using manual segmentations, the combined DL and handcrafted radiomics classification model achieved the highest AUC (0.88 [95% CI: 0.86, 0.91]) (

Indexed as

Deep LearningBreastHumansMammographyMiddle AgedRetrospective StudiesROC Curve

Identifiers

PMID37338353

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.