Evidence map›Paper›PMID 38023698›Full record

ArticleBioengineering & translational medicine2023

Deep learning-based multimodal fusion network for segmentation and classification of breast cancers using B-mode and elastography ultrasound images.

Sampa Misra, Chiho Yoon, Kwang-Ju Kim, Ravi Managuli, Richard G Barr, Jongduk Baek, Chulhong Kim

Abstract read
In one paragraph

Article in Bioengineering & translational medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 28 papers.

0numbers the graph read from it
0cells of the map it votes in
28citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

28 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Review
  13. Article
  14. Article
  15. Deep learning in multi-modal breast cancer data fusion: a literature review.Quantitative imaging in medicine and surgery · 2025
    Review
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Sampa MisraDepartment of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, Medical Device Innovation Center, and Graduate School of Artificial Intelligence Pohang University of Science and Technology Pohang South Korea.
Chiho YoonDepartment of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, Medical Device Innovation Center, and Graduate School of Artificial Intelligence Pohang University of Science and Technology Pohang South Korea.
Kwang-Ju KimDaegu-Gyeongbuk Research Center Electronics and Telecommunications Research Institute (ETRI) Daegu South Korea.
Ravi ManaguliDepartment of Bioengineering University of Washington Seattle Washington USA.
Richard G BarrDepartment of Radiology Northeastern Ohio Medical University Youngstown Ohio USA.
Jongduk BaekSchool of Integrated Technology Yonsei University Seoul South Korea.
Chulhong KimDepartment of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, Medical Device Innovation Center, and Graduate School of Artificial Intelligence Pohang University of Science and Technology Pohang South Korea.ORCID https://orcid.org/0000-0001-7249-1257

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Ultrasonography is one of the key medical imaging modalities for evaluating breast lesions. For differentiating benign from malignant lesions, computer-aided diagnosis (CAD) systems have greatly assisted radiologists by automatically segmenting and identifying features of lesions. Here, we present deep learning (DL)-based methods to segment the lesions and then classify benign from malignant, utilizing both B-mode and strain elastography (SE-mode) images. We propose a weighted multimodal U-Net (W-MM-U-Net) model for segmenting lesions where optimum weight is assigned on different imaging modalities using a weighted-skip connection method to emphasize its importance. We design a multimodal fusion framework (MFF) on cropped B-mode and SE-mode ultrasound (US) lesion images to classify benign and malignant lesions. The MFF consists of an integrated feature network (IFN) and a decision network (DN). Unlike other recent fusion methods, the proposed MFF method can simultaneously learn complementary information from convolutional neural networks (CNNs) trained using B-mode and SE-mode US images. The features from the CNNs are ensembled using the multimodal EmbraceNet model and DN classifies the images using those features. The experimental results (sensitivity of 100 ± 0.00% and specificity of 94.28 ± 7.00%) on the real-world clinical data showed that the proposed method outperforms the existing single- and multimodal methods. The proposed method predicts seven benign patients as benign three times out of five trials and six malignant patients as malignant five out of five trials. The proposed method would potentially enhance the classification accuracy of radiologists for breast cancer detection in US images.

Indexed as

breast ultrasound imagesensemble learningimage classificationimage segmentationstrain ultrasound elastographytransfer learning

Identifiers

PMID38023698
PMCPMC10658476

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.