Evidence map›Paper›PMID 35175381›Full record

ArticleEuropean radiology2022

The importance of multi-modal imaging and clinical information for humans and AI-based algorithms to classify breast masses (INSPiRED 003): an international, multicenter analysis.

André Pfob, Chris Sidey-Gibbons, Richard G Barr, Volker Duda, Zaher Alwafai, Corinne Balleyguier, Dirk-André Clevert, Sarah Fastner, Christina Gomez, Manuela Goncalo and 19 more

Registry-linked trialAbstract readMulticenter Study
In one paragraph

Article in European radiology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT02638935 (Evaluation of Virtual Touch Tissue Imaging Quantification), which is not on this map. Cited by 12 papers.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT02638935 nacompletednot on this map

Evaluation of Virtual Touch Tissue Imaging Quantification (VTIQ - 2D-SWE) in the Assessment of BI-RADS® 3 and 4 Lesions: Can Patient Selection for Biopsy be Improved? - A Confirmatory Multi-Center-Study

TypeinterventionalSponsorHeidelberg UniversityRan2016 to 2019Enrolled1,304ConditionsBreast NeoplasmsArmsUltrasound- Virtual Touch Tissue Imaging Quantification
3 · Its place in the literature

Who cites it

12 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Machine learning and new insights for breast cancer diagnosis.The Journal of international medical research · 2024
    Review
  8. Review
  9. Article
  10. Review
  11. Article
  12. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

29 authors.

André PfobUniversity Breast Unit, Department of Obstetrics and Gynecology, Heidelberg University Hospital, Im Neuenheimer Feld 440, 69120, Heidelberg, Germany.
Chris Sidey-GibbonsMD Anderson Center for INSPiRED Cancer Care (Integrated Systems for Patient-Reported Data), The University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Richard G BarrDepartment of Radiology, Northeast Ohio Medical University, Ravenna, OH, USA.
Volker DudaDepartment of Gynecology and Obstetrics, University of Marburg, Marburg, Germany.
Zaher AlwafaiDepartment of Gynecology and Obstetrics, University of Greifswald, Greifswald, Germany.
Corinne BalleyguierDepartment of Radiology, Institut Gustave Roussy, Villejuif Cedex, France.
Dirk-André ClevertDepartment of Radiology, University Hospital Munich-Grosshadern, Munich, Germany.
Sarah FastnerUniversity Breast Unit, Department of Obstetrics and Gynecology, Heidelberg University Hospital, Im Neuenheimer Feld 440, 69120, Heidelberg, Germany.
Christina GomezUniversity Breast Unit, Department of Obstetrics and Gynecology, Heidelberg University Hospital, Im Neuenheimer Feld 440, 69120, Heidelberg, Germany.
Manuela GoncaloDepartment of Radiology, University of Coimbra, Coimbra, Portugal.
Ines GruberDepartment of Gynecology and Obstetrics, University of Tuebingen, Tuebingen, Germany.
Markus HahnDepartment of Gynecology and Obstetrics, University of Tuebingen, Tuebingen, Germany.
André HennigsUniversity Breast Unit, Department of Obstetrics and Gynecology, Heidelberg University Hospital, Im Neuenheimer Feld 440, 69120, Heidelberg, Germany.
Panagiotis KapetasDepartment of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, Vienna, Austria.
Sheng-Chieh LuMD Anderson Center for INSPiRED Cancer Care (Integrated Systems for Patient-Reported Data), The University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Juliane NeesUniversity Breast Unit, Department of Obstetrics and Gynecology, Heidelberg University Hospital, Im Neuenheimer Feld 440, 69120, Heidelberg, Germany.
Ralf OhlingerDepartment of Gynecology and Obstetrics, University of Greifswald, Greifswald, Germany.
Fabian RiedelUniversity Breast Unit, Department of Obstetrics and Gynecology, Heidelberg University Hospital, Im Neuenheimer Feld 440, 69120, Heidelberg, Germany.
Matthieu RuttenDepartment of Radiology, Jeroen Bosch Hospital, 's-Hertogenbosch, The Netherlands.
Benedikt SchaefgenUniversity Breast Unit, Department of Obstetrics and Gynecology, Heidelberg University Hospital, Im Neuenheimer Feld 440, 69120, Heidelberg, Germany.
Maximilian SchuesslerNational Center for Tumor Diseases, Heidelberg University Hospital, Heidelberg, Germany.
Anne StieberUniversity Breast Unit, Department of Obstetrics and Gynecology, Heidelberg University Hospital, Im Neuenheimer Feld 440, 69120, Heidelberg, Germany.
Riku TogawaUniversity Breast Unit, Department of Obstetrics and Gynecology, Heidelberg University Hospital, Im Neuenheimer Feld 440, 69120, Heidelberg, Germany.
Mitsuhiro TozakiDepartment of Radiology, Sagara Hospital, Kagoshima, Japan.
Sebastian WojcinskiDepartment of Gynecology and Obstetrics, Breast Cancer Center, Klinikum Bielefeld Mitte GmbH, Bielefeld, Germany.
Cai XuMD Anderson Center for INSPiRED Cancer Care (Integrated Systems for Patient-Reported Data), The University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Geraldine RauchInstitute of Biometry and Clinical Epidemiology, Charité - Universitätsmedizin Berlin, Freie Universität Berlin, Humboldt-Universität Zu Berlin, Berlin , Germany.
Joerg HeilUniversity Breast Unit, Department of Obstetrics and Gynecology, Heidelberg University Hospital, Im Neuenheimer Feld 440, 69120, Heidelberg, Germany.
Michael GolattaUniversity Breast Unit, Department of Obstetrics and Gynecology, Heidelberg University Hospital, Im Neuenheimer Feld 440, 69120, Heidelberg, Germany. Michael.golatta@med.uni-heidelberg.de.ORCID http://orcid.org/0000-0002-2605-0060

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesAI-based algorithms for medical image analysis showed comparable performance to human image readers. However, in practice, diagnoses are made using multiple imaging modalities alongside other data sources. We determined the importance of this multi-modal information and compared the diagnostic performance of routine breast cancer diagnosis to breast ultrasound interpretations by humans or AI-based algorithms.

methodsPatients were recruited as part of a multicenter trial (NCT02638935). The trial enrolled 1288 women undergoing routine breast cancer diagnosis (multi-modal imaging, demographic, and clinical information). Three physicians specialized in ultrasound diagnosis performed a second read of all ultrasound images. We used data from 11 of 12 study sites to develop two machine learning (ML) algorithms using unimodal information (ultrasound features generated by the ultrasound experts) to classify breast masses which were validated on the remaining study site. The same ML algorithms were subsequently developed and validated on multi-modal information (clinical and demographic information plus ultrasound features). We assessed performance using area under the curve (AUC).

resultsOf 1288 breast masses, 368 (28.6%) were histopathologically malignant. In the external validation set (n = 373), the performance of the two unimodal ultrasound ML algorithms (AUC 0.83 and 0.82) was commensurate with performance of the human ultrasound experts (AUC 0.82 to 0.84; p for all comparisons > 0.05). The multi-modal ultrasound ML algorithms performed significantly better (AUC 0.90 and 0.89) but were statistically inferior to routine breast cancer diagnosis (AUC 0.95, p for all comparisons ≤ 0.05).

conclusionsThe performance of humans and AI-based algorithms improves with multi-modal information. KEY POINTS: • The performance of humans and AI-based algorithms improves with multi-modal information. • Multimodal AI-based algorithms do not necessarily outperform expert humans. • Unimodal AI-based algorithms do not represent optimal performance to classify breast masses.

Indexed as

Artificial IntelligenceBreast NeoplasmsAlgorithmsBreastFemaleHumansMultimodal ImagingArtificial intelligenceBreast cancerMachine learningUltrasonography

Identifiers

PMID35175381
PMCPMC9123064

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.