Evidence map›Paper›PMID 39211895›Full record

ArticleInternational journal of computer vision2024

Multimodal Machine Learning in Image-Based and Clinical Biomedicine: Survey and Prospects.

Elisa Warner, Joonsang Lee, William Hsu, Tanveer Syeda-Mahmood, Charles E Kahn, Olivier Gevaert, Arvind Rao

Abstract read
In one paragraph

Article in International journal of computer vision, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers.

0numbers the graph read from it
0cells of the map it votes in
26citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

26 citing papers in PubMed.

  1. Observational
  2. Article
  3. Human Crystallin Variation and Cataract.Investigative ophthalmology & visual science · 2026
    Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Review
  13. Article
  14. Review
  15. Review
  16. Article
  17. Modality-AGnostic image Cascade (MAGIC) for multi-modality cardiac substructure segmentation.Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology · 2026
    Article
  18. Article
  19. Review
  20. Observational
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Elisa WarnerDepartment of Computational Medicine and Bioinformatics, University of Michigan Ann Arbor, 100 Washtenaw Ave., Ann Arbor, MI 48109 USA.ORCID 0000-0001-6694-2701
Joonsang LeeDepartment of Computational Medicine and Bioinformatics, University of Michigan Ann Arbor, 100 Washtenaw Ave., Ann Arbor, MI 48109 USA.
William HsuDepartment of Medical and Imaging Informatics, University of California Los Angeles, 924 Westwood Blvd Ste 420, Los Angeles, CA 90024 USA.
Tanveer Syeda-MahmoodAlmaden Research Center, IBM, 650 Harry Rd., San Jose, CA 95120 USA.
Charles E KahnDepartment of Radiology, University of Pennsylvania, 3400 Spruce St., Philadelphia, PA 19104 USA.
Olivier GevaertCenter for Biomedical Informatics Research, Stanford, 1265 Welch Road, Stanford, CA 94305 USA.
Arvind RaoDepartment of Computational Medicine and Bioinformatics, University of Michigan Ann Arbor, 100 Washtenaw Ave., Ann Arbor, MI 48109 USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Machine learning (ML) applications in medical artificial intelligence (AI) systems have shifted from traditional and statistical methods to increasing application of deep learning models. This survey navigates the current landscape of multimodal ML, focusing on its profound impact on medical image analysis and clinical decision support systems. Emphasizing challenges and innovations in addressing multimodal representation, fusion, translation, alignment, and co-learning, the paper explores the transformative potential of multimodal models for clinical predictions. It also highlights the need for principled assessments and practical implementation of such models, bringing attention to the dynamics between decision support systems and healthcare providers and personnel. Despite advancements, challenges such as data biases and the scarcity of "big data" in many biomedical domains persist. We conclude with a discussion on principled innovation and collaborative efforts to further the mission of seamless integration of multimodal ML models into biomedical practice.

Indexed as

AlignmentArtificial intelligenceCo-learningData integrationFusionMachine learningMultimodalRepresentationTranslation

Identifiers

PMID39211895
PMCPMC11349845

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.