Evidence map›Paper›PMID 42078393›Full record

ArticlemedRxiv : the preprint server for health sciences2026

Multimodal prediction of visual improvement in diabetic macular edema using real-world electronic health records and optical coherence tomography images.

Siqi Sun, Cindy X Cai, Ruochong Fan, Saiyu You, Diep Tran, P Kumar Rao, Marc A Suchard, Yixin Wang, Cecilia S Lee, Aaron Y Lee and 1 more

Abstract readPreprint
In one paragraph

Article in medRxiv : the preprint server for health sciences, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Siqi SunInstitute for Informatics, Data Science and Biostatistics, Washington University in St. Louis, St. Louis, MO.ORCID 0009-0007-7298-7288
Cindy X CaiWilmer Eye Institute, Johns Hopkins School of Medicine, Baltimore, MD.
Ruochong FanInstitute for Informatics, Data Science and Biostatistics, Washington University in St. Louis, St. Louis, MO.
Saiyu YouInstitute for Informatics, Data Science and Biostatistics, Washington University in St. Louis, St. Louis, MO.
Diep TranWilmer Eye Institute, Johns Hopkins School of Medicine, Baltimore, MD.
P Kumar RaoJohn F. Hardesty MD, Department of Ophthalmology and Visual Sciences, Washington University in St. Louis, St. Louis, MO.
Marc A SuchardDepartment of Biostatistics, University of California, Los Angeles, Los Angeles, CA.ORCID 0000-0001-9818-479X
Yixin WangDepartment of Statistics, University of Michigan, Ann Arbor, Ann Arbor, MI.
Cecilia S LeeJohn F. Hardesty MD, Department of Ophthalmology and Visual Sciences, Washington University in St. Louis, St. Louis, MO.
Aaron Y LeeJohn F. Hardesty MD, Department of Ophthalmology and Visual Sciences, Washington University in St. Louis, St. Louis, MO.ORCID 0000-0002-7452-1648
Linying ZhangInstitute for Informatics, Data Science and Biostatistics, Washington University in St. Louis, St. Louis, MO.ORCID 0000-0002-4356-4645

Funding

Translational pharmacoepidemiology: neuroprotection and neurotoxicity of antihypertensives and strong anticholinergicsU19AG066567 · NIA · KAISER FOUNDATION RESEARCH INSTITUTE · PI Paul K Crane, Andrea Z. LaCroix · 2021 to 2026
$80.4M
Aging eyes and aging brains in studying alzheimer's disease: Modern ophthalmic data collection in the adult changes in thought (ACT) studyR01AG060942 · NIA · WASHINGTON UNIVERSITY · PI Cecilia Sungmin Lee · 2019 to 2026
$39.4M
Bridge2AI:Salutogenesis Data Generation ProjectOT2OD032644 · OD · WASHINGTON UNIVERSITY · PI BAXTER, SALLY LIU, CHUTE, CHRISTOPHER G · 2022 to 2025
$32.7M
NIA NIH HHS R01 AG060942NIA NIH HHS U19 AG066567NIH HHS OT2 OD032644
6 · The paper itself

Abstract

Multimodal learning has the potential to improve clinical prediction by integrating complementary data sources, but the incremental value of imaging beyond structured electronic health record (EHR) data remains unclear in real-world settings. We developed a multimodal survival modeling framework integrating optical coherence tomography (OCT) and EHR data to predict time to visual improvement in patients with diabetic macular edema (DME), and evaluated how different ophthalmic foundation model representations contribute to prognostic performance. In a retrospective cohort of 973 patients (1,450 eyes) receiving anti-vascular endothelial growth factor therapy, we compared multimodal models combining 22,227 EHR variables with 196,402 OCT images, with OCT embeddings derived from three ophthalmic foundation models (RETFound, EyeCLIP, and VisionFM). The EHR-only model showed minimal prognostic discrimination (C-index 0.50 [95% CI, 0.45-0.55]). Incorporating OCT improved performance, with the magnitude of improvement depending on the representation. EHR+RETFound achieved the strongest performance (C-index 0.59 [0.54-0.65]), followed by EHR+EyeCLIP (0.57 [0.52-0.62]) and EHR+VisionFM (0.56 [0.51-0.61]). Multimodal models, particularly EHR+RETFound, demonstrated improved risk stratification with clearer separation of Kaplan-Meier curves. Partial information decomposition revealed that prognostic information was dominated by modality-specific contributions, with OCT and EHR providing largely distinct signals and minimal shared information. The magnitude of OCT-specific contribution varied across foundation models and aligned with observed performance differences. These findings indicate that OCT provides complementary prognostic value beyond structured clinical data, but gains are modest and depend strongly on representation choice. Our results highlight both the promise of multimodal modeling for personalized prognosis and the need for rigorous, context-specific evaluation of foundation models in real-world clinical settings.

Identifiers

PMID42078393
PMCPMC13131729

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.