Evidence map›Paper›PMID 38655383›Full record

ArticleMedical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention2023

Unified Brain MR-Ultrasound Synthesis using Multi-Modal Hierarchical Representations.

Reuben Dorent, Nazim Haouchine, Fryderyk Kogl, Samuel Joutard, Parikshit Juvekar, Erickson Torio, Alexandra Golby, Sebastien Ourselin, Sarah Frisken, Tom Vercauteren and 2 more

Abstract read
In one paragraph

Article in Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Review
  2. Article
  3. Unified Cross-Modal Medical Image Synthesis With Hierarchical Mixture of Product-of-Experts.IEEE transactions on pattern analysis and machine intelligence · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Patient-Specific Real-Time Segmentation in Trackerless Brain Ultrasound.Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention · 2024
    Article
  8. Article
  9. ReMIND: The Brain Resection Multimodal Imaging Database.medRxiv : the preprint server for health sciences · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Reuben DorentHarvard Medical School, Brigham and Women's Hospital, Boston, MA, USA.
Nazim HaouchineHarvard Medical School, Brigham and Women's Hospital, Boston, MA, USA.
Fryderyk KoglHarvard Medical School, Brigham and Women's Hospital, Boston, MA, USA.
Samuel JoutardKing's College London, London, United Kingdom.
Parikshit JuvekarHarvard Medical School, Brigham and Women's Hospital, Boston, MA, USA.
Erickson TorioHarvard Medical School, Brigham and Women's Hospital, Boston, MA, USA.
Alexandra GolbyHarvard Medical School, Brigham and Women's Hospital, Boston, MA, USA.
Sebastien OurselinKing's College London, London, United Kingdom.
Sarah FriskenHarvard Medical School, Brigham and Women's Hospital, Boston, MA, USA.
Tom VercauterenKing's College London, London, United Kingdom.
Tina KapurHarvard Medical School, Brigham and Women's Hospital, Boston, MA, USA.
William M WellsHarvard Medical School, Brigham and Women's Hospital, Boston, MA, USA.

Funding

Wellcome Trust 203148
6 · The paper itself

Abstract

We introduce MHVAE, a deep hierarchical variational autoencoder (VAE) that synthesizes missing images from various modalities. Extending multi-modal VAEs with a hierarchical latent structure, we introduce a probabilistic formulation for fusing multi-modal images in a common latent representation while having the flexibility to handle incomplete image sets as input. Moreover, adversarial learning is employed to generate sharper images. Extensive experiments are performed on the challenging problem of joint intra-operative ultrasound (iUS) and Magnetic Resonance (MR) synthesis. Our model outperformed multi-modal VAEs, conditional GANs, and the current state-of-the-art unified method (ResViT) for synthesizing missing images, demonstrating the advantage of using a hierarchical latent representation and a principled probabilistic fusion operation. Our code is publicly available.

Indexed as

Brain ResectionImage SynthesisUltrasoundVariational Auto-Encoder

Identifiers

PMID38655383
PMCPMC7615858

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.