Evidence map›Paper›PMID 37769550›Full record

ArticleMedical image analysis2023

A robust and interpretable deep learning framework for multi-modal registration via keypoints.

Alan Q Wang, Evan M Yu, Adrian V Dalca, Mert R Sabuncu

Abstract read
In one paragraph

Article in Medical image analysis, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed.

  1. Article
  2. [A reweighted graph matching-based algorithm for automatic extraction of corresponding landmarks in medical images].Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi · 2026
    Article
  3. Review
  4. Article
  5. From Geometry to Intensity: A Coarse-to-Fine Pipeline for Unsupervised 3D Ultrasound Stitching.Proceedings of SPIE--the International Society for Optical Engineering · 2026
    Article
  6. Article
  7. CARL: A Framework for Equivariant Image Registration.Proceedings. IEEE Computer Society Conference on Computer Vision and Pattern Recognition · 2025
    Article
  8. MultiMorph: On-demand Atlas Construction.Proceedings. IEEE Computer Society Conference on Computer Vision and Pattern Recognition · 2025
    Article
  9. Article
  10. Hierarchical uncertainty estimation for learning-based registration in neuroimaging.... International Conference on Learning Representations · 2025
    Article
  11. Article
  12. Article
  13. Registration by Regression (RbR): a framework for interpretable and flexible atlas registration.Biomedical image registration, ... proceedings. WBIR (Workshop : 2006- ) · 2024
    Article
  14. Article
  15. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Alan Q WangSchool of Electrical and Computer Engineering, Cornell University and Cornell Tech, New York, NY 10044, USA; Department of Radiology, Weill Cornell Medical School, New York, NY 10065, USA. Electronic address: aw847@cornell.edu.
Evan M YuIterative Scopes, Cambridge, MA 02139, USA.
Adrian V DalcaComputer Science and Artificial Intelligence Lab at the Massachusetts Institute of Technology, Cambridge, MA 02139, USA; A.A. Martinos Center for Biomedical Imaging at the Massachusetts General Hospital, Charlestown, MA 02129, USA.
Mert R SabuncuSchool of Electrical and Computer Engineering, Cornell University and Cornell Tech, New York, NY 10044, USA; Department of Radiology, Weill Cornell Medical School, New York, NY 10065, USA.

Funding

FreeSurfer Development, Maintenance, and HardeningR01EB023281 · NIBIB · MASSACHUSETTS GENERAL HOSPITAL · PI Bruce Fischl, Douglas Nowlin Greve · 2016 to 2026
$5.6M
Deep Learning Algorithms for FreeSurferR01AG064027 · NIA · MASSACHUSETTS GENERAL HOSPITAL · PI FISCHL, BRUCE · 2020 to 2024
$3.4M
Diagnosing the undiagnosable: studies of Alzheimer disease mimics and confounders via "neuropathometry" of dissection photos with 3D scanningR01AG070988 · NIA · MASSACHUSETTS GENERAL HOSPITAL · PI IGLESIAS GONZALEZ, JUAN EUGENIO · 2021 to 2025
$2.7M
Advanced machine learning algorithms that integrate genomewide, longitudinal MRI and demographic data to predict future cognitive decline toward dementiaR01AG053949 · NIA · WEILL MEDICAL COLL OF CORNELL UNIV · PI SABUNCU, MERT RORY · 2017 to 2021
$2.4M
Novel Bioinformatics Strategies to Study Associations Between Genetic Variants and Neuroanatomical ShapeR01LM012719 · NLM · CORNELL UNIVERSITY · PI SABUNCU, MERT RORY · 2017 to 2020
$1.4M
NIA NIH HHS R01 AG053949NIA NIH HHS R01 AG064027NIA NIH HHS R01 AG070988NIBIB NIH HHS R01 EB023281NLM NIH HHS R01 LM012719
6 · The paper itself

Abstract

We present KeyMorph, a deep learning-based image registration framework that relies on automatically detecting corresponding keypoints. State-of-the-art deep learning methods for registration often are not robust to large misalignments, are not interpretable, and do not incorporate the symmetries of the problem. In addition, most models produce only a single prediction at test-time. Our core insight which addresses these shortcomings is that corresponding keypoints between images can be used to obtain the optimal transformation via a differentiable closed-form expression. We use this observation to drive the end-to-end learning of keypoints tailored for the registration task, and without knowledge of ground-truth keypoints. This framework not only leads to substantially more robust registration but also yields better interpretability, since the keypoints reveal which parts of the image are driving the final alignment. Moreover, KeyMorph can be designed to be equivariant under image translations and/or symmetric with respect to the input image ordering. Finally, we show how multiple deformation fields can be computed efficiently and in closed-form at test time corresponding to different transformation variants. We demonstrate the proposed framework in solving 3D affine and spline-based registration of multi-modal brain MRI scans. In particular, we show registration accuracy that surpasses current state-of-the-art methods, especially in the context of large displacements. Our code is available at https://github.com/alanqrwang/keymorph.

Indexed as

Deep LearningBrainHumansImage Processing, Computer-AssistedMagnetic Resonance ImagingNeuroimagingImage registrationKeypoint detectionMulti-modal

Identifiers

PMID37769550
PMCPMC10591968

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.