Rapid patient-specific neural networks for X-ray to volume registration
Abstract
Advanced navigation techniques in image-guided interventions and surgical robotics require the rapid and precise alignment of three-dimensional (3D) preoperative volumes (such as computed tomography and magnetic resonance imaging) to two-dimensional (2D) intraoperative images (such as X-ray fluoroscopy)1,2. However, existing 2D/3D registration methods fail to generalize across the broad spectrum of fluoroscopy-guided procedures: intensity-based optimizers require per-individual hyperparameter tuning3,4, while deep-learning approaches demand extensive manually labelled datasets and remain constrained to the specific anatomy on which they were trained5,6. Here, to address these limitations, we present xvr-a self-supervised framework that combines patient-specific neural networks with gradient-based optimization for automatic 2D/3D registration. xvr uses physics-based simulation to generate training data from a patient's own preoperative scan, eliminating the need for manual annotation. We present a foundation model pretrained on thousands of whole-body scans, achieving patient-specific adaptation to any anatomical region with only 5 min of fine-tuning. In to our knowledge the largest evaluation of 2D/3D registration on real fluoroscopy to date, xvr achieves high accuracy in seconds across diverse anatomical structures, volumetric imaging modalities and hospitals, improving on the accuracy of existing methods by an order of magnitude. xvr makes pan-anatomical 2D/3D rigid…
Read the paper
Related studies
- The potential and limitations of neutrons, electrons and X-rays for atomic resolution microscopy of unstained biological molecules
- X-ray-Computed Tomography Contrast Agents
- Reactivity of Surface Species in Heterogeneous Catalysts Probed by In Situ X-ray Absorption Techniques
- Single-crystal X-ray diffraction studies on structural transformations of porous coordination polymers
- Investigation of solid/vapor interfaces using ambient pressure X-ray photoelectron spectroscopy
- Resonant X-Ray Scattering Studies of Charge Order in Cuprates
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.