Image-guided interventional oncology procedures can greatly enhance the outcome of cancer treatment. As an enhancing procedure, oncology smart material delivery can increase cancer therapy's quality, effectiveness, and safety. However, the effectiveness of enhancing procedures highly depends on the accuracy of smart material placement procedures. Inaccurate placement of smart materials can lead to adverse side effects and health hazards. Image guidance can considerably improve the safety and robustness of smart material delivery. In this study, we developed a novel generative deep-learning platform that highly prioritizes clinical practicality and provides the most informative intra-operative feedback for image-guided smart material delivery. XIOSIS generates a patient-specific 3D volumetric computed tomography (CT) from three intraoperative radiographs (X-ray images) acquired by a mobile C-arm during the operation. As the first of its kind, XIOSIS (i) synthesizes the CT from small field-of-view radiographs;(ii) reconstructs the intra-operative spacer distribution; (iii) is robust; and (iv) is equipped with a novel soft-contrast cost function. To demonstrate the effectiveness of XIOSIS in providing intra-operative image guidance, we applied XIOSIS to the duodenal hydrogel spacer placement procedure. We evaluated XIOSIS performance in an image-guided virtual spacer placement and actual spacer placement in two cadaver specimens. XIOSIS showed a clinically acceptable performance, reconstructed the 3D intra-operative hydrogel spacer distribution with an average structural similarity of 0.88 and Dice coefficient of 0.63 and with less than 1 cm difference in spacer location relative to the spinal cord.

Vertebral compression fractures (VCFs), the most common fragility fractures secondary to osteoporosis, affect more than 200 million individuals worldwide. Percutaneous vertebral augmentation is an effective interventional treatment option that is routinely performed across the world. Because fluoroscopy-guided vertebral augmentation is a well-established and safe minimally invasive technique, automating its delivery is among the most important next steps. In this work, we describe the design and evaluation of a novel cannula mounted vertebral augmentation robot in a simulated X-ray environment as a first step toward autonomous vertebral augmentation. The cannula robot employs a piezo stack with inchworm control to place surgical tools within the vertebral body, while X-ray imaging verifies the robot does not interfere with imaging. Finite element analysis of the robot confirms that radiolucent materials were rigid enough to be used in the robot design as expected deformations for the cannula drive, accessory drive, and locking mechanisms$(1.299 \pm 0.034 \ um, 1.280 \pm 0.027\ um$, and$1.960 \pm 0.218\ um$, respectively) did not exceed the stroke lengths of the piezo stacks. An in silico clinical trial based on a human anatomy model suffering from VCF validates that the cannula robot does not impede visualization of the critical anatomy and tool-to-tissue positioning. Together these results demonstrate the feasibility of a cannula mounted robot for vertebral augmentation.

Soft-tissue deformation presents a confounding factor to rigid image registration by introducing image content inconsistent with the underlying motion model, presenting non-correspondent structure with potentially high power, and creating local minima that challenge iterative optimization. In this paper, we introduce a model for registration performance that includes deformable soft tissue as a power-law noise distribution within a statistical framework describing the Cramer-Rao lower bound (CRLB) and root-mean-squared error (RMSE) in registration performance. The model incorporates both cross-correlation and gradient-based similarity metrics, and the model was tested in application to 3D-2D (CT-to-radiograph) and 3D-3D (CT-to-CT) image registration. Predictions accurately reflect the trends in registration error as a function of dose (quantum noise), and the choice of similarity metrics for both registration scenarios. Incorporating soft-tissue deformation as a noise source yields important insight on the limits of registration performance with respect to algorithm design and the clinical application or anatomical context. For example, the model quantifies the advantage of gradient-based similarity metrics in 3D-2D registration, identifies the low-dose limits of registration performance, and reveals the conditions for which the registration performance is fundamentally limited by soft-tissue deformation.

For image-guided procedures, the imaging task is often tied to the registration of intraoperative and preoperative images to a common coordinate system. While the accuracy of this registration is a vital factor in system performance, there is a relatively little work that relates registration accuracy to image quality factors, such as dose, noise, and spatial resolution. To create a theoretical model for such a relationship, we present a Fisher information approach to analyze registration performance in explicit dependence on the underlying image quality factors of image noise, spatial resolution, and signal power spectrum. The model yields analysis of the Cramer-Rao lower bound (CRLB), in registration accuracy as a function of factors governing image quality. Experiments were performed in simulation of computed tomography low-contrast soft tissue images and high-contrast bone (head and neck) images to compare the measured accuracy [root mean squared error (RMSE) of the estimated transformations] with the theoretical lower bound. Analysis of the CRLB reveals that registration performance is closely related to the signal-to-noise ratio of the cross-correlation space. While the lower bound is optimistic, it exhibits consistent trends with experimental findings and yields a method for comparing the performance of various registration methods and similarity metrics. Further analysis validated a method for determining optimal post-processing (image filtering) for registration. Two figures of merit (CRLB and RMSE) are presented that unify models of image quality with registration performance, providing an important guide to optimizing intraoperative imaging with respect to the task of registration.

A 3D-2D image registration method is reported for guiding the placement of surgical devices (e.g., K-wires). The solution registers preoperative CT (and planning data therein) to intraoperative radiographs and computes the pose, shape, and deformation parameters of devices (termed “components”) known to be in the radiographic scene. The deformable known-component registration (dKC-Reg) method was applied in experiments emulating spine surgery to register devices (K-wires and spinal fixation rods) undergoing realistic deformation. A two-stage registration process (i) resolves patient pose from individual radiographs and (ii) registers components represented as polygonal meshes based on a B-spline model. The registration result can be visualized as overlay of the component in CT analogous to surgical navigation but without conventional trackers or fiducials. Target registration error in the tip and orientation of deformable K-wires was (1.5 ± 0.9) mm and (0.6° ± 0.2°), respectively. For spinal fixation rods, the registered components achieved Hausdorff distance of 3.4 mm. Future work includes testing in cadaver and clinical data and extension to more generalized deformation and component models.

Intraoperative localization of target anatomy and critical structures defined in preoperative MR/CT images can be achieved through the use of multimodality deformable registration. We propose a symmetric diffeomorphic deformable registration algorithm incorporating a modality-independent neighborhood descriptor (MIND) and a robust Huber metric for MR-to-CT registration. The method, called MIND Demons, finds a deformation field between two images by optimizing an energy functional that incorporates both the forward and inverse deformations, smoothness on the integrated velocity fields, a modality-insensitive similarity function suitable to multimodality images, and smoothness on the diffeomorphisms themselves. Direct optimization without relying on the exponential map and stationary velocity field approximation used in conventional diffeomorphic Demons is carried out using a Gauss-Newton method for fast convergence. Registration performance and sensitivity to registration parameters were analyzed in simulation, phantom experiments, and clinical studies emulating application in image-guided spine surgery, and results were compared to mutual information (MI) free-form deformation (FFD), local MI (LMI) FFD, normalized MI (NMI) Demons, and MIND with a diffusion-based registration method (MIND-elastic). The method yielded sub-voxel invertibility (0.008 mm) and nonzero-positive Jacobian determinants. It also showed improved registration accuracy in comparison to the reference methods, with mean target registration error (TRE) of 1.7 mm compared to 11.3, 3.1, 5.6, and 2.4 mm for MI FFD, LMI FFD, NMI Demons, and MIND-elastic methods, respectively. Validation in clinical studies demonstrated realistic deformations with sub-voxel TRE in cases of cervical, thoracic, and lumbar spine.

The safety of endoscopic skull base surgery can be enhanced by accurate navigation in preoperative computed tomography (CT) or, more recently, intraoperative cone-beam CT (CBCT). The ability to register real-time endoscopic video with CBCT offers an additional advantage by rendering information directly within the visual scene to account for intraoperative anatomical change. However, tracker localization error ( ∼ 1-2 mm ) limits the accuracy with which video and tomographic images can be registered. This paper reports the first implementation of image-based video-CBCT registration, conducts a detailed quantitation of the dependence of registration accuracy on system parameters, and demonstrates improvement in registration accuracy achieved by the image-based approach. Performance was evaluated as a function of parameters intrinsic to the image-based approach, including system geometry, CBCT image quality, and computational runtime. Overall system performance was evaluated in a cadaver study simulating transsphenoidal skull base tumor excision. Results demonstrated significant improvement in registration accuracy with a mean reprojection distance error of 1.28 mm for the image-based approach versus 1.82 mm for the conventional tracker-based method. Image-based registration was highly robust against CBCT image quality factors of noise and resolution, permitting integration with low-dose intraoperative CBCT.

In this paper, the design, analysis, and fabrication of a gecko-inspired climbing robot are discussed. The robot has kinematics similar to a gecko's climbing gait. It uses peeling and steering mechanisms and an active tail for robust and agile climbing as a novelty. The advantage of this legged robot is that it can explore irregular terrains more robustly. Novel peeling mechanism of the elastomer adhesive pads, as well as steering and stable climbing using an active tail are explored. The design, fabrication, analysis and test of the robot are reported. Experimental results of walking and climbing up to 85deg sloped acrylic surfaces as well as successful steering and peeling mechanism tests are demonstrated. The potential applications foreseen for this kind of robots are inspection, repair, cleaning, and exploration