Master-slave systems for endovascular catheterization have brought major clinical benefits including reduced radiation doses to the operators, improved precision and stability of the instruments, as well as reduced procedural duration. Emerging deep reinforcement learning (RL) technologies could potentially automate more complex endovascular tasks with enhanced success rates, more consistent motion and reduced fatigue and cognitive workload of the operators. However, the complexity of the pulsatile flows within the vasculature and non-linear behavior of the instruments hinder the use of model-based approaches for RL. This paper describes model-free generative adversarial imitation learning to automate a standard arterial catherization task. The automation policies have been trained in a pre-clinical setting. Detailed validation results show high success rates after skill transfer to a different vascular anatomical model. The quality of the catheter motions also shows less mean and maximum contact forces compared to manual-based approaches.

Accurate real-time catheter segmentation is an important pre-requisite for robot-assisted endovascular intervention. Most of the existing learning-based methods for catheter segmentation and tracking are only trained on smallscale datasets or synthetic data due to the difficulties of ground-truth annotation. Furthermore, the temporal continuity in intraoperative imaging sequences is not fully utilised. In this paper, we present FW-Net, an end-to-end and real-time deep learning framework for endovascular intervention. The proposed FW-Net has three modules: a segmentation network with encoder-decoder architecture, a flow network to extract optical flow information, and a novel flow-guided warping function to learn the frame-to-frame temporal continuity. We show that by effectively learning temporal continuity, the network can successfully segment and track the catheters in real-time sequences using only raw ground-truth for training. Detailed validation results confirm that our FW-Net outperforms stateof-the-art techniques while achieving real-time performance.

Cardiovascular diseases remain as the most common cause of death worldwide. Remotely manipulated robotic systems are utilized to perform minimally invasive endovascular interventions. The main benefits of this methodology include reduced recovery time, improvement of clinical skills and procedural facilitation. Currently, robotic assistance, precision, and stability of instrument manipulation are compensated by the lack of haptic feedback and an excessive amount of radiation to the patient. This paper proposes a novel master-slave robotic platform that aims to bring the haptic feedback benefit on the master side, providing an intuitive user interface, and clinical familiar workflow. The slave robot is capable of manipulating conventional catheters and guidewires in multi-modal imaging environments. The system has been initially tested in a phantom cannulation study under fluoroscopic guidance, evaluating its reliability and procedural protocol. As the slave robot has been entirely produced by additive manufacturing and using pneumatic actuation, MR compatibility is enabled and was evaluated in a preliminary study. Results of both studies strongly support the applicability of the robot in different imaging environments and prospective clinical translation.

Vascular diseases are the most common precursors to ischemic heart disease and stroke, which are two of the leading causes of death worldwide. Endovascular intervention is a minimally invasive surgical approach to treat such diseases. Compared to open surgery, it has the advantages of faster recovery, reduced need for general anesthesia, reduced blood loss and significantly lower mortality. Endovascular procedures require high surgical skills to minimize contacts between the manipulated instruments (catheters and guidewires) and the vessel wall, which represent one of the major risks for the patient. Robotic assistance can potentially improve the precision and stability of instruments manipulation. One key limitation of current commercial robotic platforms is the lack of haptic feedback, preventing their acceptance and limiting the clinical usability. This paper proposes to bring the benefit of haptic feedback to robot-assisted endovascular intervention. Here we hypothesize that the introduction of 3D haptic guidance during robot-assisted endovascular procedure can further improve the surgical performance and safety while overcoming the limitations of currently available technology. The proposed 3D haptic guidance allows the surgeon to sense the vasculature while controlling a catheter through a robotic haptic manipulator. Validation of the system is performed through end-user experiments with vascular surgeons on a bespoke surgical simulator. The obtained results demonstrate that 3D haptic guidance has the potential of improving effectiveness, precision, and safety of endovascular intervention. Furthermore, vascular surgeons found the proposed technology safe and overall easy to use, indicating its potential on real surgical procedures.

Emerging robot-assisted endovascular intervention has the potential to reduce X-ray radiations to the operator while enhancing the stability and dexterity of catheter manipulation. Supervised and shared autonomy of endovascular procedures could add further improvements in reduced fatigue and cognitive workloads of the operator, higher success rates of cannulation and improved surgical outcomes. However, robotic path planning for endovascular procedure is challenging due to complex and non-linear flow dynamics inside the vasculature. This paper presents a learning-based robotic catheterization platform addressing those challenges, this approach incorporates path integral reinforcement learning (RL) framework based on dynamic movement primitives (DMP) to enhance catheterization tasks by a customized robotic manipulator. The robotic trajectories were optimized through RL in order to avoid unwanted contacts between the catheter tip and the vessel wall. The proposed methods can adapt to different flow simulations, vascular models, and catheterization tasks. The quality of the catheterization was evaluated with performance metrics. The results show significant refinement of catheter paths by the proposed approach, resulting in shorter overall lengths and fewer contact forces, which can potentially reduce risks in endothelial wall damages, embolization, and stroke. The results support the development of robotic path planning for endovascular procedures as well as designing intelligent, hands-on robotic navigation platforms.

Robotic and computer assistance can bring significant benefits to endovascular procedures in terms of precision and stability, reduced radiation doses, improved comfort and access to difficult and tortuous anatomy. However, the design of current commercially available platforms tends to alter the natural bedside manipulation skills of the operator, so that the manually acquired experience and dexterity are not well utilized. Furthermore, most of these systems lack of haptic feedback, preventing their acceptance and limiting the clinical usability. In this paper a new robotic platform for endovascular catheterization, the CathBot, is presented. It is an ergonomic master-slave system with navigation system and integrated vision-based haptic feedback, designed to maintain the natural bedside skills of the vascular surgeon. Unlike previous work reported in literature, dynamic motion tracking of both the vessel walls the catheter tip is incorporated to create dynamic active constraints. The system was evaluated through a combined quantitative and qualitative user study simulating catheterization tasks on a phantom. Forces exerted on the phantom were measured. The results showed a 70% decrease in mean force and 61% decrease in maximum force when force feedback is provided. This research provides the first integration of vision-based dynamic active constraints within an ergonomic robotic catheter manipulator. The technological advances presented here, demonstrates that vision-based haptic feedback can improve the effectiveness, precision, and safety of robot-assisted endovascular procedures.

Increasing demands in endovascular intervention have motivated technical skill training and competency-based measures of performance. However, there are no well-established online metrics for technical skill assessment; few studies have explored operator behavioral patterns from catheter motion and operator hand motions. This paper proposes a platform for active online training and objective assessment of endovascular skills, through learning optimum catheter motions from multiple demonstrations. An ungrounded hand-held haptic device for providing intuitive haptic guidance to novice users based on this learnt information is also proposed. Statistical models are implemented to extract the underlying catheter motion patterns, and utilize them for performance evaluation and haptic guidance. The results show significant improvements in endovascular navigation for inexperienced operators. Finer catheter motions were achieved with the provided haptic guidance. The results suggest that the proposed platform can be integrated into current clinical training setups, and motivate the improvement of endovascular training platforms with better realism.