One of the goals of computer-aided surgery is to register intraoperative data to preoperative model of the anatomy, and hence add complementary information that can facilitate the task of surgical navigation. In this context, mechanical palpation can reveal critical anatomical features such as arteries and cancerous lumps which are stiffer than the surrounding tissue. This work uses position and force measurements obtained during mechanical palpation for registration and stiffness mapping. Prior approaches, including our own, exhaustively palpated the entire organ to achieve this goal. To overcome the costly palpation of the entire organ, a Bayesian optimization framework is introduced to guide the end effector to palpate stiff regions while simultaneously updating the registration of the end effector to an a priori geometric model of the organ, hence enabling the fusion of intraoperative data into the a priori model obtained through imaging. This new framework uses Gaussian processes to model the stiffness distribution and Bayesian optimization to direct where to sample next for maximum information gain. The proposed method was evaluated with experimental data obtained using a Cartesian robot interacting with a silicone organ model and an ex vivo porcine liver.

Surgeons often manually palpate tissue or organs in order to find tumors or other anatomical structures. Information about organ geometry and tissue stiffness gained from palpation can also be extremely useful in robotic surgery for diagnosis, surgical guidance, and registration to other preoperative information. However, it is not always easy to obtain, even if the robot is equipped with force sensors. This paper reports our approach for concurrent estimation of stiffness and surface geometry, using a continuous motion similar to a sweeping palpation motion used by surgeons. Our method relies on force data captured by a tactile sensor rigidly attached to an end-effector probe. We use Gaussian processes to simultaneously estimate geometry and stiffness. The method is not tied to any specific robotic platform and is consistent with a variety of palpation strategies. For simplicity, we discuss the results based on two different palpation primitives. This is our first step towards developing an adaptive high fidelity model reconstruction and path optimization technique.

Multi-backbone continuum robots have been demonstrated to possess wrench sensing capabilities by measuring the actuation load on each backbone and then using elaborate statics models. The ability to sense forces of interaction allows these robots to also control their interaction with the environment. In past studies, the force sensing models were subject to quasi-static assumptions. The goal of this paper is threefold: to update the wrench sensing model taking into account dynamic forces, to investigate the effect of these dynamic forces on the wrench sensing abilities of these robots and to present design atlases that help designers with the determination of critical dimensions ensuring bounded effect of dynamics on wrench sensing. The paper presents a simplified dynamics model using a Lagrangian formulation. This dynamics model is then used to update the wrench estimation model for a single-segment continuum robot. Finally, a set of normalized parameters is used to produce design atlases that help designers predict the effect of dynamics on the wrench estimation model. These results will allow improved performance in force sensing and control for multi-backbone continuum robots. Employing the methods presented in the paper, continuum robots, that have previously demonstrated excellent distal dexterity, will be able to control their force interaction with the anatomy better in future - thereby improving safety and the finesse of surgery.

Registering a surgical tool to an a priori model of the environment is an important first step in computer-aided surgery. In this paper we present an approach for simultaneous registration and stiffness mapping using blind exploration of flexible environments. During contact-based exploration of flexible environments, the physical interaction with the environment can induce local deformation, leading to erroneous registration if not accounted for. To overcome this issue, a new registration method called complementary model update (CMU), is introduced. By incorporating measurements of the contact force, and contact location, we minimize a unique objective function to cancel out the effect of local deformation. We are thus able to acquire the necessary registration parameters using both geometry and stiffness information. The proposed CMU method is evaluated in simulation and using experimental data obtained by probing silicone models and an ex vivo organ.

Human breast tissue is by nature heterogeneous, and in the samples we studied, epithelial tissue is formed by groups of functional breast epithelial cells that are surrounded by stromal tissue in a complex intertwined way. Therefore sampling a specific cell type on an unstained specimen is very difficult. To aid us, we use digital stained images of the same tissue annotated by a certified pathologist to identify the region of interest (ROI) at a coarse magnification and an image-guided positioning system to place the unstained tissue near the AFM probe tip. Using our setup, we could considerably reduce AFM operating time and we believe that our setup is a viable supplement to commercial AFM stages with limited X-Y range.