Collective microrobots enable controlled batch delivery, showing promising application in the biomedical field. However, significant challenges remain in achieving long-distance delivery of collective microrobots in dynamic environments. This study proposes a magnetic actuation strategy for delivering collective cell microrobots in flowing conditions. A magnetic actuation method is developed, and a mobile actuation system with multiple coils coordination is designed to generate spatially isotropic magnetic fields. Experiments of delivering collective microrobots are conducted in flowing conditions, including downstream and upstream with an average flow velocity up to 8.84 mm/s. Results demonstrate that the proposed actuation strategy enhances driving performance in dynamic environments, achieving long-distance delivery of collective microrobots (over 548 mm). The final access rate of microrobots reaches 90.63% and 94.79% in upstream and downstream conditions, respectively. Our strategy provides an efficient control method for delivering collective microrobots, showing potential for targeted delivery in biomedical applications.

Online path planning for magnetic microrobots actuated by electromagnetic system in dynamic flow field presents significant challenges due to time-varying fluid dynamics, energy constraints, and collision risks. Traditional path planning approaches, which often rely on static flow assumptions or simplified geometric models, struggle to balance energy efficiency, path continuity, and adaptability in real-world scenarios. This paper introduces an end-to-end path planner for energy-efficient and collision-free navigation of magnetic helical microrobots, integrating flow field feature extraction and reinforcement learning (RL) framework. Our method employs a transformer encoder to capture contextual correlations of flow field and uses a Soft Actor-Critic (SAC) framework to optimize energy consumption while ensuring dynamic obstacle avoidance. Simulations and experiments in dynamic flow environments validate our approach, demonstrating 14.7% lower energy consumption and robust collision avoidance in several different test scenarios.

Magnetically actuated robots have recently shown great capabilities for remote applications in medical procedures. However, the efficient actuation of magnetic robots with dexterous field and gradient generation in large workspaces remains challenging. To overcome the critical challenges, we report a reconfigurable electromagnetic actuation system (REMA) for regulating magnetic fields (maximum: 17 mT) and gradients (maximum: 120 mT/m) in large workspaces. Reconfigurable coil configurations are achieved by employing three mobile electromagnetic coils mounted on three independent 6-DOF robotic arms. Furthermore, the field characteristics generated by a single coil and three coils were modeled via Finite-element method (FEM) and measurements from experiments, respectively. Since there are non-linearities between desired field generation and coil configuration, we propose a multi-objective optimization (MOO) method for generating the Pareto-optimized coil configuration to achieve field and force control in large workspaces. Finally, extensive experiments were conducted to demonstrate the capability and dexterity of our system for autonomous magnetic manipulation in large workspaces, thus showing its potential for clinical applications. Note to Practitioners—This paper aims to address the dexterous generation of magnetic fields and gradients in large workspaces, aiming to realize accurate, efficient, and automated control of different magnetic robots. This paper introduces a reconfigurable electromagnetic actuation system based on three independent robotic arms with three electromagnetic coils. Subsequently, we propose a multi-objective optimization (MOO) method to regulate the coil configuration for generating different fields and gradients. This approach facilitates the application of magnetically driven helical robots, catheters, and capsule robots in various medical scenarios. The results demonstrate that our proposed platform and optimization strategy can effectively implement magnetic manipulations across diverse application scenarios. Looking ahead, we anticipate integrating our work with medical imaging devices to furnish doctors with enhanced tools for medical applications.

Magnetic continuum robots (MCRs) with active steering capability hold great promise for improving interventional surgery due to their flexibility and controllability. However, achieving real-time tracking and automatic navigation of MCRs in tissue-mimicking multi-bifurcated vessels remains a significant challenge. This work proposes an ultrasound-guided real-time automatic navigation framework for magnetic guidewire robots to improve interventional surgery, including modeling, simulation, tracking and control. An ultrasound-guided magnetically controlled guidewire robot system (UMCGRS) is designed and validated in 3D vascular phantom. An equilibrium guidewire model is established to describe the quasi-static behavior of MCRs in a permanent magnetic field and to derive the control Jacobian for guidewire tip control, which is validated by magnetic navigation simulation. A network-based real-time ultrasound tracking method is developed for accurate guidewire detection (average detection error of 0.81 mm across various vessels), and a model-based path tracking control strategy is proposed for guidewire navigation. Experiments in a femoral artery gelatin phantom with tissue-mimicking environments demonstrate the effectiveness of the tracking and control (average tracking error of 1.50 ± 0.30 mm). The proposed UMCGRS and automatic navigation framework are expected to enhance the autonomy of MCRs, and will provide a reliable solution for improving interventional surgery.

Magnetic continuum robots (MCRs) have become popular owing to their inherent advantages of easy miniaturization without requiring complicated transmission structures. The evolution of MCRs, from initial designs with one embedded magnet to current designs with specific magnetization profile configurations (MPCs), has significantly enhanced their dexterity. While much progress has been achieved, the quantitative index-based evaluation of deformability for different MPCs, which can assist in designing MPCs with enhanced robot deformability, has not been addressed before. Here we use “deformability” to describe the capability for body deflection when an MCR forms different global shapes under an external magnetic field. Therefore, in this paper, we propose methodologies to design and control an MCR composed of modular axially magnetized segments. To guide robot MPC design, for the first time, we introduce a quantitative index-based evaluation strategy to analyze and optimize robot deformability. Additionally, a control framework with neural network-based controllers is developed to endow the robot with two control modes: the robot tip position and orientation ($M_{1}$) and the global shape ($M_{2}$). The excellent performance of the learnt controllers in terms of computation time and accuracy was validated via both simulation and experimental platforms. In the experimental results, the best closed-loop control performance metrics, indicated as the mean absolute errors, were 0.254 mm and 0.626$^\circ$for mode$M_{1}$and 1.564 mm and 0.086$^\circ$for mode$M_{2}$.

This article addresses an autonomous manipulation problem for an underwater vehicle-manipulator system (UVMS) operating in a free-floating way while subjecting to unknown continuous disturbance. More specifically, a composite control scheme composed of disturbance observer (DOB), predictor model network (PM-Net), and nonlinear model predictive control (NMPC), is devised to improve the control performance of UVMS (i.e., unicycle-like UVMS actuated only in the surge, heave, and yaw for vehicle body) in the case of disturbance, model mismatch, and input saturation. A RBF-DOB is formulated by combining a DOB and a Radial Basis Function (RBF) neural network to estimate disturbance at the current step. Then, the PM-Network, composed of a disturbance predictor network and state predictor network, is developed based on long short-term memory (LSTM) network that predicts UVMS state sequences considering model mismatch and disturbance. The NMPC is deployed as a feedback control law to endow the input saturation of the UVMS and produce optimal control action. Compared with conventional DOB control methods using feed-forward compensation of disturbance, the primary merit of the proposed approach is that the disturbance estimated by RBF-DOB is utilized in the PM-Net to predict future UVMS state sequences, which are exploited on the NMPC’s receding optimization. Finally, realistic simulation and relevant experiment are conducted to demonstrate the effectiveness of the proposed method. Note to Practitioners—The motivation behind this article is the autonomous manipulation of an underwater vehicle-manipulator system subjected to unknown disturbance. However, it is not always feasible or straightforward to obtain the external disturbance and unmodeled dynamics for designing robust controllers. On the one hand, how to manipulate the disturbance into the designed controller to generate optimal control action rather than by using feed-forward compensation. On the other hand, the control input saturation often occurs in the UVMS control, especially under the disturbance rejection conditions, where it should be considered in the controller design. Currently, the predominant methods for UVMS control lack a control scheme that provides a complete and credible control strategy that takes the aforementioned issues into consideration. Motivated by the above analysis, this study provides a composite control scheme to deal with the dynamic uncertainties, unknown disturbance, and input saturation. The results of realistic simulation and relevant experiments demonstrate the effectiveness of the proposed method. Hopefully, our control method can provide valuable theoretical and technical guidance to practicing marine engineers for controller design.

Precise trajectory control is imperative to ensure the safety and efficacy of in vivo therapy employing the magnetic helical millirobots. However, achieving accurate 3-D path following of helical millirobots under fluid flow conditions remains challenging due to the presence of the lumped disturbances, encompassing complex fluid dynamics and input frequency saturation. This study proposes a robust 3-D path following control framework that combines a disturbance observer for perturbation estimation with an adaptive finite-time sliding mode controller for autonomous navigation along the reference trajectories. First, a magnetic helical millirobot's kinematic model based on the 3-D hand position approach is established. Subsequently, a robust smooth differentiator is implemented as an observer to estimate disturbances within a finite time. We then investigate an adaptive finite-time sliding mode controller incorporating an auxiliary system to mitigate the estimated disturbance and achieve precise 3-D path tracking while respecting the input constraints. The adaptive mechanism of this controller ensures fast convergence of the system while alleviating the chattering effects. Finally, we provide a rigorous theoretical analysis of the finite-time stability of the closed-loop system based on the Lyapunov functions. Utilizing a robotically-actuated magnetic manipulation system, experimental results demonstrate the efficacy of the proposed approach in terms of the control accuracy and convergence time.

Remote-actuated magnetic robots, relying solely on the magnetic torque stemming from rotating magnetic fields, hold immense promise in biomedical applications. However, to precisely actuate magnetic robots in large workspaces, the efficient generation of isotropic rotating fields using electromagnetic actuation (EMA) systems presents an enduring challenge. This is because the choice of configuration of the EMA system is a major concern, particularly when considering collision avoidance between coils and the human body while ensuring isotropic actuation. In this study, we presented an analysis of the characteristics of various three-coil configurations by quantitatively evaluating field isotropy. Furthermore, we introduced a performance-guided optimization method to adjust coil configurations by optimizing designed evaluation metrics, aiming to generate rotating fields with isotropic characteristics in a target local region. Finally, we implemented a reconfigurable EMA and conducted extensive experiments to demonstrate the capability of our method and platform. The experimental results showcase the potential of our approach for advanced clinical applications.

Soft magnetic miniature robots (SMMRs) have potential biomedical applications due to their flexible size and mobility to access confined environments. However, navigating the robot to a goal site with precise control performance and high repeatability in unstructured environments, especially in flow rate conditions, still remains a challenge. In this study, drawing inspiration from the control requirements of drug delivery and release to the goal lesion site in the presence of dynamic biofluids, we propose a flow rate rejection control strategy based on a deep reinforcement learning (DRL) framework to actuate an SMMR to achieve goal-reaching and hovering in fluidic tubes. To this end, an SMMR is first fabricated, which can be operated by an external magnetic field to realize its desired functionalities. Subsequently, a simulator is constructed based on neural networks to map the relationship between the applied magnetic field and robot locomotion states. With minimal prior knowledge about the environment and dynamics, a gated recurrent unit (GRU)-based DRL algorithm is formulated by considering the designed history state-action and estimated flow rates. In addition, the randomization technique is applied during training to distill the general control policy for the physical SMMR. The results of numerical simulations and experiments are illustrated to demonstrate the robustness and efficacy of the presented control framework. Finally, in-depth analyses and discussions indicate the potentiality of DRL for soft magnetic robots in biomedical applications.

This article addresses a problem of seabed terrain following control (STFC) for an underwater vehicle-manipulator system (UVMS). The motivation is to perform a visual search of marine products closely to seabed in unknown environment. In terms of this issue, we propose a novel and robust STFC framework for our UVMS to maintain an appropriate height to seabed. A nonlinear model predictive control (NMPC) method is formulated to solve the STFC problem. To relieve online computational burden and system noisy influence, Ohtsuka's continuation/generalized minimal residual (C/GMRES) algorithm incorporated with a tracking differentiator (TD) is investigated. In order to improve the following accuracy, the system state prediction part of the NMPC and a long short-term memory (LSTM) network are elaborated to predict future seabed terrain using a depth gauge and an altimeter, respectively. Finally, the three different physical scenarios for STFC problem are established using ROS to demonstrate the robustness and efficiency of the proposed algorithm.

This article presents a coordinated vehicle-manipulator control method for an underwater biomimetic vehicle-manipulator system (UBVMS) to implement floating autonomous manipulation in practice. An algorithm framework composed of adaptive tracking differentiator (ATD), extended state observer (ESO), improved nonsingular terminal sliding-mode control (I-NTSMC), fuzzy-logic controller (FLC), and estimator of manipulator disturbances, is proposed. The ATD is designed to generate desired motion state and alleviate noise. The ESO is developed to estimate the motion state, systematic uncertainties, and external disturbances. The proposed I-NTSMC method assures the finite-time convergence of the system states and alleviate chattering. The estimation of the manipulator disturbances is incorporated into the control strategy to enhance the station keeping of the vehicle. Finally, underwater autonomous free floating manipulation experiments about opening a door and grasping objects are conducted to validate the theoretical results and confirm the feasibility of the proposed control strategy.

This article presents the comprehensive framework for a hybrid-driven underwater vehicle-manipulator system (HD-UVMS) to grasp marine products on the seabed. The purpose of the proposed hybrid-driven propulsion system is to improve the swimming ability of the HD-UVMS by using thrusters and enhance the stability of its pose adjustment mechanism via two unique long fin propulsors. The control mode for the thrusters and long fin propulsors is based on a fuzzy logic control method. Subsequently, a lightweight manipulator is developed to grasp marine products. The open-closed angle and current controls for the gripper help to avoid damaging marine products. A vision system is installed to enable the HD-UVMS to gradually approach marine products with the aid of monocular vision and grasp them with the aid of binocular vision. A detailed method for monocular passive ranging and stereo matching, in accordance with real-time metrics, is elaborated. Finally, relevant experiments are conducted in an indoor pool and under real sea condition to assess the effectiveness of the proposed framework. Note to Practitioners-The motivation behind this article is the design of an underwater vehicle-manipulator system that can grasp marine products on the real seabed and perform other underwater intervention tasks. Currently, the predominant method of fishing for marine products relies on human divers, which has disadvantages for human divers' health due to the long periods of time spent working underwater. In order to further study the problem, this article develops a hybrid-driven underwater vehicle-manipulator system (HD-UVMS) to work in a real seabed environment. A hybrid-driven motion control framework is presented using the thrusters to achieve effective cruising and searching for marine products and long fin propulsors for the fine pose adjustment required to grasp marine products. The proposed lightweight underwater manipulator can grasp marine products on the seabed with the aid of a vision system. A series of experiments suggests that the HD-UVMS is practical and valid.