Open-vocabulary mobile manipulation (OVMM) that involves the handling of novel and unseen objects across different workspaces remains a significant challenge for real-world robotic applications. In this paper, we propose a novel Language-conditioned Open-Vocabulary Mobile Manipulation framework, named LOVMM, incorporating the large language model (LLM) and vision-language model (VLM) to tackle various mobile manipulation tasks in household environments. Our approach is capable of solving various OVMM tasks with free-form natural language instructions (e.g. "toss the food boxes on the office room desk to the trash bin in the corner", and "pack the bottles from the bed to the box in the guestroom"). Extensive experiments simulated in complex household environments show strong zero-shot generalization and multi-task learning abilities of LOVMM. Moreover, our approach can also generalize to multiple tabletop manipulation tasks and achieve better success rates compared to other state-of-the-art methods.

Dynamics-based control offers a promising approach to exploring the motion potential of soft robots. However, inherently infinite degrees of freedom of these systems pose significant challenges for dynamics modeling, closely followed by the pressing robustness concerns arising from finite-dimensional approximations. This paper addresses these issues by proposing a physics-informed dynamics learning neural network and an adaptive fractional-order control for continuum soft robots. Specifically, a deep Lagrangian neural network is first developed with an embedded self-attention mechanism to enhance learning efficiency, accuracy, and data sensitivity. Subsequently, an adaptive fractional-order sliding mode controller is designed, leveraging the inherent historical memory properties of fractional calculus. This controller not only ensures robust shape control but also improves response speed and tracking accuracy. To further handle model discrepancies in the learned dynamics and external disturbances, a nonlinear disturbance observer is introduced to effectively estimate and compensate for lumped uncertainties, thereby ensuring reliable performance. Theoretical analysis confirms the closed-loop stability, while both simulation and experiment results validate the high dynamics fitting accuracy of the proposed network, as well as the robust and precise tracking capability of the fractional-order controller. Note to Practitioners—Soft robots offer great potential in unstructured or constrained environments owing to their compliance and adaptability. However, their high degrees of freedom and nonlinear behaviors make analytical modeling and robust control particularly challenging. Meanwhile, traditional closed-box learning methods often suffer from limited physical interpretability, reliability and extrapolability. This work presents a physics-informed dynamics learning framework combined with a fractional-order controller for soft robots. The dynamics learning network embeds physical priors to enhance model interpretability and extrapolability, while a self-attention mechanism improves data efficiency and modeling accuracy. Additionally, a disturbance observer is designed to estimate and compensate for model discrepancies and external disturbances, thereby contributing to the system’s robustness. Incorporating the observer’s outputs, the adaptive fractional-order controller further enhances closed-loop behavior by leveraging the memory properties of fractional calculus.

This paper is focused on the event-based secure control issue for cyber-physical systems (CPSs) under aperiodic denial-of-service (DoS) attacks. Malicious DoS attacks disrupt the communication between the controller and the actuator. The finite attack resources of malicious attackers are taken into consideration, and the DoS attacks are characterized using an aperiodic model. In contrast to prior results, the present study tackles the issue of secure controller design by considering the attributes of the DoS attack, instead of employing a switched system approach to address the aforementioned concerns. More specifically, under aperiodic DoS attacks, sufficient criteria are established to guarantee that the closed-loop CPSs can achieve bounded stability. Then, within a time-varying attack period, the relationship between the attack active interval and the attack silent interval is derived. Without satisfying the derived conditions, the system’s stability will deteriorate. Moreover, an event-based secure control scheme under aperiodic DoS attacks is designed. To verify the efficacy of the derived theory, a wheeled mobile robot system under aperiodic DoS attacks is illustrated. Note to Practitioners—CPSs have been widely utilized in various domains, such as aerospace and intelligent transportation. However, the openness of networks provides attackers with numerous opportunities for malicious assaults, consequently leading to a degradation in system performance. Consequently, researching the security issues of CPSs under malicious attacks is of utmost urgency. This paper focuses on the issue of event-triggered secure control for CPSs in the presence of energy-constrained aperiodic DoS attacks. The event-triggered communication mechanism is introduced to reduce the computational burden. The criteria for ensuring the bounded stability of CPSs under aperiodic DoS attacks are proposed. The relationship between the attack active interval and the attack silent interval is derived, which is incorporated into the proposed criteria. A wheeled mobile robot system is given to validate the effectiveness of the proposed method. In the future, an active defense control method will be proposed to counter malicious attacks.

Many approaches have been influential in the robotics field because of deep learning (DL). As space robots need more reliability and stability, model-free algorithms with deep learning have particular advantages over the traditional methods in space environment. In this paper, we present an original robot current/torque prediction based on robot dynamic system with deep learning. Also, we add sliding mode-based fixed-time controller to improve the control performance. It has analysed manipulator current information through robot dynamic property’s matrix nature from fewer samples. This method has significant benefits in terms of robot current/torque identification and tracking. It also performs well in robustness and learning rates. This generic method has developed to solve a variety of problems using deep learning and data filtering with manipulator dynamics process, which includes deep learning with fractional order differential operators, robot dynamics and Kalman smoothing. We verified our algorithm into a real two-joint space robot on air-floating platform in zero gravity environment. The final results show it can learn to predict current/torque based on robot dynamics and complete the finitetime convergence. This paper made several key contributions to the fields of current/torque identification and prediction with manipulator dynamics and deep learning in space robot models. It performs very well in robot current/torque tracking and predicting new situations.

Regular expression matching plays an important role in network security. Regular expression matching is achieved by NFA and DFA. DFA is suitable for high-speed IDS due to its efficiency. However, the combined compilation of multiple rules containing “.*” may blow up in state and storage space. In this paper, we give an explanation to this problem from the prospective of information theory, and propose a multidimensional mathematical model focusing on the most serious state explosion. We divide redundant states into zero-dimensional ones and one-dimensional ones. The former are compressed by dimension, and the later are dynamically built. Theory proof illustrates that the space complexity of the model reaches the theoretical lower bound. Then we propose the multi-dimensional finite automata (MFA) based on the model. Experimental results show that, MFA reduces greatly the construction time, memory and matching time, compared with several typical state-of-the-arts DFA improved algorithms.