ABSTRACT Regong Art is one of the world's intangible cultural heritage, and Thangka, as an important form of expression within it, is created in strict adherence to the unique compositional principle of the ‘Three sutras and one commentary’. Current generation methods, when applied to the Thangka floral and leaf dataset, struggle to meet its specific compositional and color restoration requirements. To address these issues, the adversarial ResNet with omni‐dimensional dynamic convolution‐pixel2stylepixel (AROD‐PSP) model is proposed. This model uses hand‐drawn sketches to guide the generation of floral and leaf elements in Thangka, restoring its artistic features. A lightweight improvement to the encoder network is made; omni‐dimensional dynamic convolution (ODConv) is introduced to enhance feature extraction capabilities and increase result diversity; a latent code discriminator is added to ensure that the generated images align more closely with the compositional rules of the dataset; and a colour correction module is employed to adjust the colours, making them more similar to the original images. This approach successfully achieves intelligent design and visual creation tasks for Thangka floral and leaf elements. In comparative experiments, the model achieved second‐best results in quantitative analysis and the best performance in qualitative analysis. The model's generalization ability is demonstrated using two public datasets.

Efficiently coordinating multiple robotic arms is vital for secure and optimal operation in a shared workspace. This requires not only successful task completion but also minimizing collision risks from overlapping movements. Introducing real-time motion modulation adds an extra layer of challenge to this coordination task. In this article, we introduce a novel framework for real-time multiarm coordination, offering two main contributions: First, based on fuzzy model-based movement primitives, we propose a method for real-time trajectory modulation by learning from single demonstrations. This capability allows robots to modulate their motions online to reach arbitrary new desired places smoothly without necessitating extra demonstrations from users. Second, our framework incorporates a real-time multiarm coordination strategy that seamlessly integrates the trajectory modulation method with an extended reactive approach. This strategy empowers multiple robotic arms operating within a shared workspace to dynamically regulate their movements and execute tasks simultaneously in a human-desired manner while reactively avoiding mutual collisions. In the experiments, we utilize a group of robotic arms working in a shared workspace to validate the effectiveness of our framework and to make comparisons with state-of-the-art methods.

Environmental collision is a challenging issue in human–robot collaboration. This article proposes a novel fuzzy cluster-based framework for robots to have reactive responses to various environmental collision scenarios. This framework makes four contributions: First, a fuzzy cluster-based environmental collision detection algorithm is developed to efficiently classify the collision area and noncollision (free) area of the environment. Second, based on the collision detection algorithm, a$p$-norm approximation-based collision avoidance algorithm is proposed to enable robots to avoid environmental collisions with guaranteed stability. Third, by extending the collision avoidance algorithm, an environmental collision adaptation algorithm is proposed to allow robots to adapt to environmental collisions with intelligently regulated contact force. Fourth, a teleoperation controller is designed to strengthen haptic force rendering and enhance the operator's perception of collisions. Going beyond existing methods, the proposed framework allows teleoperated robots to have real-time responses to collisions in quasi-static environments without suffering from local optima, where the environments can be unstructured, nonconvex, and detected with noisy outliers. In addition, this framework is simple in implementation because the proposed collision avoidance and collision adaptation algorithms work as several linear quadratic programming constraints that can be flexibly used by inverse kinematics solvers. Several experiments using 7-degree-of-freedom robots are conducted to test and compare the proposed framework with existing methods, demonstrating the effectiveness of our work.

Manipulability ellipsoid on the Riemannian manifold serves as an effective criterion to analyze, measure, and control the dexterous performance of robots. For asymmetric bilateral telerobotics, due to the different structures of leader and follower robots, it is difficult or even impossible for the operator to manually regulate the manipulability of the remote follower robot. Thus, it is desired that the follower robot can automatically regulate its manipulability to assist the operator in remote different task executions, like humans regulating their own postures to enhance manipulability and adapt to different task scenarios. This article proposes a novel framework for manipulability transfer from human to robot. In this framework, we develop a Type-2 fuzzy model-based imitation learning method to encode and reproduce manipulability ellipsoids from demonstrations. This method can achieve high performance in accuracy and computational efficiency. In addition, it supports learning from a single demonstration. Then, we combine this method with a Riemannian manifold-based quadratic programming control algorithm such that the robot manipulability can fast track the desired manipulability profile. This framework is applied to telerobotics, in which a bilateral teleoperation controller is designed that enables the robot to follow the operator's command and simultaneously self-regulate its manipulability to perform the task adaptively. Meanwhile, the operator can receive force feedback relating to the manipulability regulation. Evaluations using comparative studies and practical experiments with a 3-degrees of freedom (DoF) haptic device and 7-DoF robots are presented to show the effectiveness of the proposed framework.

This article studies group-wise point set registration and makes the following contributions: "FuzzyGReg", which is a new fuzzy cluster-based method to register multiple point sets jointly, and "FuzzyQA", which is the associated quality assessment to check registration accuracy automatically. Given a group of point sets, FuzzyGReg creates a model of fuzzy clusters and equally treats all the point sets as the elements of the fuzzy clusters. Then, the group-wise registration is turned into a fuzzy clustering problem. To resolve this problem, FuzzyGReg applies a fuzzy clustering algorithm to identify the parameters of the fuzzy clusters while jointly transforming all the point sets to achieve an alignment. Next, based on the identified fuzzy clusters, FuzzyQA calculates the spatial properties of the transformed point sets and then checks the alignment accuracy by comparing the similarity degrees of the spatial properties of the point sets. When a local misalignment is detected, a local re-alignment is performed to improve accuracy. The proposed method is cost-efficient and convenient to be implemented. In addition, it provides reliable quality assessments in the absence of ground truth and user intervention. In the experiments, different point sets are used to test the proposed method and make comparisons with state-of-the-art registration techniques. The experimental results demonstrate the effectiveness of our method. The code is available at https://gitsvn-nt.oru.se/qianfang.liao/FuzzyGRegWithQA.

This article studies the fuzzy cluster-based point set registration (FuzzyPSReg). First, we propose a new metric based on Gustafson–Kessel (GK) fuzzy clustering to measure the alignment of two point clouds. Unlike the metric based on fuzzy c-means (FCM) clustering in our previous work, the GK-based metric includes orientation properties of the point clouds, thereby providing more information for registration. We then develop the registration quality assessment of the GK-based metric, which is more sensitive to small misalignments than that of the FCM-based metric. Next, by effectively combining the two metrics, we design two FuzzyPSReg strategies with global optimization. 1)FuzzyPSReg-SS, which extends our previous work and aligns two similar-sized point clouds with greatly improved efficiency. 2)FuzzyPSReg-O2S, which aligns two point clouds with a relatively large difference in size and can be used to estimate the pose of an object in a scene. In the experiment, we use different point clouds to test and compare the proposed method with state-of-the-art registration approaches. The results demonstrate the advantages and effectiveness of our method.

Imitation learning is an important direction in the area of robot skill learning. It provides a user-friendly and straightforward solution to transfer human demonstrations to robots. In this article, we integrate fuzzy theory into imitation learning to develop a novel method called type-2 fuzzy model-based movement primitives (T2FMP). In this method, a group of data-driven type-2 fuzzy models are used to describe the input–output relationships of demonstrations. Based on the fuzzy models, T2FMP can efficiently reproduce the trajectory without high computational costs or cumbersome parameter settings. Besides, it can well handle the variation of the demonstrations and is robust to noise. In addition, we develop extensions that endow T2FMP with trajectory modulation and superposition to achieve real-time trajectory adaptation to various scenarios. Going beyond existing imitation learning methods, we further extend T2FMP to regulate the trajectory to avoid collisions in the environment that is unstructured, nonconvex, and detected with noisy outliers. Several experiments are performed to validate the effectiveness of our method.

Bluetooth Low Energy (BLE) mesh which is the latest and the most innovative network technology has deeply changed the connection mode among massive BLE devices in Internet of Things (IoT). The study on the architecture and networking is quite necessary for the development of BLE Mesh. In IoT, the BLE devices are often used for voice, audio and data services. To satisfy the demands of diverse services and the mobility of the nodes, a hierarchical BLE mesh network (HBMN) architecture is proposed consisting of Hub Layer, Mesh Layer and User Layer. The HBMN architecture combines the star-network and mesh topology. Besides, the networking process of HBMN from the unprovisioned devices is also investigated in this paper. Moreover, two important performance measures have been analyzed and derived including networking time and single-hop delay. Finally, the access delay of one node is measured on the nRF52832 hardware platform. In addition, the networking time and single-hop delay of HBMN are evaluated and compared with the traditional BLE scatternet. The results show that the average single-hop delay of the BLE scatternet is 1.74 times as long as HBMN averagely and HBMN has a superior performance on the networking time when the network has a large number of devices.

This study presents a new point set registration method to align 3D range scans. In our method, fuzzy clusters are utilized to represent a scan, and the registration of two given scans is realized by minimizing a fuzzy weighted sum of the distances between their fuzzy cluster centers. This fuzzy cluster-based metric has a broad basin of convergence and is robust to noise. Moreover, this metric provides analytic gradients, allowing standard gradient-based algorithms to be applied for optimization. Based on this metric, the outlier issues are addressed. In addition, for the first time in rigid point set registration, a registration quality assessment in the absence of ground truth is provided. Furthermore, given specified rotation and translation spaces, we derive the upper and lower bounds of the fuzzy cluster-based metric and develop a branch-and-bound (BnB)-based optimization scheme, which can globally minimize the metric regardless of the initialization. This optimization scheme is performed in an efficient coarse-to-fine fashion: First, fuzzy clustering is applied to describe each of the two given scans by a small number of fuzzy clusters. Then, a global search, which integrates BnB and gradient-based algorithms, is implemented to achieve a coarse alignment for the two scans. During the global search, the registration quality assessment offers a beneficial stop criterion to detect whether a good result is obtained. Afterwards, a relatively large number of points of the two scans are directly taken as the fuzzy cluster centers, and then, the coarse solution is refined to be an exact alignment using the gradient-based local convergence. Compared to existing counterparts, this optimization scheme makes a large improvement in terms of robustness and efficiency by virtue of the fuzzy cluster-based metric and the registration quality assessment. In the experiments, the registration results of several 3D range scan pairs demonstrate the accuracy and effectiveness of the proposed method, as well as its superiority to state-of-the-art registration approaches.

In order to better handle the coupling effects when controlling multiple-input multiple-output (MIMO) systems, taking the decentralized control structure as the basis, this paper proposes a sparse control strategy and a decoupling control strategy. Type-1 and type-2 Takagi-Sugeno (T-S) fuzzy models are used to describe the MIMO system, and the relative normalized gain array-based criterion is employed to measure the coupling effects. The main contributions include: 1) compared to the previous studies, a manner with less computational cost to build fuzzy models for the MIMO systems is provided, and a more accurate method to construct the so-called effective T-S fuzzy model (ETSM) to express the coupling effects is developed; 2) for the sparse control strategy, four indexes are defined in order to extend a decentralized control structure to a sparse one. Afterward, an ETSM-based method is presented that a sparse control system can be realized by designing multiple independent single-input single-output (SISO) control loops; and 3) for the decoupling control strategy, a novel and simple ETSM-based decoupling compensator is developed that can effectively compensate for both steady and dynamic coupling effects. As a result, the MIMO controller design can be transformed to multiple noninteracting SISO controller designs. Both of the sparse and decoupling strategies allow to use linear SISO control algorithms to regulate a closely coupled nonlinear MIMO system without knowing its exact mathematical functions. Two examples are used to show the effectiveness of the proposed strategies.

In this paper, we propose a blind direct current bias (DCB) based timing synchronization and a blind null subcarrier (NS) based timing synchronization methods for direct current biased optical-orthogonal frequency division multiplexing (DCO-OFDM) visible light communications (VLC) systems. This is the first work to investigate blind timing synchronization for DCO-OFDM VLC systems, achieving high bandwidth efficiency, unlike the previous works which require a number of pilots. The two blind approaches are robust against the limited bandwidth of light emitting diode (LED), as the timing synchronization is conducted in frequency domain to mitigate the effect of inter-symbol-interference (ISI) caused by LED limited bandwidth, rather than being performed in time domain as the previous works that are vulnerable to the ISI. The DC bias is utilized by the proposed DCB based approach to perform blind timing synchronization, and the null subcarrier is used by the proposed NS based approach. Simulation results show that the proposed blind DCB and NS timing synchronization approaches significantly outperform the state-of-the-art methods in terms of the probability of false detection and bit error rate (BER), and yield BER performance close to ideal case with perfect synchronization, zero forcing (ZF) equalization and perfect channel state information (CSI).

At this stage, with the rapid development of society, FM TV and radio have become an indispensable information transmission medium. The transmitting antenna is the main technical system for FM broadcasting and TV stations transmitting and receiving signals. At present, FM dipole antennas are mostly used in television, broadcasting and other media. This paper introduces two types of FM dipole antennas commonly used in television and broadcast transmission systems: single dipole and double dipole. The performance of antenna bandwidth, gain, and standing wave ratio are described in detail. FM dual dipole antennas are used for array simulation.

We study the adjacent channel interference (ACI) between 5G base stations and the C-band satellite receiver. Since the experimental frequency band of the 5G network is adjacent to the downlink frequency of the C-band satellite, interference signals may enter the low noise block (LNB) in the receiver through receiving antennas, causing barrage jamming. A compact fourth-order cavity filter based on the generalized Chebyshev function is presented in this paper. By adding an electrical coupling probe between two cavities, up to four transmission zeros can be achieved in the stopband at the same time to greatly improve the selectivity performance of the filter.

Virtual reality (VR) is regarded as a useful tool for teleoperation systems and provides operators with immersive visual feedback on the robot and the environment. However, without any haptic feedback or physical constructions, VR-based teleoperation systems normally suffer from poor maneuverability, and operational faults may be caused in some fine movements. In this article, we employ mixed reality (MR), which combines real and virtual worlds, to develop a novel teleoperation system. A new system design and control algorithms are proposed. For the system design, an MR interface is developed based on a virtual environment augmented with real-time data from the task space with the goal of enhancing the operator's visual perception. To allow the operator to be freely decoupled from the control loop and offload the operator's burden, a new interaction proxy is proposed to control the robot. For the control algorithms, two control modes are introduced to improve the long-distance movements and fine movements of the MR-based teleoperation system. In addition, a set of fuzzy-logic-based methods are proposed to regulate the orientation, position, velocity, and force of the robot to enhance the system's maneuverability and address potential operational faults. A barrier Lyapunov function and a backstepping method are leveraged to design the control laws and simultaneously guarantee the system's stability under state constraints. Experiments conducted using a six-degree-of-freedom robotic arm prove the feasibility of the system.

This article proposes a new single master bimanual teleoperation system with an efficient position, orientation, and force regulation strategy. Unlike many existing studies that solely support motion synchronization, the first contribution of the proposed work is to propose a solution for orientation regulation when several slave robots have differing motions. In other words, we propose a solution for self-regulated orientation for dual-arm robots. A second contribution in the article allows the master with fewer degrees of freedom (DoF) to control the slaves (with higher DoF), while the orientation of the slaves is self-regulated. The system further offers a novel force regulation that enables the slave robots to have a smooth and balanced robot-environment interaction with proper force directions. Finally, the proposed approach provides adequate force feedback about the environment to the operator and assists the operator in identifying different motion situations of the slaves. Our approach demonstrates that the forces from the slaves will not interrupt the operator's perception of the environment. To validate the proposed system, experiments are conducted using a platform consisting of two 7-DoF slave robots and one 3-DoF master haptic device. The experiments demonstrated good results in terms of position, orientation, and force regulation.

Nature language inference (NLI) task is a predictive task of determining the inference relationship of a pair of natural language sentences. With the increasing popularity of NLI, many state-of-the-art predictive models have been proposed with impressive performances. However, several works have noticed the statistical irregularities in the collected NLI data set that may result in an over-estimated performance of these models and proposed remedies. In this paper, we further investigate the statistical irregularities, what we refer as confounding factors, of the NLI data sets. With the belief that some NLI labels should preserve under swapping operations, we propose a simple yet effective way (swapping the two text fragments) of evaluating the NLI predictive models that naturally mitigate the observed problems. Further, we continue to train the predictive models with our swapping manner and propose to use the deviation of the model’s evaluation performances under different percentages of training text fragments to be swapped to describe the robustness of a predictive model. Our evaluation metrics leads to some interesting understandings of recent published NLI methods. Finally, we also apply the swapping operation on NLI models to see the effectiveness of this straightforward method in mitigating the confounding factor problems in training generic sentence embeddings for other NLP transfer tasks.

This paper develops an innovative multilateral teleoperation system with two haptic devices on the master side and a newly designed reconfigurable multi-fingered robot on the slave side. A novel nonsingular fast terminal sliding-mode algorithm, together with varying dominance factors for cooperation, is proposed to offer this system's fast position and force tracking, as well as an integrated perception for the operator on the reconfigurable slave robot (manipulator). The Type-2 fuzzy model is used to describe the overall system dynamics, and accordingly a new fuzzy-model-based state observer is proposed to compensate for system uncertainties. A sliding-mode adaptive controller is designed to deal with the varying zero drift of the force sensors and force observers. The stability of the closed-loop system under time-varying delays is proved using Lyapunov-Krasovskii functions. Finally, experiments to grasp different objects are performed to verify the effectiveness of this multilateral teleoperation system.

This article presents an approach for assisted teleoperation of a robot arm, formulated within a real-time stack-of-tasks (SoT)whole-body motion control framework. The approach leverages the hierarchical nature of the SoT framework to integrate operator commands with assistive tasks, such as joint limit and obstacle avoidance or automatic gripper alignment. Thereby some aspects of the teleoperation problem are delegated to the controller and carried out autonomously. The key contributions of this work are two-fold: the first is a method for unobtrusive integration of autonomy in a telemanip-ulation system; and the second is a user study evaluation of the proposed system in the context of teleoperated pick-and-place tasks. The proposed approach of assistive control was found to result in higher grasp success rates and shorter trajectories than achieved through manual control, without incurring additional cognitive load to the operator.

Interaction measure determines decentralized and sparse control configurations for a multivariable process control. This paper investigates interval type-2 Takagi-Sugeno fuzzy (IT2TSF) model based interaction measures using two different criteria, one is controllability and observability gramians, the other is relative normalized gain array (RNGA). The main contributions are: first, a data-driven IT2TSF modeling method is introduced; second, explicit formulas to execute the two measures based on IT2TSF models are given; third, two interaction indexes are defined from RNGA to select sparse control configuration; fourth, the calculations to derive sensitivities of the two measures with respect to parametric variations in the IT2TSF models are developed; and fifth, the discussion to compare the two measures is presented. Three multivariable processes are used as examples to show that the results calculated from IT2TSF models are more accurate than that from their type-1 counterparts, and compared to gramian-based measure, RNGA selects more reasonable control configurations and is more robust to the parametric uncertainties.

In this paper, a novel neural network (NN)-based four-channel wave-based time domain passivity approach (TDPA) is proposed for a teleoperation system with time-varying delays. The designed wave-based TDPA aims to robustly guarantee the channels passivity and provide higher transparency than the previous power-based TDPA. The applied NN is used to estimate and eliminate the system's dynamic uncertainties. The system stability with linearity assumption on human and environment has been analyzed using Lyapunov method. The proposed algorithm is validated through experimental work based on a 3-DOF bilateral teleoperation platform in the presence of different time delays.

This paper presents a computer vision system for tracking high-speed non-rigid skaters over a large playing area in short track speeding skating competitions. The outputs of the tracking system are spatio-temporal trajectories of the players which can be further processed and analyzed by sport experts. Given very fast and non-smooth camera motions to capture highly complex and dynamic scenes of skating, tracking amorphous skaters should be a challenging task. We propose a new method of (1) automatically computing the transformation matrices to map each frame of the imagery to the globally consistent model of the rink and (2) incorporating the hierarchical model based on the contextual knowledge and multiple cues into the unscented Kalman filter to improve the tracking performance when occlusion occurs. Experimental results show that the proposed algorithm is very efficient and effective on video recorded live by the authors in the World Short Track Speed Skating Championships.