Understanding the underlying mechanism of neuromuscular system on motion/force generation is essential for human-machine interfacing. However, simultaneous decoding of wrist angles and grasp forces from neural signals remains an open challenge in the field of neural interfacing. In this study, we proposed a scheme leveraging channel-wise cumulative spike trains (cw-CSTs) of motor units to simultaneously decode wrist angles and grasp forces. Specifically, a spatial spike detection method was utilized to detect cw-CST from surface electromyography, observing as much as possible of motor unit activities. Accordingly, we extracted three neural features to drive the decoders, including a twitch force model-based (cw-MUdrive) and a discharge rate-based (DR-cwCST) neural features derived from cw-CSTs, and DR of motor units (DR-MUST) decomposed by a conventional blind source separation algorithm. Wrist- and hand-specific decoders were built to estimate wrist angles and grasp forces via Gaussian process regression. Experiments were conducted with ten subjects, in which they activated wrist motions and grasp forces concurrently. We evaluated the performance with both accuracy and output stability. Results demonstrated that the cwCST-based neural features outperformed the conventional DR-MUST features with both higher accuracy and stability metrics. Additionally, cw-MUdrive performed better than DR-cwCST in grasp force estimation and comparable to DR-cwCST in wrist angle estimation. The outcome provides an effective solution for simultaneously decoding wrist movements and hand grasp forces, promoting the development of natural control in neural interface.

Manipulating articulated tools, such as tweezers or scissors, has rarely been explored in previous research. Unlike rigid tools, articulated tools change their shape dynamically, creating unique challenges for dexterous robotic hands. In this work, we present a hierarchical, goal-conditioned reinforcement learning (GCRL) framework to improve the manipulation capabilities of anthropomorphic robotic hands using articulated tools. Our framework comprises two policy layers: (1) a low-level policy that enables the dexterous hand to manipulate the tool into various configurations for objects of different sizes, and (2) a high-level policy that defines the tool’s goal state and controls the robotic arm for object-picking tasks. We employ an encoder, trained on synthetic pointclouds, to estimate the tool’s affordance states—specifically, how different tool configurations (e.g., tweezer opening angles) enable grasping of objects of varying sizes—from input point clouds, thereby enabling precise tool manipulation. We also utilize a privilege-informed heuristic policy to generate replay buffer, improving the training efficiency of the high-level policy. We validate our approach through real-world experiments, showing that the robot can effectively manipulate a tweezer-like tool to grasp objects of diverse shapes and sizes with a 70.8% success rate. This study highlights the potential of RL to advance dexterous robotic manipulation of articulated tools.

Multi-thread flexible microelectrodes hold the promise of high-quality and long-term neural signal recording. To implant fragile microelectrodes into brain, a microneedle is usually used as a shuttle to increase stiffness. However, hooking microelectrodes with a microneedle is error-prone and time-consuming, due to the difficulty in accurately obtaining micro-object coordinates through low-quality microscope images. To solve this problem, this paper proposes an intelligent microscope vision system based on few-shot segmentation method. Firstly, a stereo vision system is designed to enable cameras to focus on all microelectrode threads simultaneously. Secondly, a few-shot instance segmentation method is proposed to obtain key-point coordinates for vision guidance, which consists of data augmentation, improved Mask-RCNN and anchor-free clustering loss. The data augmentation method synthesizes low-quality images to strengthen model’s generalization ability. To improve the proposal quality, a residual region proposal module is introduced into Mask-RCNN. By clustering instance features in metric space, the anchor-free clustering loss enhances the model capability of predicting hard instances and avoids the intra-class bias of fixed anchor. Experimental result shows that the proposed method achieves 99.72% and 90% correct rate for microelectrode and microneedle segmentation with 5-shot training. Code is available athttps://github.com/NamingIsEasy/FSS_implantation. Note to Practitioners—Multi-thread flexible microelectrodes are an emerging brain-computer interface platform. Compared with traditional electrodes, they have the advantages of low elastic modulus, micron-level width and material biocompatibility. However, the low elastic modulus also makes it difficult to be inserted into brain. Thus, researchers proposed “sewing machine” paradigm, in which a microneedle is used to hook microelectrodes and drive them to be inserted into brain. The hooking process is threading the microneedle into engaging holes at the end of microelectrodes. However, undesirable conditions in microscope images, such as out-of-focus blur and occlusion, make it difficult to accurately obtain microneedle and microelectrode coordinates. Towards automated hooking operation, this paper proposed an intelligent microscope vision system based on few-shot segmentation. Firstly, a stereo vision system is designed to focus cameras on all microelectrode threads simultaneously. Secondly, a few-shot segmentation method is proposed to reduce time of image acquisition and annotation process. It consists of data augmentation, improved Mask-RCNN and anchor-free clustering loss. The data augmentation method synthesizes undesirable-condition images to reduce the bias of training dataset. The classical region proposal module in Mask-RCNN is replaced with an improved residual version. To make the model focus more on hard instances during training, an anchor-free clustering loss is introduced. The proposed method achieves 99.72% and 90% correct rate for microelectrode and microneedle segmentation in 5-shot experiments. In future, we will explore automated hooking control and subsequent implantation process based on the proposed vision system.

Numerical models of electromyography (EMG) signals have provided a huge contribution to our fundamental understanding of human neurophysiology and remain a central pillar of motor neuroscience and the development of human-machine interfaces. However, while modern biophysical simulations based on finite element methods (FEMs) are highly accurate, they are extremely computationally expensive and thus are generally limited to modeling static systems such as isometrically contracting limbs. As a solution to this problem, we propose to use a conditional generative model to mimic the output of an advanced numerical model. To this end, we present BioMime, a conditional generative neural network trained adversarially to generate motor unit (MU) activation potential waveforms under a wide variety of volume conductor parameters. We demonstrate the ability of such a model to predictively interpolate between a much smaller number of numerical model's outputs with a high accuracy. Consequently, the computational load is dramatically reduced, which allows the rapid simulation of EMG signals during truly dynamic and naturalistic movements.

Neuromechanical studies investigate how the nervous system interacts with the musculoskeletal (MSK) system to generate volitional movements. Such studies have been supported by simulation models that provide insights into variables that cannot be measured experimentally and allow a large number of conditions to be tested before the experimental analysis. However, current simulation models of electromyography (EMG), a core physiological signal in neuromechanical analyses, remain either limited in accuracy and conditions or are computationally heavy to apply. Here, we provide a computational platform to enable future work to overcome these limitations by presenting NeuroMotion, an open-source simulator that can modularly test a variety of approaches to the full-spectrum synthesis of EMG signals during voluntary movements. We demonstrate NeuroMotion using three sample modules. The first module is an upper-limb MSK model with OpenSim API to estimate the muscle fibre lengths and muscle activations during movements. The second module is BioMime, a deep neural network-based EMG generator that receives nonstationary physiological parameter inputs, like the afore-estimated muscle fibre lengths, and efficiently outputs motor unit action potentials (MUAPs). The third module is a motor unit pool model that transforms the muscle activations into discharge timings of motor units. The discharge timings are convolved with the output of BioMime to simulate EMG signals during the movement. We first show how MUAP waveforms change during different levels of physiological parameter variations and different movements. We then show that the synthetic EMG signals during two-degree-of-freedom hand and wrist movements can be used to augment experimental data for regressing joint angles. Ridge regressors trained on the synthetic dataset were directly used to predict joint angles from experimental data. In this way, NeuroMotion was able to generate full-spectrum EMG for the first use-case of human forearm electrophysiology during voluntary hand, wrist, and forearm movements. All intermediate variables are available, which allows the user to study cause-effect relationships in the complex neuromechanical system, fast iterate algorithms before collecting experimental data, and validate algorithms that estimate non-measurable parameters in experiments. We expect this modular platform will enable validation of generative EMG models, complement experimental approaches and empower neuromechanical research.

Perching on the surface of moving objects, like vehicles, could extend the flight time and range of quadrotors. Suction cups are usually adopted for surface attachment due to their durability and large adhesive force. To seal on a surfaces, suction cups must be aligned with the surface and possess proper relative tangential velocity. However, quadrotors’ attitude and relative velocity errors would become significant when the object surface is moving and inclined. To address this problem, we proposed a real-time trajectory planning algorithm. The time-optimal aggressive trajectory is efficiently generated through multimodal search in a dynamic time-domain. The velocity errors relative to the moving surface are alleviated. To further adapt to the residual errors, we design a compliant gripper using self-sealing cups. Multiple cups in different directions are integrated into a wheel-like mechanism to increase the tolerance to attitude errors. The wheel mechanism also eliminates the requirement of matching the attitude and tangential velocity. Extensive tests are conducted to perch on static and moving surfaces at various inclinations. Results demonstrate that our proposed system enables a quadrotor to reliably perch on moving inclined surfaces (up to$1.07m/s$and$90^\circ$) with a success rate of$70\%$or higher. The efficacy of the trajectory planner is also validated. Our gripper has larger adaptability to attitude errors and tangential velocities than conventional suction cup grippers. The success rate increases by 45% in dynamic perches.Note to Practitioners—This paper was motivated by the problem of perching on moving inclined surfaces using quadrotors. It can be used for perching on the various angled surfaces of an automobile to save energy and enlarge flight distance. It can also be exploited in air-ground cooperative tasks. In recent years, various grippers and trajectory planning methods have been devised to enable quadrotors to perch on static inclined surfaces. These strategies can not be used for perching on moving inclined surfaces. The task poses high requirements for the efficiency of trajectory planning and the grippers’ adaptability to pose errors. This paper proposes a real-time planning method to generate trajectories. The trajectories respect kinematic and motor lift constraints. They allow large attitude maneuvering of quadrotors. A multimodal search in a dynamic time-domain is developed to seek the minimum feasible time for the trajectory planner. Considering large pose errors in dynamic perching, a compliant gripper based on multiple independent suction cups is designed. The wheel and multidirectional layout of cups increase the adaptability to attitude and velocity errors. Results suggest that the proposed system is effective and reliable. In practice, our multiple cups would add weight penalty and increase the drag. The suction cups should be placed close to a quadrotor’s central axis to reduce the drag and disturbance in flow. The proposed system relies on an external motion capture system. In future research, we will focus on onboard sensing and control methods to achieve perching on moving inclined surfaces outdoors.

As the need for handling data from various sources becomes crucial for making optimal decisions, managing multi-model data has become a key area of research. Currently, it is challenging to strike a balance between two methods: polyglot persistence and multi-model databases. Moreover, existing studies suggest that current benchmarks are not completely suitable for comparing these two methods, whether in terms of test datasets, workloads, or metrics. To address this issue, the authors introduce MDBench, an end-to-end benchmark tool. Based on the multi-model dataset and proposed workloads, the experiments reveal that ArangoDB is superior at insertion operations of graph data, while the polyglot persistence instance is better at handling the deletion operations of document data. When it comes to multi-thread and associated queries to multiple tables, the polyglot persistence outperforms ArangoDB in both execution time and resource usage. However, ArangoDB has the edge over MongoDB and Neo4j regarding reliability and availability.

Motor unit spike trains (MUSTs) decomposed from surface electromyography (sEMG) have been an emerging solution for neural interfacing, especially for the control of upper limb prosthetics. Accurate and efficient decomposition techniques are essential and desirable. However, most decomposition methods are designed for motor units (MUs) with global maximum of single or large muscle, while in general forearm muscles are usually small and slender with low global energy. Thus, we propose a novel approach using local spatial information towards more accurate and efficient sEMG decomposition of forearm muscles. A fast spatial spike detection method is proposed to replace the time-consuming iteration process of blind source separation (BSS) methods. Here, spatial distribution characteristics of motor unit action potential are leveraged to pre-classify the candidate MUs, and further to create initial MU templates, aiming to avoid repeating convergence to high-energy MUs. The results of both simulated and experimental sEMG signals show that low-energy MUs from small muscles are more easily found compared with conventional BSS algorithm. Specifically, the proposed method can identify more 40% reliable MUs while only 30% consuming time are needed. The outcomes provide a novel solution for more efficient sEMG decomposition, potentially paving the way of MUST-based non-invasive neural interface.

Estimating cumulative spike train (CST) of motor units (MUs) from surface electromyography (sEMG) is essential for the effective control of neural interfaces. However, the limited accuracy of existing estimation methods greatly hinders the further development of neural interface. This paper proposes a simple but effective approach for identifying CST based on spatial spike detection from high-density sEMG. Specifically, we use a spatial sliding window to detect spikes according to the spatial propagation characteristics of the motor unit action potential, focusing on the spikes of activated MUs in a local area rather than those of a specific MU. We validated the effectiveness of our proposed method through an experiment involving wrist flexion/extension and pronation/supination, comparing it with a recognized CST estimation method and an MU decomposition based method. The results demonstrated that the proposed method obtained higher accuracy on multi-DoF wrist torque estimation leveraging the estimated CST compared to the other three methods. On average, the correlation coefficient (R) and the normalized root mean square error (nRMSE) between the estimation results and recorded force were 0.96 ± 0.03 and 10.1% ± 3.7%, respectively. Moreover, there was an extremely high interpretive extent between the CSTs of proposed method and the MU decomposition method. The outcomes reveal the superiority of the proposed method in identifying CSTs and can provide promising driven signals for neural interface.

Surface electromyography (EMG) signals have shown promising applications in human-machine interfacing (HMI) systems such as orthotics, prosthetics, and exoskeletons. Nevertheless, existing myoelectric control methods, generally based on time-domain or frequency-domain features, could not directly interpret neural commands. EMG decomposition techniques have become a prevailing solution to decode the motor neuron discharges from the spinal cord, whereas only single degree-of-freedom (DoF) movements are primarily involved in the current neural-based interfaces, resulting in limited intuitiveness and functionality. Here, we propose a non-invasive framework to analyze motor unit activities and estimate wrist torques during simultaneous contractions of multiple DoFs. Motor unit discharges were decoded from surface EMG signals and pooled into groups during sequential wrist movements. Then three neural features were extracted and linearly projected to the torques of multi-DoF tasks. On average, there were 44 ±13 motor units identified for each motion with a PNR value of 25.8 ±2.9 dB. The neural features outperformed the classic EMG feature on the estimation accuracy with higher correlation coefficients and smoothness. These results demonstrate the feasibility and superiority of the proposed framework in kinetics estimation of simultaneous movements, extending the potential applications of surface EMG decomposition in human-machine interfaces.

Surface electromyography (EMG) signals are inevitably contaminated by various noise components, including powerline interference (PLI), baseline wandering (BW), and white Gaussian noise (WGN). These noises directly degrade the efficiency of EMG processing and affect the accuracy and robustness of further applications. Currently, most of the EMG filters only target one category of noise. Here, we propose a novel filter to remove all three types of noise. The noisy EMG signal is first decomposed into an ensemble of band-limited modes using variational mode decomposition (VMD). Each category of noise is located within specific modes and is separately removed in sub-bands. In particular, WGN is suppressed by soft thresholding with a noise level-dependent threshold. The denoising performance was assessed from simulated and experimental signals using three performance metrics: the root mean square error ([Formula: see text]), the improvement in signal-to-noise ratio ([Formula: see text]), and the percentage reduction in the correlation coefficient ( η). Other methods, including traditional infinite impulse response (IIR) filters, empirical mode decomposition (EMD) method, and ensemble empirical mode decomposition (EEMD) method, were examined for comparison. The proposed method achieved the best performance to remove BW or WGN. It also effectively reduced PLI noise when the signal-to-noise ratio (SNR) was low. The SNR was improved by 18.6, 19.2, and 8.0 dB for EMG signals corrupted with PLI, BW, and WGN at -6 dB SNR, respectively. The experimental results illustrated that noise was completely removed from resting states, and obvious spikes were distinguished from action states. For two of the ten subjects, the improved SNR reached 20 dB. This study explores the special characteristics of VMD and demonstrates the feasibility of using the VMD-based filter to denoise EMG signals. The proposed filter is efficient at removing three categories of noise and can be used for any application that requires EMG signal filtering at the preprocessing stage, such as gesture recognition and EMG decomposition.

Neural interface using decomposed motor units (MUs) from surface electromyography (sEMG) has allowed non-invasive access to the neural control signals, and provided a novel approach for intuitive human-machine interaction. However, most of the existing methods based on decomposed MUs merely adopted the discharge rate (DR) as the feature representations, which may lack local information around the discharge instant and ignore the subtle interactions of different MUs. In this study, we proposed an MU-specific image-based scheme for wrist torque estimation. Specifically, the high-density sEMG signals were decoded into motor unit spike trains (MUSTs), and then MU-specific images were reconstructed with MUSTs and corresponding motor unit action potential (MUAP). A convolutional neural network was used to learn representative features from MU-specific images automatically, and further to estimate wrist torques. The results demonstrated that the proposed method outperformed three conventional and a deep-learning regression approaches using DR features, with the estimation accuracy R2of 0.82 ± 0.09, 0.89 ± 0.06, and nRMSE of 12.6 ± 2.5%, 11.0 ± 3.1% for pronation/supination and flexion/extension, respectively. Further, the analysis of the extracted features from MU-specific images showed a higher correlation than DR for recorded torques, indicating the effectiveness of the proposed method. The outcomes of this study provide a novel and promising perspective for the intuitive control of neural interfacing.

Neural interface using motor units (MUs) decomposed from surface electromyography (sEMG) has provided a novel approach for the intuitive human-robot interaction. However, existing feature extraction methods from decomposed MUs are simplex, ignoring the inherent spatial information and the subtle interactions between different MUs. In this study, we proposed a MU-specific images based scheme for extracting features from decomposed MUs and further estimating wrist torques continuously. Specifically, MU-specific images were reconstructed from decomposed MUs using sEMG and fed into a convolutional neural network for feature extraction and estimating wrist torques. The results demonstrated that the proposed scheme significantly outperformed three conventional regression methods using decomposed spike count features, with R2equal to 0.86 ± 0.05 in pronation/supination and 0.90 ± 0.05 in flexion/extension. This study provides a novel scheme for estimation of continuous movement using decomposed MUs and potentially paves the way of neural interface.

In this article, an artificially weighted spanning tree coverage (AWSTC) algorithm is proposed for the distributed path planning of multiple flying robots. To balance well the efficiency, redundancy, and robustness in the cooperative coverage problem, each robot simultaneously constructs its spanning tree, which grows toward the center of inertia of the uncovered area and keeps away from the trees of its partners. Based on this, each robot covers a concerned area with almost equal trajectory length and computational burden. To guarantee dynamical consistency, a trajectory-smoothing method is developed utilizing Bézier curve transition. As transition in the spanning tree path planning is always conducted around the corner with right angle, geometric and velocity profiles of this kind of transition can be preevaluated as a basic component and then connected to establish more complex real-time trajectories according to the constructed spanning trees. Numerical evaluations and real-time flight experiments are carried out at last. Results demonstrate that the proposed strategy can generate a smooth trajectory for an area coverage problem while ensuring efficiency and robustness. In particular, the efficiency of the proposed algorithm is quite close to the typical centralized spanning tree coverage (STC) algorithm, while ensuring the fulfillment of the coverage task regardless of any breakdown in the individual robot.Note to Practitioners—In applications such as infrastructure inspection and plant protection, the concerned area or terrain is required to be fully covered with the smallest possible time consumption. In view of these real-world requirements, multiple unmanned systems with proper path planning provide a promising solution that can significantly enhance the efficiency as well as the robustness, compared with a single-robot system. Especially, centralized STC algorithms, concerning the computation efficiency and trajectory redundancy of multiple unmanned systems, demonstrate satisfactory effectiveness, and thereby receive a lot of attention. Unfortunately, most of the STC algorithms are proposed in a centralized control framework. Therefore, it is worth to study its decentralized version that could exploit the advantages of the distributed multiple robots. With this consideration, a decentralized AWSTC algorithm is proposed in this article. This spanning tree-based strategy artificially assigns priority weight for each cell, with respect to each individual robot, in the concerned area. With specially designed weight assignment, each robot tends to construct a spanning tree with cells that are uncovered but keep away from the trees of its partners. Based on this, the task burden as well as computational cost of each robot are almost equal. To improve the real-time performance, a Bézier transition trajectory-generation method is also used. With proper parameter selection, robots can generate smooth trajectory with constant velocity in real-time missions. Numerical evaluations and experiments with real-time flight demonstrate the effectiveness of this methodology.

Automatic gesture recognition (AGR) is investigated as an effortless human-machine interaction method, potentially applied in many industrial sectors. When using surface electromyogram (sEMG) for AGR, i.e., myoelectric control, a minimum of four EMG channels are required. However, in practical applications, fewer number of electrodes is always preferred, particularly for mobile and wearable applications. No published research focused on how to improve the performance of a myoelectric system with only two sEMG channels. In this study, we presented a systematic investigation to fill this gap. Specifically, we demonstrated that through spatial filtering and electrode position optimization, the myoelectric control performance was significantly improved (p <; 0.05) and similar to that with four electrodes. Furthermore, we found a significant correlation between offline and online performance metrics in the two-channel system, indicating that offline performance was transferable to online performance, highly relevant for algorithm development for sEMG-based AGR applications.

With the availability of high-density (HD) electrodes technology, the electrodes used in myoelectric control can have much higher density than the current practice. In this study, we investigated the effects of electrode density on pattern recognition (PR) based myoelectric control. Four density levels were analyzed in two directions: parallel and perpendicular to muscle fibers. Their influence on PR-based myoelectric control algorithms was investigated under three conditions between training and testing datasets: no electrode shift, 10-mm shift parallel to muscle fibers and 10-mm shift perpendicular to muscle fibers. The effect of electrode density varied among the different shift conditions: First, when there was no shift, increasing electrode density significantly improved the classification performance; second, when the shift was in the perpendicular direction, increasing electrode density resulted in deterioration in the classification performance; third, when the shift was in the parallel direction, the effect of the electrode density was more complicated-increasing the density in the parallel direction reduced the performance, while increasing density in the perpendicular direction would initially enhance the performance, but then reduce performance. To our best knowledge, this was the first study focusing on the role of electrode density in myoelectric control with the presence of electrode shift. Its outcome would benefit the design of electrode placement for future myoelectric prostheses with HD electrodes.

The lost motor functions of an upper-limb amputee can be restored by means of multi-DOF myoelectric prostheses. However, the somatosensory (tactile and proprioceptive) feedback from a commercial prosthetic hand to the user is still missing, especially the proprioceptive feedback (PF). An object grasping or manipulation actually are organized in phases characterized by muscle synergy and delimited by means of discrete sensory "events". Inspired by the Discrete Event-driven Sensory feedback Control (DESC) policy, we delimited the continuous grasping motion into discrete wrist and finger motions to evaluate human proprioceptive matching ability. In current study, four kinds of typical hand motions (radial flexion, ulnar flexion, wrist flexion and lateral prehension) were passively generated by stimulating respective forearm dominated muscles via non-invasive electrical stimulation (ES) and then actively reappeared with the ipsilateral hands on eight able-bodied subjects. Under two types of matching conditions (PF and PF+ visual feedback (VF)), the human proprioceptive matching ability were evaluated and analyzed. Based on this, a feasible method (interface) used for encoding the grasping movement from fingers of the prosthetic hand to an upper-limb amputee was proposed.

While most wearable gesture recognition approaches focus on the forearm or fingers, the wrist may be a more suitable location for practical use. We present the design and validation of a real-time gesture recognition wristband based on surface electromyography and inertial measurement unit sensing fusion, which can recognize 8 air gestures and 4 surface gestures with 2 distinct force levels. Ten healthy subjects performed an initial gesture recognition experiment, followed by a second experiment 1 h later and a third experiment 1 day later. Classification accuracies for the initial experiment were 92.6% and 88.8% for air and surface gestures, respectively, and there were no changes in accuracy results during testing 1 h. and 1 day later (p > 0.05). These results demonstrate the feasibility of wrist-based gesture recognition paving the way for potential future integration in to a smart watch or other wrist-worn wearable for intuitive human computer interaction.

Advanced myoelectric prosthetic hands are currently limited due to the lack of sufficient signal sources on amputation residual muscles and inadequate real-time control performance. This paper presents a novel human-machine interface for prosthetic manipulation that combines the advantages of surface electromyography (EMG) and near-infrared spectroscopy (NIRS) to overcome the limitations of myoelectric control. Experiments including 13 able-bodied and three amputee subjects were carried out to evaluate both offline classification accuracy (CA) and online performance of the forearm motion recognition system based on three types of sensors (EMG-only, NIRS-only, and hybrid EMG-NIRS). The experimental results showed that both the offline CA and realtime performance for controlling a virtual prosthetic hand were significantly (p <; 0.05) improved by combining EMG and NIRS. These findings suggest that fusion of EMG and NIRS is feasible to improve the control of upper-limb prostheses, without increasing the number of sensor nodes or complexity of signal processing. The outcomes of this study have great potential to promote the development of dexterous prosthetic hands for transradial amputees.

Control scheme design based on surface electromyography (sEMG) pattern recognition has been the focus of much research on a myoelectric prosthesis (MP) technology. Due to inherent nonstationarity in sEMG signals, prosthesis systems may need to be recalibrated day after day in daily use applications; thereby, hindering MP usability. In order to reduce the recalibration time in the subsequent days following the initial training, we propose a domain adaptation (DA) framework, which automatically reuses the models trained in earlier days as input for two baseline classifiers: a polynomial classifier (PC) and a linear discriminant analysis (LDA). Two novel algorithms of DA are introduced, one for PC and the other one for LDA. Five intact-limbed subjects and two transradial-amputee subjects participated in an experiment lasting ten days, to simulate the application of a MP over multiple days. The experiment results of four methods were compared: PC-DA (PC with DA), PC-BL (baseline PC), LDA-DA (LDA with DA), and LDA-BL (baseline LDA). In a new day, the DA methods reuse nine pretrained models, which were calibrated by 40 s training data per class in nine previous days. We show that the proposed DA methods significantly outperform nonadaptive baseline methods. The improvement in classification accuracy ranges from 5.49% to 28.48%, when the recording time per class is 2 s. For example, the average classification rates of PC-BL and PC-DA are 83.70% and 92.99%, respectively, for intact-limbed subjects with a nine-motions classification task. These results indicate that DA has the potential to improve the usability of MPs based on pattern recognition, by reducing the calibration time.

Variations in muscle contraction effort have a substantial impact on performance of pattern recognition based myoelectric control. Though incorporating changes into training phase could decrease the effect, the training time would be increased and the clinical viability would be limited. The modulation of force relies on the coordination of multiple muscles, which provides a possibility to classify motions with different forces without adding extra training samples. This study explores the property of muscle coordination in the frequency domain and found that the orientation of muscle activation pattern vector of the frequency band is similar for the same motion with different force levels. Two novel features based on discrete Fourier transform and muscle coordination were proposed subsequently, and the classification accuracy was increased by around 11% compared to the traditional time domain feature sets when classifying nine classes of motions with three different force levels. Further analysis found that both features decreased the difference among different forces of the same motion ) and maintained the distance among different motions p > 0.1). This study also provided a potential way for simultaneous classification of hand motions and forces without training at all force levels.

It is known that human controls muscles for hand poses in a coordinated manner and the coordination is referred to as a postural synergy. Using postural synergies, dexterous grasping tasks could be accomplished on a prosthetic hand via only a few (usually two) control inputs. Instead of implementing postural synergies digitally, this paper presents the design of a simple continuum mechanism for implementing the postural synergies mechanically. The design, fabrication and assembly of a prosthetic hand are firstly presented, followed by the synthesis of postural synergies from various grasping poses. Referring to the extracted postural synergies, structural parameters of the continuum mechanism are calculated based on a kinematics model. Experimental verifications are also presented to demonstrate the efficacy of the proposed idea.

Surface electromyography (sEMG) is extensively explored in human-computer interface (HCI); complementary to the electrophysiological activity of the muscles, the hemodynamic information that measured from near infrared spectroscopy (NIRS) is less investigated. Properly combining the sEMG and NIRS would provide a novel approach for HCI applications. This paper presents a multi-channel wireless wearable sEMG and NIRS acquisition system aiming for enhanced human-computer interaction, by providing more information about the muscle activity for subject's motor intention decoding. Extensive tests were carried out to evaluate the system performance. It showed that this novel system proved to be able to capture sEMG signals similar to those of the commercialized sEMG acquisition devices, and had a comparable NIRS sensor performance. Furthermore, simultaneously recording of sEMG and NIRS signals, the system had shown the ability to provide more information about the muscle activities for a better HCI performance. The classification accuracy of 13 hand gesture motions was significantly (P<;0.001) improved by using combined sEMG and NIRS features comparing to sEMG or NIRS features individually, suggesting that the proposed sEMG and NIRS system could be potentially available for an enhanced HCI.

One problem in the development of brain-computer interface (BCI) systems is to minimize the amount of subject training on the premise of accurate classification. Hence, the challenge is how to train the BCI system effectively especially in the scenario with small amount of training data. In this paper, we introduce improved semisupervised adaptation based on common spatial pattern (CSP) features. The feature extraction and classification are performed jointly and iteratively. In the iteration step, training data are expanded by part of the testing data with labels which are predicted by a linear discriminant analysis classifier and/or a Bayesian linear discriminant analysis classifier in the previous iteration. Then CSP features are reextracted from the expanded training data, and the classifiers are retrained. Both self-training and cotraining paradigms are proposed for the improved semisupervised adaptation. Throughout the investigation on different number of initial training trials, we find that when a small number of training trials are used, e.g., a training session contains no more than 30 trials, similar classification performance to that of large training data items (40-50 trials) can be achieved. Effectiveness of the algorithms is verified by two competition datasets. Compared with several existing algorithms, the proposed semisupervised algorithms show improvements in classification accuracy for most of the competition datasets especially in the case of small training data.

In real-time network-based systems with long linear paths, the growth rate of time synchronization error is the major barrier to the scalability of systems even if a transparent clock mechanism of IEEE 1588 is used. This paper is devoted to designing a new time synchronization method for such systems. In the proposed algorithm, a proportional-integral (PI) clock servo is used to achieve the frequency compensation. In order to reduce the growth rate of synchronization error due to the quantization error in timestamping, a Kalman filter is designed based on a state-variable model, which is built for the PI controller-tuned slave clock. In addition, the quantization effect is analyzed and the variance of quantization error is quantitatively estimated for each slave node. Experiments are performed to validate its effectiveness and demonstrate that the peak-to-peak jitter is measured to be only 59.37 ns after four hops, and the growth rate of synchronization error can also be significantly reduced by the presented synchronization method. This indicates that the maximum number of networked nodes can be correspondingly increased.

The exhibition of hysteresis effects in smart actuators highly affects the accuracy and stability of the control systems. In this work, a modified generalized PI (MGPI) model is proposed to describe a more general class of hysteresis shapes. Comparing to the previous works, the MGPI model not only enlarges the application of the PI model, but also makes it possible to derive the analytical inverse model. The inverse MGPI model can be used as a compensator to mitigate the hysteresis effect in the control systems. Furthermore, in order to minimize the inverse compensation error due to the modeling inaccuracy and to achieve the closed-loop stability and tracking precision, an adaptive variable structure controller is designed. The simulation results show that the proposed controller consisting of both the inverse compensator and adaptive controller has superior control performance comparing with the adaptive controller itself.

This paper proposes a time-stamped cross-coupled control (TSCCC) algorithm to deal with the asynchronous sampling and network-induced delays in networked computer numerical control (CNC) machines. It uses time-stamps to estimate the network-induced delays from the sampling instants of different axes to the controller node. The network-induced delays are considered for accurately estimating the contour error in real-time. Furthermore, a networked CNC simulation system based on TrueTime toolbox is constructed, on which the proposed TSCCC algorithm is compared with the cross-coupled control (CCC) algorithm. Simulation results on two DC servomotors show that the TSCCC algorithm achieves better contour accuracy than the CCC algorithm.