EDBT 2026 Demo / reviewers in the wild / expert
Rui Huang 0008
dblp:56/2875-8
· DBLP profile ↗
36ranked-venue papers
8as first author
24since 2021 · last 2026
0000-0001-7231-5042ORCID · conflict
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 24 · 6 first-author · 17 since 2021Systems, architecture and hardware · 15 · 5 first-author · 8 since 2021Applied, interdisciplinary, general and emerging computing · 10 · 1 first-author · 6 since 2021Computer networks · 1 · 1 since 2021Databases, data management, data science and information retrieval · 1 · 1 first-authorGraphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Adaptive Optimal Tracking Control of Uncertain Robotic Systems With Global Predefined-Time Stability: A Unified Observer-Identifier-Learning FrameworkabstractThis paper proposes a unified observer–identifier–learning framework (OILF) for predefined-time optimal tracking control with prescribed performance for robotic systems subject to unmeasurable states and uncertain dynamics. Most existing optimal control approaches rely on full-state information or accurate dynamic models, which are often unavailable in practice. To overcome this issue, a predefined-time dynamic regression extension and mixing (PTDREM) method is proposed to realize the co-design of state observer and parameter identifier, enabling synchronous predefined-time estimation of unknown states and dynamic parameters. Subsequently, to achieve optimal tracking control for robotic systems, a prescribed-performance-based critic–actor (PPCA) structure is developed via reinforcement learning (RL), in which all hierarchical tracking errors are driven into prescribed neighborhoods of the origin within a predefined time. In contrast to most existing works that solely ensure uniform ultimate boundedness (UUB) of the closed-loop system, the proposed scheme enables the upper bounds of the convergence time of the state observer, system identifier, and optimal controller to be preset through independent parameter design, thereby establishing global predefined-time stability (G-PTS) for the overall closed-loop system. Numerical simulations on a two-degree-of-freedom (DOF) robotic manipulator verify the effectiveness of the proposed OILF. Lin Hao, Rui Luo 0003, Zhinan Peng, Linpu He, Zhipeng Du, Rui Huang 0008, Hong Cheng 0002, Bijoy K. Ghosh |
IEEE Internet Things J. | 7 |
| 2026 | Spatiotemporal Dynamics Modeling of Brain Activity for Human-Robot Cognitive Interaction: A Distributed-Lumped Parameter System FrameworkabstractThis article investigates the system modeling problem for the dynamical process of human brain activity in human-robot cognitive interaction (HRCI). An important novelty of the proposed approaches is to build a computational model of a human-distributed robot-lumped parameter system (HDRLPS) that describes the inherent dynamical principle of human brain activity (with spatiotemporal-varying characteristic) undergoing the interaction between the intrinsic cognitive dynamics and extrinsic robot stimuli. A deterministic learning (DL)-based spatiotemporal dynamics identification scheme is proposed to accurately identify the spatiotemporal dynamics of HDRLS and obtain the associated knowledge as a constant radial basis functional neural network (RBF NN) model. A spatiotemporal dynamics estimator is designed with this model, which can accurately evaluate and monitor the dynamical process of human brain activity in real-time HRCI by the generated dynamics-synchronized state. The effectiveness and practicability of the approaches in the dynamics identification and evaluation for the human brain activity in HRCI are validated by the thorough analysis, including the mathematical proof, the simulation study, and the brain-computer interface (BCI) experiment using publicly available datasets. Our method is compared with state-of-the-art (SOTA) methods, such as LGGNet, EEGNet, Tsception, EEG-Deformer, EEG-Transformer, and EEGViT. The results show that our method can outperform these methods with better recognition accuracy and macro- $F1$ scores. The source code can be found at: https://github.com/alonexing/source_code/tree/master. Jingting Zhang, Lianchi Zhang, Fengjun Mu, Zonghai Huang, Chaobin Zou, Rui Huang 0008, Cong Wang 0007, Hong Cheng 0002 |
IEEE Trans. Neural Networks Learn. Syst. | 6 |
| 2025 | Plug-and-Play Multi-Domain Fusion Adaptation for Cross-Subject EEG-Based Motor Imagery ClassificationabstractMotor imagery (MI) classification in rehabilitation brain-computer interfaces (RBCIs) faces significant challenges due to the variability of electroencephalography (EEG) signals across subjects. Existing methods typically require extensive EEG data collection from each new subject, which is time-consuming and results in poor user experience. To address this issue, this paper decompose MI-EEG into subject-specific private components and shared components common across all subjects, and propose a plug-and-play domain fusion adaptive method (PPMDFA) to handle variability between subjects. In the training phase, PPMDFA introduces a Multi-Domain Fusion Graph Convolutional Network (MDFGCN) module to extract shared and private features from the MI processes of source domain subjects. In the calibration phase, the method constructs private classifiers for the target new subject using the extracted shared features combined with a small amount of labeled data. During testing, PPMDFA leverages the similarity of private components to utilize knowledge from source subjects, thereby enhancing classification accuracy for target subjects' MI. We validated the proposed method on the PhysioNet and LLMBCImotion datasets. Experimental results show that PPMDFA achieves state-of-the-art classification accuracy on both datasets, with rapid adaptation to new subjects using only 20% of the data, reaching accuracies of 73.33% and 61.62%, demonstrating strong generalization ability and robustness. Rui Huang 0008, Jianzhi Lyu, Yang Zhao 0024, Guangkui Song, Hong Cheng 0002, Jianwei Zhang 0001 |
ICRA | 2 |
| 2025 | KneeMamba: A Multi-level Feature Extraction Model for Knee MRI Assisted Diagnosis with MambaabstractMagnetic resonance imaging (MRI) is highly important for diagnosing knee injuries because of its ability to provide detailed images. However, the key problem in intelligent MRI diagnosis is how to identify and extract the most relevant features from a large amount of data. In this paper, we present a single training stage method. This method can extract features from images, sequences, and anatomical planes at different levels simultaneously. First, we propose a nested Mamba module. This module allows parallel extraction of image-level and sequence-level features from the same anatomical plane in MRI. Second, an anatomical-level Mamba module is designed. It integrates features extracted from different anatomical planes. Finally, self-distillation is applied to improve the model’s feature extraction efficiency. Experimental results show that our proposed model outperforms sub-optimal models by 3.7% in accuracy and 2.4% in F1-score. Moreover, compared with the multi-stage model, the single-stage multi-class classification model greatly improves classification efficiency. In conclusion, the model developed in this paper can effectively and accurately conduct intelligent knee MRI diagnosis. Zonghai Huang, Jiatong Si, Jingting Zhang, Fengjun Mu, Rui Huang 0008, Hong Cheng 0002 |
IJCNN | 5 |
| 2025 | Adaptive Coordinated Motion Planning for lower limb exoskeleton robots with a robotic walker
Chaobin Zou, Rui Huang 0008, Jingting Zhang, Zhinan Peng, Hong Cheng 0002 |
Eng. Appl. Artif. Intell. | 3 |
| 2025 | Multi-Level Skeleton Self-Supervised Learning: Enhancing 3D action representation learning with Large Multimodal Models
Yang Chen 0039, Ling Wang 0013, Rui Huang 0008, Hong Cheng 0002 |
Knowl. Based Syst. | 5 |
| 2025 | Memory-Guided Transformer with group attention for knee MRI diagnosis
Rui Huang 0008, Zonghai Huang, Hantang Zhou, Qiang Zhai, Fengjun Mu, Huayi Zhan, Hong Cheng 0002 |
Pattern Recognit. | 1 |
| 2025 | EEG-Based Motor Imagery Classification With Tuned Heuristic Fusion Graph Convolutional Network for Rehabilitation TrainingabstractMotor imagery-based brain–computer interfaces (MI-BCIs) hold significant promise for rehabilitation training in individuals with neurological impairments such as stroke and spinal cord injury (SCI). Achieving precise and robust lower limb movement prediction for each patient is crucial. However, the variability in MI response frequencies and brain activation patterns among subjects presents a great challenge to the generalizability of MI-BCIs. This paper proposes a Tuned Heuristic Fusion Graph Convolutional Network (THFGCN) for limb movement prediction in rehabilitation scenarios. THFGCN innovatively designs a learnable EEG frequency band tuned module and a heuristic space topology module. These two modules allow for the intricate extraction of both frequency and spatial topological features, utilizing graph adjacency matrices that encapsulate channel correlations and spatial relationships, hence fostering individualized analysis and enhanced generalizability across subjects. Furthermore, a spatio-temporal convolution module paired with a feature map attention mechanism is proposed to extract the critical spatio-temporal features of electroencephalogram (EEG) data. Validation experiments on the PhysioNet and LLM-BCImotion datasets against six mainstream methods demonstrate that THFGCN outperforms state-of-theart methods, achieving 88.41% and 82.82% accuracy in the within-subject case, and 65.93% and 60.56% accuracy in the cross-subject case, respectively. Detailed frequency band weight and T-distributed Stochastic Neighbor Embedding visualization validate the effectiveness of proposed modules. Furthermore, feature interpretability analysis proves the extracted features’ profound MI task relevance, underlining THFGCN’s exceptional interpretability. Rui Huang 0008, Jianzhi Lyu, Fengjun Mu, Zhinan Peng, Chaobin Zou, Hong Cheng 0002, Jianwei Zhang 0001, Bijoy K. Ghosh |
IEEE Trans Autom. Sci. Eng. | 2 |
| 2025 | Optimization-Based Adaptive Assistance for Lower Limb Exoskeleton Robots With a Robotic Walker via Spatially Quantized GaitabstractGait training with human-like gait patterns can be provided by lower limb exoskeletons (LLEs) for patients with gait impairments. For patients with little effort to keep balance, using a mobile robotic walker to assist gait training with LLEs is an effective way. Since gait patterns are varying with walking speeds, it is a critical issue to coordinated control the robotic walker and the exoskeleton to obtain a natural and human-like walking posture. In this paper, a novel adaptive assistance approach named SQG-OPT is proposed to tackle the problem, which comprises of two parts: the Spatially Quantized Gait (SQG) and the optimization. The SQG generates reference joint angles and reference trajectory of the Center Of Mass (COM) for the human-exoskeleton system in space domain. The optimization part is constructed to convert the reference joint angles from the space domain to the time domain, which is based on the dynamics model of the human-exoskeleton-walker system and adaptive to different walking speeds. The proposed approach has been tested on the robot simulation platform CoppeliaSim, the experimental results indicate that the proposed approach can generate human-like gait patterns for different walking speeds from 0 to 0.8 m/s. Additionally, in comparison with other methods, the proposed approach has a better performance on the movement tracking of the COM for a natural walking posture.Note to Practitioners—The coordinated control is important for the exoskeleton robot with a mobile robotic walker, one of the potential challenge is the adaptive coordinated motion planning for these robotic devices. The proposed approach is for the coordinated control of the exoskeleton robots with a robotic walker and adaptive to different walking speeds, which may inspires more extended coordinated control strategies for human-exoskeleton systems in more gait training applications. The proposed approach is also potential for the coordinated motion planning of the other human-centered assistance robots, such as the wheeled walking assistance robots for the elderly. Chaobin Zou, Zhinan Peng, Fengjun Mu, Rui Huang 0008, Hong Cheng 0002 |
IEEE Trans Autom. Sci. Eng. | 5 |
| 2024 | Joint-Loss Enhanced Self-Supervised Learning for Refinement-Coupled Object 6D Pose Estimationabstract6D object pose estimation plays a crucial role in robot grasping and manipulation. However, the prevalent methods for 6D object pose estimation heavily rely on 6D annotated data to train deep neural networks, which poses challenges due to the difficulty in obtaining sufficient pose annotations. To address this limitation, this paper presents a self-supervised pose estimation method based on a novel pixelwise weighted dense fusion architecture. This method allows for direct learning from unannotated RGB-D data facilitated by an Iterative Annotation Resolver. Furthermore, a self-supervised pose refinement method based on joint loss is proposed to enhance the pose estimation accuracy. This refinement method employs a differentiable renderer to construct joint optimization constraints. The experimental results demonstrate that our approach achieves a level of pose estimation accuracy that closely rivals that of supervised methods. Fengjun Mu, Shixiang Sun, Rui Huang 0008, Chaobin Zou, Wenjiang Li, Huayi Zhan, Hong Cheng 0002 |
ICRA | 3 |
| 2024 | Event-triggered learning-based robust tracking control for robotic manipulators with uncertain dynamics and non-zero equilibrium
Chen Chen 0137, Zhinan Peng, Chaobin Zou, Rui Huang 0008, Kaibo Shi, Hong Cheng 0002 |
Expert Syst. Appl. | 4 |
| 2024 | SS-Pose: Self-Supervised 6-D Object Pose Representation Learning Without RenderingabstractObject pose estimation has extensive applications in various industrial scenarios. However, the heavy reliance on dense 6-D annotation and textured object models has become a significant obstacle to the widespread industrial application of 6-D object pose estimation methods. In this work, we presentSS-Pose, a self-supervised learning framework for estimating 6-D object poses without annotated 6-D data and textured model.SS-Poseproposes thecoordinate system datum reinitializerstage to dynamically establish a sequence-level pose representation datum, and thetemporal–spatial constraint resolvermodule to obtain the self-supervised learning target through interframe constraints. We introduce a one-shotcross-coordinate transformationthat establishes the relationship between the 6-D representation and the object poses, which can be further utilized in real-world tasks. We evaluated the proposedSS-Poseon the challenging YCB-Video dataset and texture-less T-LESS dataset. Our approach achieves competitive performance with significantly lower data dependency, making it suitable for visual perception in industrial applications. Fengjun Mu, Rui Huang 0008, Jingting Zhang, Chaobin Zou, Shixiang Sun, Huayi Zhan, Pengbo Zhao, Jing Qiu 0004, Hong Cheng 0002 |
IEEE Trans. Ind. Informatics | 2 |
| 2023 | Optimal tracking control for motion constrained robot systems via event-sampled critic learning
Zhinan Peng, Hong Cheng 0002, Kaibo Shi, Chaobin Zou, Rui Huang 0008, Xiaoqing Li 0003, Bijoy K. Ghosh |
Expert Syst. Appl. | 5 |
| 2022 | A Novel Multimodal Human-Exoskeleton Interface Based on EEG and sEMG Activity for Rehabilitation TrainingabstractDespite the advances in the field of human-robot interface (HRI) based on biological neural signal, the use of the sole electroencephalography (EEG) signal to help robotic exoskeleton predict the limb movement is currently no mature in rehabilitation training, due to its unreliability. Multimodal HRI represents a very recent solution to enhance the performance of single modal HRI. These HRI normally include the EEG signal with surface electromyography (sEMG) signal. However, their use for the lower limb movement prediction in hemiplegia is still limited, and the deep fusion feature of sEMG and EEG signal is ignored. This paper proposes a Dense co-attention mechanism-based Multimodal Enhance fusion Network (DMEFNet) for the lower limb movement prediction in hemiplegia. The DMEFNet can realize the mapping and deep fusion between the sEMG and EEG signal features and get a high accuracy movement prediction of the lower limbs. A sEMG and EEG data acquisition experiment and an incomplete asynchronous data collection paradigm are designed to verify the effectiveness of DMEFNet. The experimental results show that DMEFNet has a good movement prediction performance in both within-subject and cross-subject situations, reaching an accuracy of 82.96% and 88.44% respectively. Rui Huang 0008, Fengjun Mu, Zhinan Peng, Yizhe Qin, Hong Cheng 0002 |
ICRA | 2 |
| 2022 | Human-exoskeleton Cooperative Balance Strategy for a Human-powered Augmentation Lower ExoskeletonabstractLower Limb Exoskeletons (LLE) have received considerable interest in strength augmentation, rehabilitation, and walking assistance scenarios. For strength augmentation, LLE is expected to have the capability of reducing metabolic energy. However, the energy for adjusting Center of Gravity (CoG) is a main part of the total energy consumed during walking. This paper proposes a novel Human-exoskeleton Cooperative Balance (HCB) strategy which gives assistive torques balance ability and combine with the direction selected by the pilot to achieve balance walking of human-exoskeleton systems. In which, a Dynamic Torque Primitive Model (DTPM) is designed to plan a bionic assistive torque, and the balance parameters obtained by an Inverted Pendulum Model (IPM) is superimposed on it. Finally, the performance improved by the HCB strategy can break the limitation of traditional strategies and substantially increase the efficiency of assistance. We demonstrated the effectiveness of the proposed HCB strategy on the HUman-powered Augmentation Lower EXoskeleton (HUALEX) system. Experimental results indicate that the proposed HCB is more efficient than traditional strategies. Guangkui Song, Rui Huang 0008, Zhinan Peng, Jing Qiu 0004, Huayi Zhan, Hong Cheng 0002 |
IROS | 2 |
| 2022 | Attention-Based Deep Driving Model for Autonomous Vehicles with Surround-View CamerasabstractExperienced human drivers always make safe driving decisions by selectively observing the front, rear and side- view mirrors. Several end - to-end methods have been pro-posed to learn driving models with multi-view visual infor-mation. However, these benchmark methods lack semantic understanding of multi-view image contents, where human drivers usually reason these information for decision making with different visual region of interests. In this paper, we propose an attention-based deep learning method to learn a driving model with input of surround-view visual information and the route planner, in which a multi-view attention module is designed for obtaining region of interests from human drivers. We evaluate our model on the Drive360 dataset with comparison of benchmarking deep driving models. Results demonstrate that our model achieves a competitive accuracy in both steering angle and speed prediction than benchmarking methods. Code is available at https://githuh.com/jet-uestc/MVA-Net. Yang Zhao 0024, Rui Huang 0008, Boqi Li 0001, Ao Luo, Yaochen Li, Hong Cheng 0002 |
IROS | 3 |
| 2021 | Uncertainty-Guided Transformer Reasoning for Camouflaged Object DetectionabstractSpotting objects that are visually adapted to their surroundings is challenging for both humans and AI. Conventional generic / salient object detection techniques are suboptimal for this task because they tend to only discover easy and clear objects, while overlooking the difficult-to-detect ones with inherent uncertainties derived from indistinguishable textures. In this work, we contribute a novel approach using a probabilistic representational model in combination with transformers to explicitly reason under uncertainties, namely uncertainty-guided transformer reasoning (UGTR), for camouflaged object detection. The core idea is to first learn a conditional distribution over the backbone's output to obtain initial estimates and associated uncertainties, and then reason over these uncertain regions with attention mechanism to produce final predictions. Our approach combines the benefits of both Bayesian learning and Transformer-based reasoning, allowing the model to handle camouflaged object detection by leveraging both deterministic and probabilistic information. We empirically demonstrate that our proposed approach can achieve higher accuracy than existing state-of-the-art models on CHAMELEON, CAMO and COD10K datasets. Code is available at https://github.com/fanyang587/UGTR. Fan Yang 0054, Qiang Zhai, Xin Li 0079, Rui Huang 0008, Ao Luo, Hong Cheng 0002, Deng-Ping Fan |
ICCV | 4 |
| 2021 | Estimating the Center of Mass of Human-Exoskeleton Systems with Physically Coupled Serial ChainabstractEstimating the center of mass (CoM) is essential for both gait planning and controlling of lower limb exoskeletons. Different from CoM estimation in human and humanoid robots, a critical issue in human-exoskeleton systems pis how to describe the effect of physical human-exoskeleton interactions in estimating the CoM of lower limb exoskeletons. This paper presents a novel center of mass estimation method Physically Coupled Serial Chain (PCSC) for human-coupled lower limb exoskeleton systems. Different from traditional serial chain methods, the proposed PCSC involves physical human-exoskeleton models to describe physical interactions between the pilot and the lower limb exoskeleton. We demonstrated the effectiveness of proposed PCSC model in the AIDER lower limb exoskeleton system. Experimental results indicate that the proposed PCSC model is more accuracy than traditional serial chain methods. Rui Huang 0008, Zhinan Peng, Siying Guo, Chaobin Zou, Jing Qiu 0004, Hong Cheng 0002 |
IROS | 1 |
| 2021 | TemporalFusion: Temporal Motion Reasoning with Multi-Frame Fusion for 6D Object Pose Estimationabstract6D object pose estimation is an essential task in vision-based robotic grasping and manipulation. Prior works extract spatial features by fusing the RGB image and depth without considering the temporal motion information, limiting their performance in heavy occlusion robotic grasping scenarios. In this paper, we present an end-to-end model named TemporalFusion, which integrates the temporal motion information from RGB-D images for 6D object pose estimation. The core of proposed TemporalFusion model is to embed and fuse the temporal motion information from multi-frame RGB-D sequences, which could handle heavy occlusion in robotic grasping tasks. Furthermore, the proposed deep model can also obtain stable pose sequences, which is essential for real-time robotic grasping tasks. We evaluated the proposed method in the YCB-Video dataset, and experimental results show our model outperforms state-of-the-art approaches. Our code is available at https://github.com/mufengjun260/TemporalFusion21. Fengjun Mu, Rui Huang 0008, Ao Luo, Xin Li 0079, Jing Qiu 0004, Hong Cheng 0002 |
IROS | 2 |
| 2021 | Synergetic Gait Prediction for Stroke Rehabilitation with Varying Walking SpeedsabstractLower Limb Exoskeletons (LLEs) are promising in gait rehabilitation for stroke survivors. In gait training of post-stroke patients with LLEs, one of the main challenges is how to generate appropriate gait patterns from the sound leg to the paretic leg for different patients with varying walking speeds. In this paper, we proposed a Synergetic Gait Prediction (SGP) model for rehabilitation LLEs with post-stroke patients, which can generate adaptive synergetic gait patterns for different patients with varying walking speeds. The proposed SGP model is based on Sequence-to-Sequence (Seq2Seq) neural networks with temporal attention mechanisms. In the training procedure of the proposed SGP model, a gait database with collected gait patterns from healthy subjects is employed to learn the parameters of SGP model. The SGP model takes current joint angles from the sound leg and a segment of observed history joint angles from both legs as input and predicts the future joint angles for the paretic leg. We compared the effectiveness of the SGP model with the Long Short Term Memory (LSTM) model, experimental results indicate that SGP model can generate synergetic gait patterns for different subjects via varying walking speeds with less prediction error. Chaobin Zou, Rui Huang 0008, Zhinan Peng, Jing Qiu 0004, Hong Cheng 0002 |
IROS | 2 |
| 2021 | Learning continuous coupled multi-controller coefficients based on actor-critic algorithm for lower-limb exoskeleton
Guangkui Song, Rui Huang 0008, Hong Cheng 0002, Jing Qiu 0004, Qiming Cheng, Shuai Fan 0002 |
Sci. China Inf. Sci. | 2 |
| 2021 | Adaptive compensation for time-varying uncertainties in model-based control of lower-limb exoskeleton systems
Guangkui Song, Rui Huang 0008, Hong Cheng 0002, Jing Qiu 0004, Shuai Fan 0002 |
Sci. China Inf. Sci. | 2 |
| 2021 | EKENet: Efficient knowledge enhanced network for real-time scene parsing
Ao Luo, Fan Yang 0054, Xin Li 0079, Rui Huang 0008, Hong Cheng 0002 |
Pattern Recognit. | 4 |
| 2021 | Slope Gradient Adaptive Gait Planning for Walking Assistance Lower Limb ExoskeletonsabstractIn recent years, lower limb exoskeletons have gained considerable interest in applications of walking assistance for paraplegic patients. In daily lives, the exoskeleton should have the ability to help the patients to walk over different terrains. For sloped terrains, how to plan the stepping locations on slopes with different gradients and generate stable human-like gaits for patients is a critical issue. In this article, we proposed a slope gradient estimator (SGE) based on the sensor data fusion of the exoskeleton and combined SGE with the capture point theory and dynamic movement primitives (DMP) to construct an adaptive gait planning approach for slopes. After learning from demonstrated gaits sampled from healthy subjects, adaptive gait trajectories can be reproduced online to adapt to slopes with different gradients. The efficiency of the proposed approach was demonstrated on an exoskeleton system named AIDER. Experimental results indicate that the proposed approach can endow exoskeletons with the ability to generate appropriate gaits for different slopes. Note to Practitioners-For lower limb exoskeletons, it is a vital problem to plan the gait for sloped terrains. Considering different gradients among slopes, fixed predefined gait planning cannot cover all cases; thus, a slope gradient adaptive gait planning approach is necessary. The slope gradient estimator proposed in this article provides a possible slope gradient estimation method for exoskeletons or humanoid bipedal robots; it is easy to estimate the slope gradient only based on the local sensor data of the robot. The proposed dynamic gait generator provides lower limb exoskeletons and humanoid bipedal robots a possible adaptive gait planning framework and some flexibility for different slopes. The proposed approach may inspire more extended gait planning strategies for other terrains, such as stairs. Chaobin Zou, Rui Huang 0008, Jing Qiu 0004, Hong Cheng 0002 |
IEEE Trans Autom. Sci. Eng. | 2 |
| 2020 | Data-Driven Reinforcement Learning for Walking Assistance Control of a Lower Limb Exoskeleton with Hemiplegic PatientsabstractLower limb exoskeleton (LLE) has received considerable interests in strength augmentation, rehabilitation and walking assistance scenarios. For walking assistance, the LLE is expected to have the capability of controlling the affected leg to track the unaffected leg’s motion naturally. An important issue in this scenario is that the exoskeleton system needs to deal with unpredictable disturbance from the patient, which requires the controller of exoskeleton system to have the ability to adapt to different wearers. This paper proposes a novel Data-Driven Reinforcement Learning (DDRL) control strategy to adapt different hemiplegic patients with unpredictable disturbances. In the proposed DDRL strategy, the interaction between two lower limbs of LLE and the legs of hemiplegic patient are modeled in the context of leader-follower framework. The walking assistance control problem is transformed into a optimal control problem. Then, a policy iteration (PI) algorithm is introduced to learn optimal controller. To achieve online adaptation control for different patients, based on PI algorithm, an Actor-Critic Neural Network (ACNN) technology of the reinforcement learning (RL) is employed in the proposed DDRL. We conduct experiments both on a simulation environment and a real LLE system. Experimental results demonstrate that the proposed control strategy has strong robustness against disturbances and adaptability to different pilots. Zhinan Peng, Rui Luo 0003, Rui Huang 0008, Jiangping Hu, Hong Cheng 0002, Bijoy K. Ghosh |
ICRA | 3 |
| 2020 | Optimal containment control of continuous-time multi-agent systems with unknown disturbances using data-driven approach
Zhinan Peng, Jiefu Zhang, Jiangping Hu, Rui Huang 0008, Bijoy K. Ghosh |
Sci. China Inf. Sci. | 4 |
| 2020 | A novel tunnel FET design through hybrid modulation with optimized subthreshold characteristics and high drive capability
Yang Zhao 0024, Rui Huang 0008 |
Sci. China Inf. Sci. | 3 |
| 2019 | Adaptive Gait Planning for Walking Assistance Lower Limb Exoskeletons in Slope ScenariosabstractLower-limb exoskeleton has gained considerable interests in walking assistance applications for paraplegic patients. In walking assistance of paraplegic patients, the exoskeleton should have the ability to help patients to walk over different terrains in the daily life, such as slope terrains. One critical issue is how to plan the stepping locations on slopes with different gradients, and generate stable and human-like gaits for patients. This paper proposed an adaptive gait planning approach which can generate gait trajectories adapt to slopes with different gradients for lower-limb walking assistance exoskeletons. We modeled the human-exoskeleton system as a 2D Linear Inverted Pendulum Model (2D-LIPM) with an external force in the two-dimensional sagittal plane, and proposed a Dynamic Gait Generator (DGG) based on an extension of the conventional Capture Point (CP) theory and Dynamic Movement Primitives (DMPs). The proposed approach can dynamically generate reference foot locations for each step on slopes, and human-like adaptive gait trajectories can be reproduced after the learning from demonstrated trajectories that sampled from level ground walking of normal healthy human. We demonstrated the efficiency of the proposed approach on both the Gazebo simulation platform and an exoskeleton named AIDER. Experimental results indicate that the proposed approach is able to provide the ability for exoskeletons to generate appropriate gaits adapt to slopes with different gradients. Chaobin Zou, Rui Huang 0008, Hong Cheng 0002, Jing Qiu 0004 |
ICRA | 2 |
| 2019 | End-to-End Driving Model for Steering Control of Autonomous Vehicles with Future Spatiotemporal FeaturesabstractEnd-to-end deep learning has gained considerable interests in autonomous driving vehicles in both academic and industrial fields, especially in decision making process. One critical issue in decision making process of autonomous driving vehicles is steering control. Researchers has already trained different artificial neural networks to predict steering angle with front-facing camera data stream. However, existing end-to-end methods only consider the spatiotemporal relation on a single layer and lack the ability of extracting future spatiotemporal information. In this paper, we propose an end-to-end driving model based on Convolutional Long Short-Term Memory (Conv-LSTM) neural network with a Multi-scale Spatiotemporal Integration (MSI) module, which aiming to encode the spatiotemporal information from different scales for steering angle prediction. Moreover, we employ future sequential information to enhance spatiotemporal features of the end-to-end driving model. We demonstrate the efficiency of proposed end-to-end driving model on the public Udacity dataset with comparison of some existing methods. Experimental results show that the proposed model has better performances than other existing methods, especially in some complex scenarios. Furthermore, we evaluate the proposed driving model on a real-time autonomous vehicle, and results show that the proposed driving model is able to predict the steering angle with high accuracy compared to skilled human driver. Ao Luo, Rui Huang 0008, Hong Cheng 0002, Yang Zhao 0024 |
IROS | 3 |
| 2019 | Learning Physical Human-Robot Interaction With Coupled Cooperative Primitives for a Lower ExoskeletonabstractHuman-powered lower exoskeletons have received considerable interests from both academia and industry over the past decades, and encountered increasing applications in human locomotion assistance and strength augmentation. One of the most important aspects in those applications is to achieve robust control of lower exoskeletons, which, in the first place, requires the proactive modeling of human movement trajectories through physical human-robot interaction (pHRI). As a powerful representative tool for motion trajectories, dynamic movement primitives (DMP) have been used to model human movement trajectories. However, canonical DMP only offers a general representation of human movement trajectory and may neglects the interactive term, therefore it cannot be directly applied to lower exoskeletons which need to track human joint trajectories online, because different pilots have different trajectories and even same pilot might change his/her motion during walking. This paper presents a novel coupled cooperative primitive (CCP) strategy, which aims at modeling the motion trajectories online. Besides maintaining canonical motion primitives, we model the interaction term between the pilot and exoskeletons through impedance models, and propose a reinforcement learning method based on policy improvement and path integrals (PI2) to learn the parameters online. Experimental results on both a single degree-of-freedom platform and a HUman-powered Augmentation Lower EXoskeleton (HUALEX) system demonstrate the advantages of our proposed CCP scheme. Rui Huang 0008, Hong Cheng 0002, Jing Qiu 0004, Jianwei Zhang 0001 |
IEEE Trans Autom. Sci. Eng. | 1 |
| 2018 | Learning-based Walking Assistance Control Strategy for a Lower Limb Exoskeleton with Hemiplegia PatientsabstractLower exoskeleton has gained considerable interests in walking assistance applications for both paraplegia and hemiplegia patients. In walking assistance of hemiplegia patients, the exoskeleton should have the ability to control the affected leg to follow the unaffected leg's motion naturally. One critical issue of walking assistance for hemiplegia patients is how to adapt the controller of both lower limbs with different patients. This paper presents a novel learning-based walking assistance control strategy for lower exoskeleton with hemiplegia patients. In the proposed control strategy, we modeled the control system of lower exoskeleton with hemiplegia patient as a Leader-Follower Multi-Agent System (LF -MAS). In order to adapt different patients with different conditions, reinforcement learning framework is utilized to adapt controllers online. In reinforcement learning framework with LF-MAS, we employed a Policy Iteration Adaptive Dynamic Programming (PI-ADP) algorithm, which aims to achieve better tracking control performance for lower exoskeleton with hemiplegia patient. We demonstrate the efficiency of proposed learning-based walking assistance control strategy in an exoskeleton system with healthy subjects who simulate hemiplegia patients. Experimental results indicate that the proposed control strategy can adapt different pilots with good tracking performance. Rui Huang 0008, Zhinan Peng, Hong Cheng 0002, Jiangping Hu, Jing Qiu 0004, Chaobin Zou |
IROS | 1 |
| 2018 | Hierarchical learning control with physical human-exoskeleton interaction
Rui Huang 0008, Hong Cheng 0002, Hongliang Guo 0001, XiChuan Lin, Jianwei Zhang 0001 |
Inf. Sci. | 1 |
| 2016 | Hierarchical Interactive Learning for a HUman-Powered Augmentation Lower EXoskeletonabstractLearning by demonstration methods have gained considerable interest in human-coupled robot control. It aims at modeling the goal motion trajectories through human demonstration. However, in lower exoskeleton control, the physical human-robot interaction is changing from pilot to pilot or even for one pilot in different walking patterns. This characteristic requires that the exoskeletons should have the ability to learn and adapt the motion trajectories as well as controllers online. This paper presents a novel Hierarchical Interactive Learning (HIL) strategy which reduces the complexity of the exoskeleton sensory system and is able to handle varying interaction dynamics. The proposed HIL strategy is composed of two learning hierarchies, namely, high-level motion learning and low-level controller learning. The Dynamic Movement Primitives (DMPs) combined with Locally Weighted Regression (LWR) are employed to model and learn the motion trajectories, while reinforcement learning (RL) is used to learn the model-based controller. We demonstrate the efficiency of proposed HIL strategy on a single degree-of-freedom (DOF) platform as well as a HUman-powered Augmentation Lower EXoskeleton (HUALEX) system. Experimental results indicate that the proposed HIL strategy is able to handle the varying interaction dynamics with less interaction force between the pilot and the exoskeleton when compared to traditional model-based control algorithms. Rui Huang 0008, Hong Cheng 0002, Hongliang Guo 0001, XiChuan Lin |
ICRA | 1 |
| 2016 | Learning Cooperative Primitives with physical Human-Robot Interaction for a HUman-powered Lower EXoskeletonabstractHuman-powered lower exoskeletons have gained considerable interests from both academia and industry over the past few decades, and thus have seen increasing applications in areas of human locomotion assistance and strength augmentation. One of the most important aspects in those applications is to achieve robust control of lower exoskeletons, which, in the first place, requires the proactive modeling of human movement trajectories through physical Human-Robot Interaction (pHRI). As a powerful representation tool for motion trajectories, Dynamic Movement Primitive (DMP) has been used extensively to model human movement trajectories. However, canonical DMPs only offers a general offline representation of human movement trajectory and neglects the real-time interaction term, therefore it cannot be directly applied to lower exoskeletons which need to model human motion trajectories online since different pilots have different trajectories and even one pilot might change his/her intended trajectory during walking. This paper presents a novel Coupled Cooperative Primitives (CCPs) scheme, which models the motion trajectories online. Besides maintaining canonical motion primitives, we also model the interaction term between the pilot and exoskeletons through impedance models and apply a reinforcement learning method based on Policy Improvement and Path Integrals (PI2) to learn the parameters online. Experimental results on both a single Degree-Of-Freedom (DOF) platform and a HUman-powered Augmentation Lower EXoskeleton (HUALEX) system demonstrate the advantages of our proposed CCP scheme. Rui Huang 0008, Hong Cheng 0002, Hongliang Guo 0001, XiChuan Lin, Fuchun Sun 0001 |
IROS | 1 |
| 2015 | Interactive learning for sensitivity factors of a human-powered augmentation lower exoskeletonabstractSensitivity Amplification Control (SAC) algorithm was first proposed in the augmentation applications of Berkeley Lower Extremity Exoskeleton (BLEEX). The SAC algorithm is widely used in human augmentation applications since it just need the information from the exoskeleton robot, so that the complexity of exoskeleton system can be reduced greatly. However, the SAC algorithm has two main drawbacks: 1) requiring accurate dynamic models of the exoskeleton, 2) can not manage the variation of interaction dynamics from different walking speed. This paper presents a novel developed learning control strategy based on SAC algorithm. In the proposed Adaptive Sensitivity Amplification Control (ASAC) strategy, the reinforcement learning method is utilized to learn the sensitivity factors online for the sake of handling the variation of interaction dynamics. We demonstrate the control efficiency of ASAC on an one degree-of-freedom (DOF) platform with swing movements first, and then extend it into a HUman-powered Augmentation Lower EXoskeleton (HUALEX). The experimental results show that the proposed ASAC strategy can handle the changing interaction dynamics with less interaction force between the pilot and the exoskeleton as compared with traditional SAC algorithm. Rui Huang 0008, Hong Cheng 0002, Huu-Toan Tran, XiChuan Lin |
IROS | 1 |
| 2014 | The relationship between physical human-exoskeleton interaction and dynamic factors: using a learning approach for control applications
Huu-Toan Tran, Hong Cheng 0002, XiChuan Lin, Mien-Ka Duong, Rui Huang 0008 |
Sci. China Inf. Sci. | 5 |