Individuals with Severe Speech and Motor Impairment (SSMI) struggle to interact with their surroundings due to physical and communicative limitations. To address these challenges, this paper presents a gaze-controlled robotic system that helps SSMI users perform stamp printing tasks. The system includes gaze-controlled interfaces and a robotic arm with a gripper, designed specifically for SSMI users to enhance accessibility and interaction. User studies with gazecontrolled interfaces such as video see-through (VST), video pass-through (VPT), and optical see-through (OST) displays demonstrated the system's effectiveness. Results showed that VST had the average stamping time of$28.45 s(SD = 15.44s)$and the average stamp count$7.36(SD = 3.83)$, outperforming VPT and OST.

Rapid aiming movement involves quick, accurate, pre-programmed motions used in the context of human-computer and human-robot interaction. It incorporates target forecasting to minimize the duration of tasks requiring rapid aiming. Applications include predicting target icons in UI design, driver intent in automotive technology, and human intent during human-robot collaboration. Conventional approaches often fail to capture human preferences accurately, leading to low prediction accuracy. This work explores an Inverse Reinforcement Learning (IRL)-based system for forecasting human hand movements and intended targets during rapid aiming. Sampling-based Maximum Entropy IRL (SMEIRL) with a sampler and Maximum Entropy Deep IRL (MEDIRL) algorithms were evaluated for prediction accuracy. The proposed sampler efficiently generates sample trajectories for rapid aiming tasks. User studies were conducted to assess target prediction during two tasks involving rapid aiming movement: (1) Pointing in Virtual Reality (VR) and Mixed Reality (MR), and (2) Human-robot handovers. A multimodal target prediction algorithm was analyzed for swift and accurate anticipation of the intended target, considering both hand and eye gaze. Results demonstrate that the proposed approach achieves a prediction accuracy of 98% in MR and 96% in VR for the pointing task using SMEIRL. During human-robot handover task, prediction accuracy using MEDIRL reached 99.9% when less than 20% and 40% of the task was left using only hand motion or both hand and eye gaze, respectively, surpassing state-of-the-art methods using Path Integral-IRL (PI-IRL), Recurrent Neural Network-Inverse Kinematics-Modified Kalman Filtering (RNNIK-MKF), Bayesian Predictor for Human Motion Trajectory (BP-HMT), and Classical kinematics of motion ( \(CM_{k=5}\) ).

In shared autonomy, human-robot handover for object delivery is crucial. Accurate robot predictions of human hand motion and intentions enhance collaboration efficiency. However, low prediction accuracy increases mental and physical demands on the user. In this work, we propose a system for predicting hand motion and intended target during human-robot handover using Inverse Reinforcement Learning (IRL). A set of feature functions were designed to explicitly capture users’ preferences during the task. The proposed approach was experimentally validated through user studies. Results indicate that the proposed method outperformed other state-of-the-art methods (PI-IRL, BP-HMT, RNNIK-MKF and CMk=5) with users feeling comfortable reaching upto 60% of the total distance to the target for handover with 90% target prediction accuracy. The target prediction accuracy reaches 99.9% when less than 20% of the task remains.