We demonstrate the capabilities of an attentionbased end-to-end approach for high-speed vision-based quadrotor obstacle avoidance in dense, cluttered environments, with comparison to various state-of-the-art learning architectures. Quadrotor unmanned aerial vehicles (UAVs) have tremendous maneuverability when flown fast; however, as flight speed increases, traditional model-based approaches to navigation via independent perception, mapping, planning, and control modules breaks down due to increased sensor noise, compounding errors, and increased processing latency. Thus, learning-based, end-to-end vision-to-control networks have shown to have great potential for online control of these fast robots through cluttered environments. We train and compare convolutional, U-Net, and recurrent architectures against vision transformer (ViT) models for depth image-to-control in high-fidelity simulation, observing that ViT models are more effective than others as quadrotor speeds increase and in generalization to unseen environments, while the addition of recurrence further improves performance while reducing quadrotor energy cost across all tested flight speeds. We assess performance at speeds of up to 7m/s in simulation and hardware. To the best of our knowledge, this is the first work to utilize vision transformers for end-to-end vision-based quadrotor control.

Tracking controllers enable robotic systems to accurately follow planned reference trajectories. In particular, reinforcement learning (RL) has shown promise in the synthesis of controllers for systems with complex dynamics and modest online compute budgets. However, the poor sample efficiency of RL and the challenges of reward design make training slow and sometimes unstable, especially for high-dimensional systems. In this work, we leverage the inherent Lie group symmetries of robotic systems with a floating base to mitigate these challenges when learning tracking controllers. We model a general tracking problem as a Markov decision process (MDP) that captures the evolution of both the physical and reference states. Next, we prove that symmetry in the underlying dynamics and running costs leads to an MDP homomorphism, a mapping that allows a policy trained on a lower-dimensional “quotient” MDP to be lifted to an optimal tracking controller for the original system. We compare this symmetry-informed approach to an unstructured baseline, using Proximal Policy Optimization (PPO) to learn tracking controllers for three systems: the Particle (a forced point mass), the Astrobee (a fully-actuated space robot), and the Quadrotor (an underactuated system). Results show that a symmetry-aware approach both accelerates training and reduces tracking error at convergence.

Robotic exoskeletons can transform mobility for individuals with lower-limb disabilities. However, their widespread adoption is limited by controller degradation caused by varying gait dynamics across different users and environments. Here, we propose an online adaptation framework that leverages real-time data streams to continuously update the user state estimator model. This approach allows the exoskeleton to learn the user-specific gait patterns, effectively customizing the model for each new user. Additionally, we demonstrate a sensor signal transformation technique that enables model transfer across different exoskeleton hardware (from a research-grade exoskeleton to a commercial device). With less than one minute of adaptation, our framework improved gait phase estimation, which directly affects assistance timing, by 40.9% for able-bodied subjects and 65.9% for stroke survivors (p<0.05), and reduced torque profile error by 32.7% compared to the baseline model (p<0.05). Furthermore, in a pilot test, we applied our adaptation framework with human-in-the-loop optimization for control tuning. In a single stroke survivor, this approach led to a 21.8% increase in walking speed and a 6.5% reduction in metabolic cost compared to walking without exoskeleton. While preliminary, these results suggest the potential for personalized exoskeleton assistance in clinical populations.