This paper introduces AirLock+, an end-to-end vision system for scalable UAV-to-satellite image registration, enabling two key downstream tasks: (i) precise target geolocalization in geodetic coordinates and (ii) geospatial augmented reality to elevate situation awareness. AirLock+comprises three modules: A predictive tracker first localizes targets in UAV image frames, while a cross-view image matcher generates robust UAV-to-satellite homographies that withstand severe domain gaps, outdated satellite imagery, and generalize to unseen environments without finetuning. The resulting pixel-to-world correspondences enable target pixel coordinates to be mapped into geodetic space, yielding continuous trajectory estimates and supporting geospatial augmentation of UAV video feeds. Our system achieves an average target localization error of 20.23 m across 7.8 km real-world trajectories, demonstrating robustness in high-altitude, oblique-view conditions where existing methods typically fail.

Multi-suction-cup grippers are often used to perform pick-and-place robotic tasks, especially in industrial settings where grasping a wide range of light to heavy objects in limited amounts of time is a common requirement. However, most existing works focus on using one or two suction cups to grasp only lightweight objects with irregular shapes. There is a lack of research on robust manipulation of heavy objects using larger arrays of suction cups, which introduces challenges in modeling and predicting grasp failure. This paper presents a general approach to modeling grasp strength in multi-suction-cup grippers, introducing new constraints usable for trajectory planning and optimization to achieve fast and reliable pick-and-place maneuvers. The primary modeling challenge is the accurate prediction of the distribution of loads at each suction cup while grasping objects. To solve for this load distribution, we find minimum spring potential energy configurations through a simple quadratic program. This results in a computationally efficient analytical solution that can be integrated to formulate grasp failure constraints in time-optimal trajectory planning. Finally, we present experimental results to validate the efficiency and accuracy of the proposed model.

Despite the rise of mobile robot deployments in community settings, the perceived safety of cohabitants remains understudied in many domains. To address this gap, we perform a study to identify elements of indoor human–mobile robot encounters that impact perceived safety. This study evaluates the effects of robot movement behavior and the number of robots nearby on perceived safety of participants. Further, this article investigates how the presence of other people impacts perceived safety in such settings. We leverage methodologies from physiological signal analysis, autonomy, surveys, and qualitative interviews to decode insights into the human experience during such encounters. Particularly, signal analysis yielded that the presence of multiple robots decreases perceived safety and that search behaviors were more comfortable than navigation behaviors. Similarly, interviews with participants demonstrated clear effects on perceived safety in the presence of others, and that sensemaking was a key component involved in their perceptions of safety. When the data were combined, interview data revealed that near collisions between the robots likely confounded the signal analysis findings with respect to the number of robots and their movement behavior. The data types agree that the presence of a robot impacts perceived safety; however, there are also conflicting results that we discuss, which highlight that near-collisions impact perceived safety. In aggregate, the study illustrates the benefits of leveraging eclectic methods to ascertain deeper insights. Overall, the article aims to unlock insights into human perceptions during encounters with community embedded robots, which can be used in the future design of such systems.

This paper presents a set of simple and intuitive robot collision detection algorithms that show substantial scaling improvements for high geometric complexity and large numbers of collision queries by leveraging hardware-accelerated ray tracing on GPUs. It is the first leveraging hardware-accelerated ray-tracing for direct volume mesh-to-mesh discrete collision detection and applying it to continuous collision detection. We introduce two methods: Ray-Traced Discrete-Pose Collision Detection for exact robot mesh to obstacle mesh collision detection, and Ray-Traced Continuous Collision Detection for robot sphere representation to obstacle mesh swept collision detection, using piecewise-linear or quadratic B-splines. For robot link meshes totaling 24k triangles and obstacle meshes of over 190k triangles, our methods were up to 2.8 times faster in batched discrete-pose queries than a state-of-the-art GPU-based method using a sphere robot representation. For the same obstacle mesh scene, our sphere-robot continuous collision detection was up to 7 times faster depending on trajectory batch size. We also performed detailed measurements of the volume coverage accuracy of various sphere/mesh pose/path representations to provide insight into the tradeoffs between speed and accuracy of different robot collision detection methods.

Electroencephalography (EEG) measured from the human forehead can noninvasively assess activity from the prefrontal cortex (PFC), which is involved in executive functions, attention, and emotion regulation. Eye movement induced elec-troculography (EO G) can also be recorded from the forehead. Both EEG and EOG can enable a variety of applications such as brain-computer interfaces (BCI) and human status monitoring. However, conventional brain-monitoring wearables including rigid and flexible headbands form unstable electrode-skin contacts, resulting in significant noise, especially under motion. In this work, we introduce a thin, lightweight, skin-conformal, and low-power wireless electronic tattoo (e-tattoo) that can be deployed in general forehead EEGIEOG applications without being limited by signal quality, battery life, or motion.

Jerk-constrained trajectories offer a wide range of advantages that collectively improve the performance of robotic systems, including increased energy efficiency, durability, and safety. In this paper, we present a novel approach to jerk-constrained time-optimal trajectory planning (TOTP), which follows a specified path while satisfying up to third-order constraints to ensure safety and smooth motion. One significant challenge in jerk-constrained TOTP is a non-convex formulation arising from the inclusion of third-order constraints. Approximating inequality constraints can be particularly challenging because the resulting solutions may violate the actual constraints. We address this problem by leveraging convexity within the proposed formulation to form conservative inequality constraints. We then obtain the desired trajectories by solving an n-dimensional Sequential Linear Program (SLP) iteratively until convergence. Lastly, we evaluate in a real robot the performance of trajectories generated with and without jerk limits in terms of peak power, torque efficiency, and tracking capability.

Despite the rise of mobile robot deployments in home and work settings, perceived safety of users and bystanders is understudied in the human-robot interaction (HRI) literature. To address this, we present a study designed to identify elements of a human-robot encounter that correlate with observed stress response. Stress is a key component of perceived safety and is strongly associated with human physiological response. In this study a Boston Dynamics Spot and a Unitree Go1 navigate autonomously through a shared environment occupied by human participants wearing multimodal physiological sensors to track their electrocardiography (ECG) and electrodermal activity (EDA). The encounters are varied through several trials and participants self-rate their stress levels after each encounter. The study resulted in a multidimensional dataset archiving various objective and subjective aspects of a human-robot encounter, containing insights for understanding perceived safety in such encounters. To this end, acute stress responses were decoded from the human participants’ ECG and EDA and compared across different human-robot encounter conditions. Statistical analysis of data indicate that on average (1) participants feel more stress during encounters compared to baselines, (2) participants feel more stress encountering multiple robots compared to a single robot and (3) participants stress increases during navigation behavior compared with search behavior.

Model generalization of the underlying dynamics is critical for achieving data efficiency when learning for robot control. This paper proposes a novel approach for learning dynamics leveraging the symmetry in the underlying robotic system, which allows for robust extrapolation from fewer samples. Existing frameworks that represent all data in vector space fail to consider the structured information of the robot, such as leg symmetry, rotational symmetry, and physics invariance. As a result, these schemes require vast amounts of training data to learn the system's redundant elements because they are learned independently. Instead, we propose considering the geometric prior by representing the system in symmetrical object groups and designing neural network architecture to assess invariance and equivariance between the objects. Finally, we demonstrate the effectiveness of our approach by comparing the generalization to unseen data of the proposed model and the existing models. We also implement a controller of a climbing robot based on learned inverse dynamics models. The results show that our method generates accurate control inputs that help the robot reach the desired state while requiring less training data than existing methods.

This paper proposes a real-time model predictive control (MPC) strategy for accomplishing multiple tasks using robots within a finite-time horizon. In industrial robotic applications, it is crucial to consider various constraints to ensure that joint position, velocity, and torque limits are not exceeded. In addition, singularity-free and smooth motions require executing tasks continuously and safely. Instead of formulating nonlinear MPC problems, we devise linear MPC problems using kinematic and dynamic models linearized along nominal trajectories produced by hierarchical controllers. These linear MPC problems are solvable via the use of Quadratic Pro-gramming; therefore, we significantly reduce the computation time of the proposed MPC framework so the resulting update frequency is higher than 1 kHz. Our proposed MPC framework is more efficient in reducing task tracking errors than a baseline based on operational space control (OSC). We validate our approach in numerical simulations and in real experiments using an industrial manipulator. More specifically, we deploy our method in two practical scenarios for robotic logistics: 1) controlling a robot carrying heavy payloads while accounting for torque limits, and 2) controlling the end-effector while avoiding singularities.

We tackle the problem of perceptive locomotion in dynamic environments. In this problem, a quadrupedal robot must exhibit robust and agile walking behaviors in response to environmental clutter and moving obstacles. We present a hierarchical learning framework, named PRELUDE, which decomposes the problem of perceptive locomotion into high-level decision-making to predict navigation commands and low-level gait generation to realize the target commands. In this framework, we train the high-level navigation controller with imitation learning on human demonstrations collected on a steerable cart and the low-level gait controller with reinforcement learning (RL). Therefore, our method can acquire complex navigation behaviors from human supervision and discover versatile gaits from trial and error. We demonstrate the effectiveness of our approach in simulation and with hardware experiments. Videos and code can be found at the project page: https://ut-austin-rpl.github.io/PRELUDE.

The Longitudinal Social Impacts of HRI over Long-Term Deployments Workshop seeks to bring together researchers working on all aspects of thoroughly understanding such deployments. This includes researchers working in contributing areas, such as longitudinal studies of human-robot interaction, long-term autonomy, and real-world reployments. This workshop seeks to grow the study of how real-world, deployed robot systems impact the people who interact with them and the social structure of the places that they inhabit. Historically, research in this area has been high-impact. As the world sees robots begin to inhabit places designed for people - delivery robots on city streets, and robots with jobs in airports, shopping malls, and in the home - we expect the importance of understanding these impacts to grow.

We present a method that finds locomanipulation plans that perform simultaneous locomotion and manipulation of objects for a desired end-effector trajectory. Key to our approach is to consider an injective locomotion constraint manifold that defines the locomotion scheme of the robot and then using this constraint manifold to search for admissible manipulation trajectories. The problem is formulated as a weighted-A* graph search whose planner output is a sequence of contact transitions and a path progression trajectory to construct the whole-body kinodynamic locomanipulation plan. We also provide a method for computing, visualizing, and learning the locomanipulability region, which is used to efficiently evaluate the edge transition feasibility during the graph search. Numerical simulations are performed with the NASA Valkyrie robot platform that utilizes a dynamic locomotion approach, called the divergent-component-of-motion (DCM), on two example locomanipulation scenarios.

Human joint dynamic stiffness plays an important role in the stability of performance augmentation exoskeletons. In this paper, we consider a new frequency domain model of the human joint dynamics which features a complex value stiffness. This complex stiffness consists of a real stiffness and a hysteretic damping. We use it to explain the dynamic behaviors of the human connected to the exoskeleton, in particular the observed non-zero low frequency phase shift and the near constant damping ratio of the resonance as stiffness and inertia vary. We validate this concept with an elbow-joint exoskeleton testbed (attached to a subject) by experimentally varying joint stiffness behavior, exoskeleton inertia, and the strength augmentation gain. We compare three different models of elbow-joint dynamic stiffness: a model with real stiffness, viscous damping and inertia; a model with complex stiffness and inertia; and a model combining the previous two models. Our results show that the hysteretic damping term improves modeling accuracy (via a statistical F-test). Moreover, this term contributes more to model accuracy than the viscous damping term. In addition, we experimentally observe a linear relationship between the hysteretic damping and the real part of the stiffness which allows us to simplify the complex stiffness model down to a 1-parameter system. Ultimately, we design a fractional order controller to demonstrate how human hysteretic damping behavior can be exploited to improve strength amplification performance while maintaining stability.

With the primary objective of human-robot interaction being to support humans' goals, there exists a need to formally synthesize robot controllers that can provide the desired service. Synthesis techniques have the benefit of providing formal guarantees for specification satisfaction. There is potential to apply these techniques for devising robot controllers whose specifications are coupled with human needs. This paper explores the use of formal methods to construct human-aware robot controllers to support the productivity requirements of humans. We tackle these types of scenarios via human workload-informed models and reactive synthesis. This strategy allows us to synthesize controllers that fulfill formal specifications that are expressed as linear temporal logic formulas. We present a case study in which we reason about a work delivery and pickup task such that the robot increases worker productivity, but not stress induced by high work backlog. We demonstrate our controller using the Toyota HSR, a mobile manipulator robot. The results demonstrate the realization of a robust robot controller that is guaranteed to properly reason and react in collaborative tasks with human partners.

A cyberphysical avatar is a semi-autonomous robot that adjusts to an unstructured environment and performs physical tasks subject to critical timing constraints while under human supervision. This article first realizes a cyberphysical avatar that integrates three key technologies: body-compliant control, neuroevolution, and real-time constraints. Body-compliant control is essential for operator safety, because avatars perform cooperative tasks in close proximity to humans; neuroevolution (NEAT) enables “programming” avatars such that they can be used by non-experts for a large array of tasks, some unforeseen, in an unstructured environment; and real-time constraints are indispensable to provide predictable, bounded-time response in human-avatar interaction. Then, we present a study on the tradeoffs between three design parameters for robotic task systems that must incorporate at least three dimensions: (1) the amount of training effort for robot to perform the task, (2) the time available to complete the task when the command is given, and (3) the quality of the result of the performed task. A tradeoff study in this design space by using the imprecise computation as a framework is to perform a common robotic task, specifically, grasping of unknown objects. The results were validated with a real robot and contribute to the development of a systematic approach for designing robotic task systems that must function in environments like flexible manufacturing systems of the future.

In this paper, we present a sampling-based kino-dynamic planning framework for a bipedal robot in complex environments. Unlike other footstep planning algorithms which typically plan footstep locations and the biped dynamics in separate steps, we handle both simultaneously. Three primary advantages of this approach are (1) the ability to differentiate alternate routes while selecting footstep locations based on the temporal duration of the route as determined by the Linear Inverted Pendulum Model (LIPM) dynamics, (2) the ability to perform collision checking through time so that collisions with moving obstacles are prevented without avoiding their entire trajectory, and (3) the ability to specify a minimum forward velocity for the biped. To generate a dynamically consistent description of the walking behavior, we exploit the Phase Space Planner (PSP) [1] [2]. To plan a collision-free route toward the goal, we adapt planning strategies from non-holonomic wheeled robots to gather a sequence of inputs for the PSP. This allows us to efficiently approximate dynamic and kinematic constraints on bipedal motion, to apply a sampling-based planning algorithm such as RRT or RRT*, and to use the Dubin's path [3] as the steering method to connect two points in the configuration space. The results of the algorithm are sent to a Whole Body Controller [1] to generate full body dynamic walking behavior. Our planning algorithm is tested in a 3D physics-based simulation of the humanoid robot Valkyrie.

In this paper, we devise methods for the multiobjective control of humanoid robots, a.k.a.prioritized wholebody controllers, that achieve efficiency and robustness in the algorithmic computations.We use a form of whole-body controllers that is very general via incorporating centroidal momentum dynamics, operational task priorities, contact reaction forces, and internal force constraints.First, we achieve efficiency by solving a quadratic program that only involves the floating base dynamics and the reaction forces.Second, we achieve computational robustness by relaxing task accelerations such that they comply with friction cone constraints.Finally, we incorporate methods for smooth contact transitions to enhance the control of dynamic locomotion behaviors.The proposed methods are demonstrated both in simulation and in real experiments using a passive-ankle bipedal robot.

In this paper we focus on a mobile platform which physically interacts with a human operator. We detect the contact gestures of a human operator in real-time using a labmade time-of-flight 3D scanner mounted on the platform as well as rotary torque sensors mounted along the drivetrain of its omni-directional wheels. Through the fusion of these two different sensors, touch gestures of an operator are processed inferring information about the body parts in contact and the applied forces. Behaviors that respond to touch-based gestures are programmed a priori, and with the previous sensor data we classify them into a set of known contact gestures that allow the platform to quickly react. We investigate these physical human-robot cooperative functions in a testbed consisting of a sensorized mobile platform and a human operator.

The mechanical design of robotic hands has been converging towards low-inertia, tendon-driven strategies. As tendon driven robotic fingers are serial chain systems, routing strategies with compliant tendons lead to multi-articular coupling between the degrees of freedom. We propose a generalized analysis of such serial chain linkages with coupled passive joint stiffnesses. We analyze the effect of such coupling on maximum achievable stiffness control boundaries while maintaining passivity at the actuators by analytically deriving the boundaries. We believe that we can use this information to form mechanical design guidelines for intelligently selecting arrangements of compliance elements (mechanical springs) and transmission strategies, i.e. tendon routing and pulley radii, to provide intrinsic stability and customizable controller stiffness limits for high performance manipulation in robotic hands.

This paper considers the problem of numerically efficient planning for legged robot locomotion, aiming towards reactive multi-contact planning as a reliability feature. We propose to decompose the problem into two parts: an extremely low dimensional kinematic search, which only adjusts a geometric path through space; and a dynamic optimization, which we focus on in this paper. This dynamic optimization also includes the selection of foot steps and hand-holds-in the special case of instantaneous foot re-location. This case is interesting because (1) it is a limiting behavior for algorithms with a foot switching cost, (2) it may have merit as a heuristic to guide search, and (3) it could act as a building block towards algorithms which do consider foot transition cost. The algorithm bears similarity both to phase space locomotion planning techniques for bipedal walking and the minimum time trajectory scaling problem for robot arms. A fundamental aspect of the algorithm's efficiency is its use of linear programming with reuse of the active set of inequality constraints. Simulation results in a simplified setting are used to demonstrate the planning of agile locomotion behaviors.

Whole-body operational space controllers (WBOSCs) are versatile and well suited for simultaneously controlling motion and force behaviors, which can enable sophisticated modes of locomotion and balance. In this paper, we formulate a WBOSC for point-foot bipeds with series-elastic actuators (SEA) and experiment with it using a teen-size SEA biped robot. Our main contributions are on devising a WBOSC strategy for point-foot bipedal robots, 2) formulating planning algorithms for achieving unsupported dynamic balancing on our point-foot biped robot and testing them using a WBOSC, and 3) formulating force feedback control of the internal forces-corresponding to the subset of contact forces that do not generate robot motions-to regulate contact interactions with the complex environment. We experimentally validate the efficacy of our new whole-body control and planning strategies via balancing over a disjointed terrain and attaining dynamic balance through continuous stepping without a mechanical support.

Legged robots naturally exhibit continuous and discrete dynamics when maneuvering over level-ground and uneven terrains. In recent years, numerous studies have focused on locomotion hybrid dynamics. However, locomotion on more challenging terrains such as split wedges in Figure 1 has rarely been explored, let alone its hybrid dynamics. In this study, we specifically focus on a two-phase hybrid automaton formulation for this highly steep wedge locomotion. This automaton incorporates both multi-contact and flight single contact phase motions. To dynamically balance and jump upwards on this wedge, an aperiodic phase space planning is used for trajectory generations. Three control strategies are employed simultaneously: internal force control, linear and angular momentum control. Finally, simulation results are shown to verify our strategy's effectiveness.

We present a study on the tradeoffs between three design parameters for robotic task systems that function in partially unknown and unstructured environments, and under timing constraints. The design space of these robotic tasks must incorporate at least three dimensions: (1) the amount of training effort to teach the robot to perform the task, (2) the time available to complete the task from the point when the command is given to perform the task, and (3) the quality of the result from performing the task. This paper presents a tradeoff study in this design space for a common robotic task, specifically, grasping of unknown objects in unstructured environments. The imprecise computation model is used to provide a framework for this study. The results were validated with a real robot and contribute to the development of a systematic approach for designing robotic task systems that must function in environments like flexible manufacturing systems of the future.

Robotic grasping of a target object without advance knowledge of its three-dimensional model is a challenging problem. Many studies indicate that robot learning from demonstration (LfD) is a promising way to improve grasping performance, but complete automation of the grasping task in unforeseen circumstances remains difficult. As an alternative to LfD, this paper leverages limited human supervision to achieve robotic grasping of unknown objects in unforeseen circumstances. The technical question is what form of human supervision best minimizes the effort of the human supervisor. The approach here applies a human-supplied bounding box to focus the robot's visual processing on the target object, thereby lessening the dimensionality of the robot's computer vision processing. After the human supervisor defines the bounding box through the man-machine interface, the rest of the grasping task is automated through a vision-based feature-extraction approach where the dexterous hand learns to grasp objects without relying on pre-computed object models through the NEAT neuroevolution algorithm. Given only low-level sensing data from a commercial depth sensor Kinect, our approach evolves neural networks to identify appropriate hand positions and orientations for grasping novel objects. Further, the machine learning results from simulation have been validated by transferring the training results to a physical robot called Dreamer made by the Meka Robotics company. The results demonstrate that grasping novel objects through exploiting neuroevolution from simulation to reality is possible.

This paper presents a control scheme for ensuring that a 3D, under-actuated, point-foot biped robot remains balanced while walking. It achieves this by observing the center of mass (COM) position error relative to a reference path and re-planning a new reference trajectory to remove this error at every step. The Prismatic Inverted Pendulum Model (PIPM) is used to simplify behavioral analysis of the robot. We use phase space techniques to plan the COM trajectories and foot placement. While obtaining a stable path using this simplified model is easy, when applied to a real robot, there will usually be deviation from the expected path due to modeling inaccuracies. Although fully-actuated robots can reduce the deviation with relatively simple feedback control loops, when working with under-actuated robots, it is challenging to design such a feedback control loop. Our approach is based on continuous re-planning. By planning the path of the next step based on the observed initial error, we can find the proper landing location of each step. For each step we allocate sufficient time to avoid disturbances from the moment induced by the moving leg, which is not modeled in the PIPM. Our control scheme relies on the PIPM instead of the Linear Inverted Pendulum Model (LIPM) to enable non-planar COM motion, which is essential for rough terrain locomotion. We show simulation results that include full multi-body dynamics, friction, and ground reaction forces.

In order to make unintentional physical interaction with robots safer for humans, we consider compliant control of an omnidirectional wheeled base. In this paper we present a fully holonomic mobile robot system which achieves compliant motion via force control, improving over previous pseudo-omnidirectional mobile systems by being fully omnidirectional. We explain our robot's drive train, and present an experimental validation of our actuator control strategy. Using a smith predictor and a simple delay-based plant model, we demonstrate compliance and safe interaction in both the mobile system alone and as the base of a wheeled mobile manipulator style system.

Motivated by an emerging theory of robust low-rank matrix representation, in this paper, we introduce a novel solution for online rigid-body motion registration. The goal is to develop algorithmic techniques that enable a robust, real-time motion registration solution suitable for low-cost, portable 3-D camera devices. Assuming 3-D image features are tracked via a standard tracker, the algorithm first utilizes Robust PCA to initialize a low-rank shape representation of the rigid body. Robust PCA finds the global optimal solution of the initialization, while its complexity is comparable to singular value decomposition. In the online update stage, we propose a more efficient algorithm for sparse subspace projection to sequentially project new feature observations onto the shape subspace. The lightweight update stage guarantees the real-time performance of the solution while maintaining good registration even when the image sequence is contaminated by noise, gross data corruption, outlying features, and missing data. The state-of-the-art accuracy of the solution is validated through extensive simulation and a real-world experiment, while the system enjoys one to two orders of magnitude speed-up compared to wellestablished RANSAC solutions.

Whole-body operational space control is a powerful compliant control approach for robots that physically interact with their environment. The underlying mathematical and algorithmic principles have been laid in a large body of published work, and novel research keeps advancing its formulation and variations. However the lack of a reusable and robust shared implementation has hindered its widespread adoption.

Although the problem of dynamic locomotion in very rough terrain is critical to the advancement of various areas in robotics and health devices, little progress has been made on generalizing gait behavior with arbitrary paths. Here, we report that perturbation theory, a set of approximation schemes that has roots in celestial mechanics and nonlinear dynamical systems, can be adapted to predict the behavior of non-integrable state-space trajectories of a robot's center of mass, given its arbitrary contact state and center of mass (CoM) kinematic path. Given an arbitrary kinematic path of the CoM and known step locations, we use perturbation theory to determine phase curves of CoM behavior. We determine step transitions as the points of intersection between adjacent phase curves. To discover intersection points, we fit polynomials to the phase curves of neighboring steps and solve their differential roots. The resulting multi-step phase diagram is the locomotion plan suited to drive the behavior of a robot or device maneuvering in the rough terrain. We provide two main contributions to legged locomotion: (1) predicting CoM state-space behavior for arbitrary paths by means of perturbation theory, and (2) finding step transitions by locating common intersection points between neighboring phase curves. Because these points are continuous in phase they correspond to the desired contact switching policy. We validate our results on a human-size avatar navigating in a very rough environment and compare its behavior to a human subject maneuvering through the same terrain.

This paper presents a new methodology for the analysis and control of internal forces and center-of-mass (CoM) behavior, which are produced during multicontact interactions between humanoid robots and the environment. The approach leverages the virtual-linkage model that provides a physical representation of the internal and CoM resultant forces with respect to reaction forces on the supporting surfaces. A grasp/contact matrix describing the complex interactions between contact forces and CoM behavior is developed. Based on this model, a new torque-based approach for the control of internal forces is suggested and illustrated on the Asimo humanoid robot. The new controller is integrated into the framework for whole-body-prioritized multitasking, thus enabling the unified control of CoM maneuvers, operational tasks, and internal-force behavior. The grasp/contact matrix is also proposed to analyze and plan internal force and CoM control policies that comply with frictional properties of the links in contact.

This paper presents a methodology for the modeling and control of internal forces and moments produced during multi-contact interactions between humanoid robots and the environment. The approach is based on the virtual linkage model which provides a physical representation of the internal forces and moments acting between the various contacts. The forces acting at the contacts are decomposed into internal and resulting forces and the latter are represented at the robot's center of mass. A grasp/contact matrix describing the complex interactions between contact forces and center of mass behavior is developed. Based on this model, a new torque-based approach for the control of internal forces is suggested and illustrated on the Asimo humanoid robot. The new controller is integrated into the framework for whole-body prioritized multitasking enabling the unified control of operational tasks, postures, and internal forces.

Tomorrow's humanoids will operate in human environments, where efficient manipulation and locomotion skills, and safe contact interactions are critical design factors. We report here our recent efforts into these issues, materialized into a whole-body control framework. This framework integrates task-oriented dynamic control and control prioritization allowing to control multiple task primitives while complying with physical and movement-related constraints. Prioritization establishes a hierarchy between control spaces, assigning top priority to constraint-handling tasks, while projecting operational tasks in the null space of the constraints, and controlling the posture within the residual redundancy. This hierarchy is directly integrated at the kinematic level, allowing the program to monitor behavior feasibility at runtime. In addition, prioritization allows us to characterize the dynamic behavior of the individual control primitives subject to the constraints, and to synthesize operational space controllers at multiple levels. To complete this framework, we have developed free-floating models of the humanoid and incorporate the associated dynamics and the effects of the resulting support contacts into the control hierarchy. As part of a long term collaboration with Honda, we are currently implementing this framework into the humanoid robot Asimo

The possibility of controlling humanoid robots in free-space opens new fields of application involving free-floating behaviors. Recently, we presented a prioritized task-oriented control framework for the control of multiple motion primitives while complying with physical constraints imposed by the robot’s body and environment. We adapt here this framework to the control of free-floating robots.