Interactions with articulated objects are a challenging but important task for mobile robots. To tackle this challenge, we propose a novel closed-loop control pipeline, which integrates manipulation priors from affordance estimation with sampling-based whole-body control. We introduce the concept of agent-aware affordances which fully reflect the agent's capabilities and embodiment and we show that they outperform their state-of-the-art counterparts which are only conditioned on the end-effector geometry. Additionally, closed-loop affordance inference is found to allow the agent to divide a task into multiple non-continuous motions and recover from failure and unexpected states. Finally, the pipeline is able to perform long-horizon mobile manipulation tasks, i.e. opening and closing an oven, in the real world with high success rates (opening: 71%, closing: 72%).

Several animal species self-organize into large groups to leverage vital behaviors such as foraging, construction, or predator evasion. With the advancement of robotics and automation, engineered multi-agent systems have been inspired to achieve similarly high degrees of scalable, robust, and adaptable autonomy through decentralized and dynamic coordination. So far however, they have been most successfully demonstrated above ground or with partial assistance from central controllers and external tracking. Here we demonstrate an underwater robot collective that realizes full spatiotemporal coordination. Using the example of fish-inspired evasive maneuvers, our robots display alignment, formation control, and coordinated escape, enabled by real-time on-board multi-robot tracking and local decision making. Accompanied by a custom simulator, this robotic platform advances the physically- validated development of algorithms for collective behaviors and future applications including collective exploration, tracking and capture, or environmental sampling.