Soft Pneumatic Actuators (SPAs) have recently become popular for use as fingers in robotic hands because of their inherent compliance, low cost, and ease of construction. We seek to overcome two key limitations which limit SPAs' abilities to grasp and manipulate objects: 1) Current SPAs lack position or force sensor feedback, which prevents controlling them precisely (e.g. to achieve a hand preshape or apply a specified pushing force), and 2) the tip of the SPA is compliant and has high friction against common surfaces, causing the SPA to stick against surfaces when grasping objects from above. To overcome the first limitation we propose methods to integrate soft eGaIn sensors into SPAs and controllers that use these sensors' feedback for position and force control. To overcome the second limitation, we explore embedding rigid fingernails into the tip of the SPA so that the finger does not stick against surfaces and can wedge under objects. Our experiments suggest that we can achieve low steady-state error and overshoot in position and force using feed-forward models that relate pressure, force, and curvature along with a PID controller. We also compare several fingernail designs and show that the best-performing design significantly outperforms having no fingernails when grasping a set of common objects from a table.

Supervision and teleoperation of high degree-of-freedom robots is a complex task due to environmental constraints such as obstacles and limited communication, as well as task specific requirements such as using more than one end-effector at the same time. In this work we present a supervision and teleoperation framework that allows an operator to see the surroundings of a robot in 3D, make necessary adjustments for a dual or single arm manipulation task, preview the task in simulation before execution, and finally execute the task on a real robot. The framework has been applied to the valve turning task of the DARPA Robotics Challenge on the PR2, Hubo2+, and DRCHubo robots.

We propose a new method of representing de-formable objects that allows both physical and qualitative properties to be captured in an efficient representation. We show how to use this representation with two types of motion planners: 1) optimal discrete planners, which are suitable for low-dimensional problems, 2) sampling-based planners that plan in high-dimensional cost spaces. In both cases, our representation allows us to formulate a cost function that directly assesses the cost of deformation without expensive physical simulation or computation of deformed geometry. We show that our methods can generate paths that minimize deformation in both simulated and physical environments with either hard and soft robots in either hard and soft environments. The efficiency of our representation allows these paths to be computed in under 20s for 3-DOF problems. For more complicated 6-DOF problems, low-deformation paths can be computed in under 120s. Additionally, using feedback from simulated and physical test environments, we demonstrate methods for calibrating models based on our representation.

In this paper, we report lessons learned through the design of a framework for teleoperating a humanoid robot to perform a manipulation task. We present a software framework for cooperative traded control that enables a team of operators to control a remote humanoid robot over an unreliable communications link. The framework produces statically-stable motion trajectories that are collision-free and respect end-effector pose constraints. After operator confirmation, these trajectories are sent over the data link for execution on the robot. Additionally, we have defined a clear operational procedure for the operators to manage the teleoperation task. We applied our system to the valve turning task in the DARPA Robotics Challenge (DRC). Our framework is able to perform reliably and is resilient to unreliable network conditions, as we demonstrate in a set of test runs performed remotely over the internet. We analyze our approach and discuss lessons learned which may be useful for others when designing such a system.