This paper reports that the superposition of a small set of behaviors, learned via teleoperation, can lead to robust completion of an articulated reach-and-grasp task. The results support the hypothesis that a robot can learn to interact purposefully with its environment through a developmental acquisition of sensory-motor coordination. Teleoperation can bootstrap the process by enabling the robot to observe its own sensory responses to actions that lead to specific outcomes within an environment. It is shown that a reach-and-grasp task, learned by an articulated robot through a small number of teleoperated trials, can be performed autonomously with success in the face of significant variations in the environment and perturbations of the goal. In particular, teleoperation of the robot to reach and grasp an object at nine different locations in its workspace enabled robust autonomous performance of the task anywhere within the workspace. Superpositioning was performed using the Verbs and Adverbs algorithm that was developed originally for the graphical animation of articulated characters. The work was performed on Robonaut, the NASA space-capable humanoid at Johnson Space Center, Houston, TX.

This paper addresses the problem of automatic skill acquisition by a robot. It reports that six trials of a reach-grasp-release-retract skill are sufficient for learning a canonical description of the task under the following circumstances: The robot is Robonaut, NASA's space-capable, dexterous humanoid. Robonaut was teleoperated by a person using full immersion Virtual Reality technology that transforms the operator's arm and hand motions into those of the robot. The operator's sole source of real-time feedback was visual. During the six trials all of the Robot's sensory inputs and motor control parameters were recorded as time-series. Later the time-series from each trial was partitioned into the same number of episodes as a function of changes in the motor parameter sequence. The episodes were time normalized and averaged across trials The resultant motor parameter sequence and sensor signals were used to control the robot without the teleoperator. The robot was able to perform the task autonomously with robot starting positions and object locations both similar to, and different from the original trials.