The humanoid robot that can transform itself into a form according to its purpose requires whole-body motions with complex contact state transitions such as recovery from a fall and transition to the target form. To make the robot behavior in simulations closer to that in the real world for planning complex target trajectories, we need a platform that can measure the body stiffness during the motion and verify its application without being damaged by repeated motions that are prone to tipping over. In this study, we propose a small, inexpensive, and robust humanoid-vehicle transformer platform with redundant sensors and a low rigidity multi degree-of-freedom body and observe the effects of body deflection and internal forces during whole-body posture transition. By comparing the results obtained from experiments in several environments with different friction and from the simulator using a rigid body model, we were able to verify the influence of body flexibility on whole-body motion and the relationship between deflection and wrench observed by redundant sensors and movement failure.

When robots walk on uneven terrain, trajectory planning should take into account both the whole-body dy-namics and the ground geometry simultaneously. In uneven terrain environments, there are only a limited number of places where the robot is able to make stable contact with the ground without its feet wobbling or slipping because of the intricate round geometry. In such environments, the optional landing position and time to maintain the robot's balance and stable foot contact are not obvious and computationally expensive. In this study, we propose a robust walking system that integrates environment recognition using steppable regions and walking control for a humanoid robot to walk on uneven terrain. In this paper, a steppable region is defined as a two-dimensional convex hull that represents a region where a robot is capable of landing. We propose a method to compute the steppable region quickly by 2.SD projection of the environment points and spatial filtering. In this system, the walking controller integrates the steppable region with the Capture Region to modify the landing position from a two-dimensional geometric calculation. In addition, to cope with the environment recognition error, we have introduced a trajectory generation that allows the feet to penetrate the ground and hybrid control of position and torque. We verified the effectiveness of the proposed system through experiments in which a life-size humanoid robot walked on uneven terrain and recovered when pushed.

Legged robots with high locomotive performance have been extensively studied, and various leg structures have been proposed. Especially, a leg structure that can achieve both continuous and high jumps is advantageous for moving around in a three-dimensional environment. In this study, we propose a parallel wire-driven leg structure, which has one DoF of linear motion and two DoFs of rotation and is controlled by six wires, as a structure that can achieve both continuous jumping and high jumping. The proposed structure can simultaneously achieve high controllability on each DoF, long acceleration distance and high power required for jumping. In order to verify the jumping performance of the parallel wire-driven leg structure, we have developed a parallel wire-driven monopedal robot, RAMIEL. RAMIEL is equipped with quasi-direct drive, high power wire winding mechanisms and a lightweight leg, and can achieve a maximum jumping height of 1.6 m and a maximum of seven continuous jumps.

Self-healing function is a promising approach for damage management of high-load robot applications such as legged robots. Although the function is getting major in soft robotics, its application to life-sized "stiff" robots is of relatively minor interest. Although the authors have devised several self-healing tensile modules for tendon-driven robots, the design guideline to satisfy the large load endurance and large stroke is still unclear. The paper focuses on the parametric design for unleaked liquid-assisted healing of low melting point alloy structure. The method was validated with a benchtop module test. Moreover, the module enabled tendon-driven monopod testbed to perform squat motion three times after the landing impact fracture and the self-healing sequence, which was never accomplished.

The purpose of this paper is the robotic hanging manipulation of an object of various shapes that is not limited to a specific category. To achieve this, we propose a method that allows the estimator to learn many different shapes with hanging points without any manual annotation. A random shape generator using GAN solves the limitation of the number of 3D models and can handle objects of various shapes. In addition, hanging is repeated in the dynamics simulation, and hanging points are automatically generated. A large amount of training data is generated by rendering random-textured objects with hanging points in the random simulation environment. A deep neural network trained with these data was able to estimate hanging points of an unknown category object in the real world and achieved hanging manipulation by a robot.

There is increasing demand for robots that provide a mode of transportation in environments in which people coexist. However, conventional mobile robots, especially those carrying people, are limited in terms of their environments and tasks. For example, wheeled robots are limited to moving on flat ground. Walking robots are limited to entertainment and so on. The originality of the present paper is the development of a novel movement mechanism for a mobility apparatus that can handle various daily use scenes. We first clarify functional requirements for daily use. We then propose a transformable human-carrying wheel–leg mobility. The leg is based on a serial link and compactly uses a parallel link mechanism such that the motor is placed on top, which improves responsiveness when having a high payload and compact shape. By conducting simulations and experiments with the prototype, it is confirmed that expected operations can be realized. In particular, it is confirmed that the weight of the leg tips is reduced, such that the shaking of the waist in the direction of travel during the ascent of a step is reduced by 68%. The above results reveal that the prototype can be used in daily life.

We developed a method to enable a humanoid robot to carry stacked boxes. In order to transport objects efficiently, it is necessary to carry multiple objects at the same time, but in previous studies, humanoid robots have only been able to carry a single object. When a humanoid robot carries stacked boxes, the robot drops boxes when the positional relationship between un-grasped boxes changes. The causes for dropping the boxes can be divided into sudden changes attributed to robot making turns or losing balance, and the accumulation of small changes that occur because of the impact of landing while walking. We propose a method that prevents sudden changes in the stacked boxes by smoothing the hand trajectory and modifying the misalignment by tilting or shaking the entire stack. We verify the effectiveness of proposed method for enabling a humanoid robot to carry stacked boxes through experiments using a simulator and an actual robot.

In this paper, we aim to recognize function points of category-agnostic objects and perform object manipulation. To recognize function points of various shapes, it is necessary to train with a large amount of training data. Also, it is necessary to take into account not only visual information but also physics and interaction between objects. To solve these problems, we are working on the automatic generation of training data by detecting function points from a physical simulation. In the proposed system, we add simulation with target task operation and goal state, which allows a robot to acquire the target function point recognizer. We also use GAN to generate various random shapes and render them with random domains, and train Deep Neural Networks on these data. These enable the robot to recognize function points of unseen objects in the real world and realize manipulation.

In this work, we propose a system for humanoid robot fast motions. When a humanoid robot performs a motion such as a tennis forehand stroke motion, a whole-body fast motion in reaction to visual information is required. There are three problems to tackle. (1) Motion is desired to be quick. (2) Real-time visual processing considering visual noises is needed. (3) Real-time joint angle modification with balance keeping is needed. To solve the problem (1), we used an offline optimization system to enhance the motion speed. To solve the problem (2), we implement a ball trajectory prediction algorithm using the Extended Kalman Filter (EKF). To solve the trade-off between (1) and (3), we propose an offline optimization condition with an estimated balance margin. By using these methods, we achieved a non-step tennis forehand stroke motion with a humanoid robot by predicting a ball's trajectory with stereo cameras on the robot's head.

For mitigating joint impact torques, researchers have reduced joint stiffness by series elastic actuators, reflected inertia by low gear ratios, and friction torque from drive-trains. However, these impact mitigation methods may impair the control performance of contact forces or may increase motor and robot mass. This paper proposes a design method for achieving a balance between impact mitigation performance and force control fidelity. We introduce an inertia-to-square-torque ratio as a new index for integrating the parameters of torque generation (motor continuous torque limits, gear ratios, etc.) and the parameters of impact mitigation (joint stiffness, reflected inertia, etc.). In the process, we make a hypothesis that a motor mass is negatively correlated with the ratio. Based on the hypothesis, we calculate a joint breakdown region of impact torques, joint stiffnesses, and motor masses. Finally, we decide the drive-train specifications of JAXON3-P and demonstrate that the proposed method provides high impact mitigation and force control capabilities through several experiments including the jumping motion of 0.3 m COG height.

We proposed the soft flexible wire-driven finger mechanism with the soft skin and the multi-joint skeletal structure using two coil springs. The multi-joint skeletal structure is mainly composed of two coil springs, multiple skeletal members and a fiber wire, and the soft skin is formed outside of them. The soft skin and the multi-joint skeletal structure make it possible to distribute the contact pressure, which is necessary for not only touching a living body such as a human or an agricultural crop, but also for touching an artificial object such as pastry or an industrial product without damaging it or its package. In this paper, we describe the design of the soft flexible wire-driven finger mechanism and development of the three-fingered hand using the finger mechanism we proposed.

In this paper, we propose walking balance control based on Caputurability. The proposed method consists of five strategies: (i) moving Zero Moment Point (ZMP) in the support polygon (ii) landing position modification (iii) landing timing modification (iv) angular momentum control (v) falling detection and fall control. Walking pattern generation calculates the ZMP so that the Capture Point (CP) reaches the position of the supporting foot at the end of the double support phase. Owing to the asymmetry of the reachable landing region, landing timing modification is different in the sagittal and lateral planes, and the step time is extended in the lateral plane depending on the direction of disturbances. The torque around the center of gravity to avoid falling is realized through whole-body inverse kinematics with constraints on the angular momentum. In addition, we propose falling detection considering the reachable landing region. We verified the effectiveness of the proposed method through experiments in which the biped robot was disturbed by pushing during tether-free walking. The robot could prevent breakdown by detecting possible falling and performed knee bending motions to suppress damage.

We present a torque controller for humanoid robot's arm and a method to execute heavy-load tasks under that controller. Torque control of arms can reduce the joint load when an impulsive force is applied to the robot's hand. This feature is important for robots that will work among many humans or obstacles because accidental collisions may happen in such situations. We also developed a static force filter for force sensors at the end-effectors. This filter is utilized for the compensation for the static reaction force during heavy-load tasks. A life-sized humanoid robot JAXON digs soil with a shovel and carries soil with a wheelbarrow using our proposed controller.

Self-healing robotics has been of considerable interest. We believe the function will have a major role in legged robots as a typical high-load application of robotics. Some pioneering works have been ongoing on self-healing soft robots. However, the development of large load self-healing component and its system integration with a life-sized legged robot is a challenging task. This study is to try the problem by a constructing self-healing component oriented for facilitated investigation. Proposed part enhances visibility and manufacturing by specializing tension transmission system. The developed module was evaluated by several experiments. First, healing visualization experiment was conducted to evaluate healing progress. In addition, the module's strength was tested using a motor-driven tendon module previously developed in our laboratory. Results of these experiments suggested that the stirring process have a major role in performing self-healing behaviour. Finally, we conducted a preliminary experiment on a tendon-driven legged robot. The experiment demonstrated that the module functioned in a real robot once.

Humanoid robots are expected to conduct tasks on behalf of humans in places such as a disaster scattered environment. Although humanoid robots have potentials to walk on uneven ground unlike wheeled robots, it is difficult to reach a given destination without falling down based on only visual information. In this paper, to reach the destination safely, we propose the autonomous safe locomotion system applying vision and sole reaction force to the footstep planning. Considering force information in addition to visual information, the robot can plan a path avoiding unstable footholds. The planned path is safer than a path which is planned based on only visual information. In our system, the robot checks if the foothold is safe or not by the foothold ascertainment motion. In addition to that, the robot saves the results of the motion to the database with the foothold label given by the visual classifier. To judge foothold safety, stiffness of the foothold is estimated from the reaction force and stepping amount. We propose the system considering these requirements for safe locomotion for bipedal robots and show experimental results using a real bipedal robot CHIDORI.

When a humanoid robot manipulates a heavy object, balance and heavy loads become problems. To solve these problems, we provide a method to generate a key pose sequence of the robot and the object which balance constraints and joint torque limits are kept. As we consider the configurations of both the robot and the object, the key poses of them are optimized in a view of kinematics and statics. Moreover, we generate a smooth key pose sequence by adding an objective function which makes adjacent poses closer. By using the proposed method, we make a humanoid robot RHP4B place a heavy suitcase on a step.

An integrated humanoid robot system, including from low-level hardware to high-level intelligence software and user interfaces, is required to build humanoid robot system meeting the expectation that robots work in the real environment such as disaster response. For creating such an integrated system, it is important that it has sustainable development potential, partially re-usability, and transparency to any type of robot. When creating a new robot, the conventional a system is desired to use just by changing a robot hardware. In order to realize such system, it is necessary to ensure that a software system is transparent to a robot hardware. On the other hand, sustainable development and partially reusability contribute robustness of the system and quickly building a complex system. In this paper, we describe the methodology to create an integrated humanoid robot system through actual humanoid robot system we have developed. Our system achieved to have sustainable development, partially re-usability, and transparency to any type of robot.

In this paper, we propose novel methods suitable for online real time whole body master-slave control with real life-sized humanoid robot. We conducted some dynamic whole body master-slave experiment with life-sized humanoid robot, and we achieved speedier and flexible master-slave operation compared to conventional study. Conventionally, master-slave operations with humanoid robots were available with only the upper body of the humanoid robot, and the COM movement was limited to be static. In our previous study, we introduced LIP model based restrictions to ensure the balance stability. In this study, we extend the safety restrictions by introducing foot landing delay prediction and trajectory smoothing method suitable for real robot. We conducted master-slave tennis swing experiment and high kick motion experiment with life-sized humanoid robot “JAXON”, and we evaluated the effectiveness of our proposed methods and system.

To enable robots to work on real home environments, they have to not only consider common knowledge in the global society, but also be aware of existing rules there. Since such “local rules” are not describable beforehand, robot agents must acquire them through their lives after deployment. To achieve this, we developed a framework that a) lets robots record long-term episodic memories in their deployed environments, b) autonomously builds probabilistic object localization map as structurization of logged data and c) make adapted task plans based on the map. We equipped our framework on PR2 and Fetch robots operating and recording episodic memory for 41 days with semantic common knowledge of the environment. We also conducted demonstrations in which a PR2 robot tidied up a room, showing that the robot agent can successfully plan and execute local-rule-aware home assistive tasks by using our proposed framework.

Comparing to IK (Inverse Kinematics) based motion control, joint-space motion control is more advantageous in terms of not being restricted by kinematics singularity problem. In this paper, we start with SIMBICON (Simple Biped Locomotion Control) based controller, a joint-space motion control method, extend it for enhancing walking's robustness and versatility. We propose a motion optimization method considering walking robustness, desired walking velocity and energy efficient minimization for walking motion generation. This method enables us to achieve human-like walking motion, which has stretched-knee posture and robust to large push disturbances. We also apply our proposed method to a life-sized biped robot and validate its effectiveness with push recovery and walking on unknown debris experiments.

Whole-body manipulation is necessary for a humanoid robot to achieve tasks such as carrying large objects. One difficulty for achieving a whole-body manipulation is that the robot needs to select the appropriate operation from a list of candidates, such as lifting, pushing, and tilting. The appropriate operation depends upon the target object's physical properties, including its mass, center of mass, and friction coefficient, which are difficult to measure directly. In order to select the appropriate manipulation motion online, we propose a method of estimating the object's physical properties and evaluating the feasibility of the object operation. We calculate the likelihood of the object's physical properties from sensor information during manipulation and update these properties' probabifity distribution periodically based on Bayesian methods. The operational feasibility probability is evaluated by physics-based stability determination, allowing the robot to perform manipulation tasks by selecting the appropriate operation. We show the effectiveness of the proposed method by an experiment in which a life-sized humanoid robot carries a large object.

In this study, we propose a novel method to operate whole body of a humanoid robot, which also includes both feet, dynamically and safely with the master-slave approach. The conventional whole body master-slave approaches need static balancing assumption or a certain time length of planning after operator's input. Then, we introduce a set of limitations that allows the robot to execute human's daily dynamic bipedal locomotion, but forbid dangerous motions like the COM will be gone outside of the support region. In the limitations, we regulate COM velocity based on a positional relation of the Divergent Component of Motion (Capture Point) and the both feet, and automatically modify the swing foot contact timing with judging the ZMP is inside or outside of the single foot support region. At last, we conducted some experiments of the real time master-slave locomotion with using two life-sized humanoid robots and confirmed the effectiveness of our novel limitation methods.

For humanoid robots, unexpected collision can cause instability of robot balancing and damage to both robots and environment. This paper presents a reactive bipedal walking controller against swing foot collision for humanoid robots. This controller is composed of following three components: 1) Swing Foot Trajectory Regenerator, 2) Swing Foot Collision Detector, and 3) Swing Foot Impact Mitigation Controller. By regenerating swing foot trajectory depending on situations, humanoid robots can avoid falling down. However, although humanoid robots detect collision and regenerate a swing foot, collision impact can cause bad effects such as damage and posture rotation. Therefore, to mitigate strong impact, we propose Swing Foot Impact Mitigation Controller, which is composed of two controllers. The proposed method is validated through the experiments by actual humanoid robot CHIDORI. We confirm that CHIDORI can avoid falling down against collision in two situations: walking on the flat ground, and stepping up a stair.

In this paper, we described a new developed life-size humanoid robot. A purpose of the developed robot is to realize continuous operation for a long time and to improve an action autonomously. we considered three aspects of robustness, mechanical robustness, functional robustness and robustness of an action. Mechanical robustness was confirmed by the experiment that the robot fell down without mechanical failures and continued to work after falling down by using hard points. Functional robustness was designed to use power cable and to wear a suit which can be changed by required functionality. Robustness of an action was achieved as a standing up action using “StateNet”, which realized autonomous error recovery. Finally, we present a methodology to develop a humanoid robot platform which can continue to work in the real world.

The human forearm is composed of two long, thin bones called the radius and the ulna, and rotates using two axle joints. We aimed to develop a forearm based on the body proportion, weight ratio, muscle arrangement, and joint performance of the human body in order to bring out its benefits. For this, we need to miniaturize the muscle modules. To approach this task, we arranged two muscle motors inside one muscle module, and used the space effectively by utilizing common parts. In addition, we enabled the muscle module to also be used as the bone structure. Moreover, we used miniature motors and developed a way to dissipate the motor heat to the bone structure. Through these approaches, we succeeded in developing a forearm with a radioulnar joint based on the body proportion, weight ratio, muscle arrangement, and joint performance of the human body, while keeping maintainability and reliability. Also, we performed some motions such as soldering, opening a book, turning a screw, and badminton swinging using the benefits of the radioulnar structure, which have not been discussed before, and verified that Kengoro can realize skillful motions using the radioulnar joint like a human.

This paper explains low-latency joint torque feedback control based on torque estimation on each joint for gear-driven humanoid robots with harmonic drives. Force control of gear-driven robots has an advantage in its fully variable stiffness in comparison with elastic robots. However, feedback latency makes gear-driven robots vulnerable to impact rising in several milliseconds. It would be resolved by low-latency torque feedback loop in a single joint, but torque sensors are too large for life-sized humanoid robots. We estimate joint torque from motor current and rotation observed in each joint, and give artificial elasticity to joints using compliance control and shock absorption control. Our controller performance is demonstrated by landing experiments.

Groping behavior based on contact sensors is necessary for manipulation in an unknown environment. For those situations, it is effective for a robot to accumulate contact information as an environment map, and to plan the motions for executing the safe trial motion. We first propose a method of updating the occupancy grid map of the manipulation region from the contact information by introducing the contact sensor model. Using this map, we propose a method of sampling-based motion planning that enables the execution of the safe trial motion based on the criteria of feasibility and safety. To verify the effectiveness, we show the experimentally obtained results, showing that a real robot plans and executes the manipulation with groping behavior in the occluded environment.

We propose a human mimetic foot structure for musculoskeletal humanoids. We designed the foot structure by inspiring from human foot abilities of the multi-bone connected structure for flexibility and the distributed force sensor system. The foot has multi-DOFs structure including toe DOF that is composed of fingers. The distributed force sensing system is composed of 12 an-axis force sensors. In order to demonstrate those effectiveness, we implement the foot into musculoskeletal humanoid Kengoro and conduct several experiments. As a result, we confirmed effectiveness of the foot from tiptoe motion and balancing behavior by utilizing the foot characteristics.

Humanoid robot has the potential to manipulate wide range of tools in daily life. Arms and legs of humanoid robot contribute this ability. Above all, manipulation tasks for vehicles which are the same size as a life-sized humanoid or larger size than it require the operational motion by both arms and legs of humanoid robot. In addition to the arms and legs cooperative motion control, it is also important for humanoid robot to stabilize self posture during driving vehicle. In this research, we focus on the arms-legs-integrated manipulation task for tricycle controlled by humanoid robot. We propose dual manipulators control law that is defined as active manipulator which works movable objects such as handle and crank, and passive manipulator which follows the movement of this objects. We discuss the self stabilizing strategy for humanoid robot by both active manipulating legs as well as manipulation strategy for objects. Furthermore, this paper contributes the strategy of recognition and planning for outside obstacle situations and configures the tricycle manipulation system. Applying this proposed system, we show the experimental result for tricycle manipulation by life-sized humanoid robot HRP2-JSK on obstacle-mixed situation.

In this paper, we develop a waterproof suit for humanoid robots and propose an underwater walking control method. Although very few life-sized humanoid robots are completely waterproof, we can easily make these humanoid robots watertight by putting a waterproof suit on them. In water, humanoid robots are influenced by the two forces due to the water: buoyancy and drag force. We take buoyancy into account when generating a walking pattern because the force is large and easy to estimate before walking. However, drag force is small and difficult to precisely predict and therefore, we treat the force as an unknown disturbance. In our method, we modify footsteps based on the Capture Point in order to deal with large disturbances. We verify the effectiveness of the proposed methods through an experiment in which a life-sized humanoid robot walks on a floor, stairs and debris in water.

In this paper we propose a novel method to utilize the skeletal structure not only for supporting force but for releasing heat by latent heat.

To achieve tasks in unknown environments with high reliability, highly accurate localization during task execution is necessary for humanoid robots. In this paper, we discuss a localization system which can be applied to a humanoid robot when executing tasks in the real world. During such tasks, humanoid robots typically do not possess a referential to a constant horizontal plane which can in turn be used as part of fast and cost efficient localization methods. We solve this problem by first computing an improved odometry estimate through fusing visual odometry, feedforward commands from gait generator and orientation from inertia sensors. This estimate is used to generate a 3D point cloud from the accumulation of successive laser scans and such point cloud is then properly sliced to create a constant height horizontal virtual scan. Finally, this slice is used as an observation base and fed to a 2D SLAM method. The fusion process uses a velocity error model to achieve greater accuracy, which parameters are measured on the real robot. We evaluate our localization system in a real world task execution experiment using the JAXON robot and show how our system can be used as a practical solution for humanoid robots localization during complex tasks execution processes.

For generating motions of robots, global search in configuration space is time consuming although it is sometimes indispensable (e.g. collision avoidance in complex environment). Our idea is to use global sampling algorithm not in the state space but in the task nullspace, which is the redundant degrees of freedom of the state space with respect to the task space. Because the task nullspace is smaller than the original search space (state space), fast global sampling is possible. For embedding this hidden task nullspace parameters, we propose a new deep-auto-encoder-based neural network structure. Our approach learns the map from task and task nullspace towards robot's state (Task-State Map, TSM). As the demonstration, the relationship between 28-dof joint angles (state) and the end-effector coordinates of all limbs (task) is learned, and egress postures and reaching postures are generated.

In this paper, we propose a real-time control method for skating motion of humanoid robots. There are three problems for skating motion: (1) keeping dynamic balance, (2) adequately controlling foot force to suppress slipping at the foot, (3) controlling full-body motion in real-time. For solving these problems, we propose the Skating Motion Generator and the Skating Motion Stabilizer. In the Skating Motion Generator, we separate the slip suppression from motion generation for (3). The separation enables us to generate skating motions in real-time. In the Skating Motion Stabilizer, we adjust the sole pressure distribution of each foot to solve the contradiction between (1) and (2). We show the effectiveness of the proposed controller through the experiments, in which life-sized humanoid HRP-2 pushes the ground and skates on the skateboard. Applying the proposed controller, HRP-2 could successfully accelerate and skate on the skateboard at 0.5[m/s].

Humanoid robot is able to execute various behavior to manipulate objects because of high degree-of-freedom around the whole-body. Although hands contact with objects and exert force in ordinary pushing motion by robot, pushing motion contacting with the object at various regions of whole-body has potential for extending the scope of feasible manipulation. We derive the fundamental formulas of humanoid robot in the situation that the external force is applied to the arbitrary region of whole-body, and then propose the method to generate and execute the pushing motion based on the formulas. The proposed method is generalized for enabling to select a contact point with an object from whole-body regions and control the pushing force applied to the sensorless region. In order to verify the effectiveness, we show the experimental result that a lifesized humanoid carries large and heavy objects by pushing with various regions of whole-body.

This paper presents a novel control method to stabilize the whole-body motion of humanoid robots when climbing vertical ladders and transitioning between ladders and catwalks. In such environments, the body of the robot tends to incline and rotate because of the slippery surfaces. The inclination and rotation may cause the robot to fail to grasp and thus collide with the rungs. The proposed method modifies the subsequent contact position in real time based on the error of the current robot posture estimated with inertial measurement units (IMUs) and actual joint angles. This paper also presents a method of generating motion by minimizing the contact wrench. This method satisfies hardware limitations, such as collision avoidance, joint torque limits, and joint limits. Applying these methods to a humanoid robot, we realize the robust climbing and descending of multiple rungs of a vertical ladder and bidirectional transitioning from ladders to catwalks.

The main goal of this paper is to design and evaluate a spine structure which withstands various motions. The structure around the neck has a prevailing importance since it is involved in various motions of the upper half of the body. The new design method we introduce essentially shows how to design all 7 cervical vertebrae (the part of spine in the neck) in a limited space, actuated by the wires winded around the motors. Then we show the muscle arrangements around the upper half of the spine. More specifically, we make use of a so called planar muscle mechanism. An abduction experiment which requires great force around the spine is made to show its stability. Finally, we show a variable stiffness system which enables the spine to resist an impulsive force. We have tested the system in the situation of whiplash injury which is a case of extreme external forces which can occur in car crash accidents. As such we have evaluated the strength of the design and the viability of our robot to act as a human body simulator.

Whole-body holding manipulation is effective for carrying the handleless large object. In order to keep the object stability, the dexterous transition motion is necessary. From geometric and physical conditions of object manipulation, we propose the general method of generating the transition graph, which represents the object pose and grasp contact. By searching the path on the graph, the transition motion is planned automatically with considering the object motion and contact switching simultaneously. By generating and modifying the whole-body holding motion, the planned object motion is achieved stably. We show the effectiveness of the proposed method by the experiments, in which robot lifts up a large object with whole-body contact by the planned transition motion.

For generating whole-body behavior involving contacts with environments such as climbing ladder behavior or walking on terrain behavior, “contact-before-motion” approach was used in some previous researches. By separating contact search process and motion search process, whole-body behavior generation was achieved. However, in previous researches, there were few examinations about contact transition strategies while generating behavior. For changing contact states, there are many kinds of contact transition strategies such as walking, sliding, rotating and so on. For example, while generating standing up behavior, it is important to switch contact transition strategies because the lack of degree of freedom makes it difficult to detach limb contacts from ground, and it may be desirable not to detach contacts but to slide them. In this study, we propose a novel whole-body behavior generation algorithm which involves contact transition strategies switching function. Especially, in this paper, we focus on the walk-type and slide-type transition strategies switching. We call walk-type transition as the contact transition process which detaches some contacts, moves them, and attaches them again. Besides, we call slide-type transition as the contact transition process which keeps on attaching contacts, and slides to move them. By using this algorithm, it is possible to generate whole-body behaviors which are difficult or impossible to achieve only with walk-type transition and which are more desirable by comparing multiple transition strategies. Finally, we evaluated this algorithm by generating standing up behavior and sitting on chair behavior.

Recent research in psychology argue the importance of “context” in emotion perception. According to these recent studies, facial expressions do not possess discrete emotional meanings; rather the meaning depends on the social situation of how and when the expressions are used. These research results imply that the emotion expressivity depends on the appropriate combination of context and expression, and not the distinctiveness of the expressions themselves. Therefore, it is inferable that relying on facial expressions may not be essential. Instead, when appropriate pairs of context and expression are applied, emotional internal states perhaps emerge. This paper first discusses how facial expressions of robots limit their head design, and can be hardware costly. Then, the paper proposes a way of expressing context-based emotions as an alternative to facial expressions. The paper introduces the mechanical structure for applying a specific non-facial contextual expression. The expression was originated from Japanese animation, and the mechanism was applied to a real desktop size humanoid robot. Finally, an experiment on whether the contextual expression is capable of linking humanoid motions and its emotional internal states was conducted under a sound-context condition. Although the results are limited in cultural aspects, this paper presents the possibilities of future robotic interface for emotion-expressive and interactive humanoid robots.

Object handover is a basic task in many human-robot interactive scenarios and therefore, it is important for assistive robots to be able to perform proper handovers. We previously designed a human-inspired grip-force-varying handover controller for a robot giver and showed on a Willow Garage PR2 robot that the controller yields human-like and human-preferred handovers. The PR2 robot had a non-compliant fully-actuated gripper. However, recently, compliant underactuated grippers have been gaining more popularity. Although compliant underactuated grippers can provide more flexibility in manipulation, it is generally difficult to accurately measure and control the amount of applied grip force. In this paper, we present an implementation of the human-inspired handover controller on a Kawada Industries HRP4R robot, which has compliant underactuated hands, using joint position error measurement for estimating the amount of applied grip force. Through an experiment, we show that we are able to achieve safe, smooth, and intuitive robot-human handovers despite the lack of accurate grip force control on our robot.

In case that a robot carries large and heavy objects with unknown physical parameters such as mass automatically, the autonomous decision and execution of the manipulation strategy are necessary. The method to decide the proper strategy from the various candidates depending on the object is a difficult problem and not researched widely. We consider the operation as the mapping from the physical parameter space to the object motion space. Based on the concept of mapping, we define the strategy proving operation (SPO) for determination of strategy feasibility. We introduce two examples of SPO and construct the system for deciding strategy from lifting, pushing, and pivoting. Executing the strategy in the situation that physical parameters are not known is also necessary. We construct the generator and controller for the full-body manipulation, which can be employed regardless of strategy. The controller enables the robot to exert adequate force while keeping balance. We clarify the applicable scope of the proposed method and show that a life-sized humanoid decides the strategy and carries various large and heavy objects autonomously through the experiment.

For humanoid robots to perform whole-body motions, a motion planner should generate feasible motions satisfying various constraints including joint torque limitation, friction, balancing, collision, and so on. Furthermore, for life-size humanoid robots to perform higher-load motions, such as climbing ladders, safely, it is important to generate motions which requirements are not too close to the limitations. In this paper, we propose a humanoid motion planner based on Body Retention Load Vector (BRLV), which is a novel index for representing severity of physical constraints: limitation of joint Torque, contact Force, and contact Moment (TFM limitations). By minimizing the norm of BRLV, we obtain humanoid motions that are farthest from TFM limitations. Finally, we evaluate the proposed motion planner in simulation and confirm the effectiveness of the planner through experiments in which a life-size humanoid robot climbs a ladder and a car.

We present a method for enabling robots to determine appropriate grasp configurations for handovers - i.e., where to grasp, and how to orient an object when handing it over. In our method, a robot first builds a knowledge base by observing demonstrations of how certain objects are used and their proper handover grasp configurations. Objects in the knowledge base are then organized based on their movements and inter-object interaction features. The key point in this process is that similarity in affordances should be recognized. When subsequently asked to handover an object, the robot then computes an appropriate grasp configuration based on the object's recognized affordances. Experimental results show that our method was able to differentiate and group together objects according to their affordances. Furthermore, when given a new object, our method was able to generalize data in the knowledge base and determine an appropriate grasp configuration.

Pushing heavy and large objects in a plane requires generating correct operational forces that compensate for unpredictable ground-object friction forces. This is a challenge because the reaction forces from the heavy object can easily cause a humanoid robot to slip at its feet or lose balance and fall down. Although previous research has addressed humanoid robot balancing problems to prevent falling down while pushing an object, there has been little discussion about the problem of avoiding slipping due to the reaction forces from the object. We extend a full-body balancing controller by simultaneously controlling the reaction forces of both hands using dual-arm force control. The main contribution of this paper is a method to calculate dual-arm reference forces considering the moments around the vertical axis of the humanoid robot and objects. This method involves estimating friction forces based on force measurements and controlling reaction forces to follow the reference forces. We show experimental results on the HRP-2 humanoid robot pushing a 90[kg] wheelchair.

Humanoid robots working in a household environment need 3D geometric shape models of objects for recognizing and managing them properly. In this paper, we make humanoid robots creating models by themselves with dual-arm re-grasping (Fig.1). When robots create models by themselves, they should know how and where they can grasp objects, how their hands occlude object surfaces, and when they have seen every surface on an object. In addition, to execute efficient observation with less failure, it is important to reduce the number of re-grasping. Of course when the shape of objects is unknown, it is difficult to get a sequence of grasp positions which fulfills these conditions. This determination problem of a sequence of grasp positions can be expressed through a graph search problem. To solve this graph, we propose a heuristic method for selecting the next grasp position. This proposed method can be used for creating object models when 3D shape information is updated on-line. To evaluate it, we compare the result of the re-grasping sequence from this method with the optimal sequence coming out of breadth first search which use 3D shape information. Also, we propose an observation system with dual-arm re-grasping considering the points when humanoid robots execute observation in the real world. Finally, we show the experiment results of construction of 3D shape models in the real world using the heuristic method and the observation system.

Manipulation of structured objects connected to the environment by a kinematics chain involves two problems: (a) The objects have movable directions and unmovable directions. An undesired reaction force in the unmovable directions prevents a robot from successful manipulation; (b) The reaction forces from the objects could fluctuate during manipulation. Related works have enabled robots to manipulate objects by integrating position control in movable directions and force control in unmovable directions at the hands. However, in the case of a humanoid robot, too large undesired reaction forces in movable directions cause the robot's falling down and slipping. In this paper, we propose a controller system controlling reaction forces at the hands and successively updating reference forces based on reaction forces. For problem (a), we apply force control both to the movable and unmovable directions in order to satisfy both maintaining full-body balance and achieving manipulation. For problem (b), the update of the reference forces enables the humanoid robot to adapt to fluctuation of the reaction forces. We show experimental results on the cmanipulating four doors and a drawer.

A humanoid robot working in a household environment with people needs to localize and continuously update the locations of obstacles and manipulable objects. Achieving such system, requires strong perception method to efficiently update the frequently changing environment. We propose a method for mapping a household environment using multiple stereo and depth cameras located on the humanoid head and the environment. The method relies on colored 3D point cloud data computed from the sensors. We achieve robot localization by matching the point clouds from the robot sensor data directly with the environment sensor data. Object detection is performed using Iterative Closest Point (ICP) with a database of known point cloud models. In order to guarantee accurate object detection results, objects are only detected within the robot sensor data. Furthermore, we utilize the environment sensor data to map out of the obstacles as bounding convex hulls. We show experimental results creating a household environment map with known object labels and estimate the robot position in this map.

We propose a strategy for a robot to operate in an environment with movable obstacles using only onboard sensors, with no previous knowledge of the objects in that environment. Movable obstacles are detected using active sensing and a color range sensor, and when an obstacle is moved, the perception of the environment is reconstructed. Active sensing is defined as the classification of an object as either movable or static after the robot tries to push the object using its arm. This classification is collectively based on force sensor inputs, joint angles, and color range sensor inputs. In order to gather information from the environment, we use a color range sensor consisting of a TOF (Time of Flight) range sensor and conventional stereo cameras. Finally, we show experimental result in the environment with movable obstacles such as a table and chairs. Humanoid robot HRP-2 detects that a chair is a movable obstacle, moves the chair to clear a path to its goal, and then reaches the goal.

In this paper we propose a new method to manipulate heavy objects for a humanoid robot. In this method the manipulation strategy is determined based on on-line estimation of the operational force. We integrate these functions with a real-time controller that controls the external force and maintains full-body balance. The feature point of our work is that since a full-body control system includes switching of the manipulation strategy based on the operational force estimated on-line the system enables a humanoid robot to manipulate heavy objects as well as light objects. The effectiveness of our whole system is confirmed in our experiments, in which a humanoid robot manipulates up to 12[kg] while estimating the object's weight.

In this paper, a second generation remote-brained humanoid robot is presented which is developed for research on whole body action. Humanoid robots are important as a platform for the integration of techniques and algorithms acquired from research on manipulators, legged robots and so on. And they have new problems such as how to acquire, memorize, select and carry out various motions which use their whole bodies efficiently. In order to do research on these problems, a good robot body, which has whole body and enough performance for walking and getting up when it falls down is necessary. At the same time, a powerful brain is necessary which can be evolved through the body. As a solution to these demands, remote-brained approach was proposed and several humanoid robots was developed. Using these robots, several researches were done. For example, a brain framework called BeNet, an action acquisition using GA and NN and so on. They were done using a simple wireless connection. Interface between robot brain and its body to concentrate on a high-level problem. However this interface limited actions the robot can do simultaneously. In this paper, this old interface is taken to the next step. New interface has multiple actuator control methods which are switched on demand, and an onbody microprocessor network which controls actuators, measures sensors and interacts with a brain. Finally a new humanoid robot is developed on this interface.