Human-assistive systems, such as robots, need to correctly understand the surrounding situation based on obser-vations and output the required support actions for humans. Language is one of the important channels to communicate with humans, and robots are required to have the ability to express their understanding and action-planning results. In this study, we propose a new task of operative action captioning that estimates and verbalizes the actions to be taken by the system in a human-assisting domain. We constructed a system that outputs a verbal description of a possible operative action that changes the current state to the given target state. We collected a dataset consisting of two images as observations, which express the current state and the state changed by actions and a caption that describes the actions that change the current state to the target state, by crowdsourcing in daily life situations. Then we constructed a system that estimates an operative action by a caption. Since the operative action's caption is expected to contain some state-changing actions, we use scene graph prediction as an auxiliary task because the events written in the scene graphs correspond to the state changes. Experimental results showed that our system successfully described the operative actions that should be conducted between the current and target states. The auxiliary tasks that predict the scene graphs improved the quality of the estimation results.

Recently, ubiquitous vital signs sensing using wireless medical sensors has become essential, not only for inhospital diagnosis but for healthcare at home. In this work, the most advanced electrocardiography (ECG) sensor is proposed. This sensor system makes it possible to eliminate the use of both batteries and self-adhesive electrodes by introducing energy harvesting technology and newly developed unwoven fabric electrodes, respectively. By realizing smaller and thinner implementation and easy handling, the complete sensors may be easily mounted on underwear and allow long term wearable usage for vital signs monitoring. The sensor has the capability of transmitting ECG data to a cloud-based data processing server set up in the Internet via a smartphone or other ubiquitous tools. This paper describes the configuration of the ECG sensor, which adopts cutting edge technologies, and also the constitution of the acquired ECG data transmitting and processing systems.