This work presents the development of a real-time framework for the research of multimodal feedback of robots/talking agents in the context of Human Robot Interaction (HRI) and Human Computer Interaction (HCI). For evaluating the framework, a Multimodal corpus is built (ENTERFACE_STEAD), and a study on the important multimodal features was done for building an active Robot/Agent listener of a storytelling experience with Humans. The experiments show that even when building the same reactive behavior models for Robot and Talking Agents, the interpretation and the realization of the behavior communicated is different due to the different communicative channels Robots/Agents offer be it physical but less human-like in Robots, and virtual but more expressive and human-like in Talking agents.

This paper presents key points of a human machine interface (HMI) for disabled people suffering from tetraplegia. It proposes an original HMI based on a monocular camera that controls an exoskeletal orthosis for the upper limb. The aim of this paper is to identify innovative research paths in intelligent camera interface (ICI). It shows how far can a camera be used as a control interface and its application to a 4 axis exoskeletal orthosis. Two methods are presented: head control using planar face detection and 3D face modelling and mouth expression control. The preliminary results show that the intelligent camera interface can be an effective issue in human machine interaction especially for disabled people since commonly used HMI are difficult to use, unreliable or tiring.

The goal of this project is to develop an upper limb exoskeletal orthosis destinated to help disabled population to achieve arm movements. This orthosis is principally designed for people suffering from myopathy and muscle degeneration. Such patients cannot generate enough force to move alone their arm. This poster presents a new approach to control the exoskeleton using pressure sensors.