This paper proposes an intuitive wireless sensor/actuator based communication network for human animal interaction for a digital zoo. In order to enhance effective observation and control over wild life, we have built a wireless sensor network. 25 video transmitting nodes are installed for animal behavior observation and experimental vibrotactile collars have been designed for effective control in an animal park.

In this paper we propose three tire based protocol for augmented reality application on mobile phones for animal situation awareness and tracking system in a wireless sensor network. We have developed and deployed an animal tracking system in a local zoo that can provide visitors information about individual animals. Here we present our ongoing work on an augmented information system that can provide online real-time animal information such as the current location, and feature of specific breed.

We have developed a head gesture controlled electric wheelchair system to aid persons with severe disabilities. Realtime range information obtained from a stereo camera is used to locate and segment the face images of the user from the sensed video. We use an Isomap based nonlinear manifold learning map of facial textures for head pose estimation. Our system is a non-contact vision system, making it much more convenient to use. The user is only required to gesture his/her head to command the wheelchair. To overcome problems with a non responding system, it is necessary to notify the user of the exact system state while the system is in use. In this paper, we explore the use of vibrotactile rendering of head gestures as feedback. Three different feedback systems are developed and tested, audio stimuli, vibrotactile stimuli and audio plus vibrotactile stimuli. We have performed user tests to study the usability of these three display methods. The usability studies show that the method using both audio plus vibrotactile response outperforms the other methods (i.e. audio stimuli, vibrotactile stimuli response).

Vibration offers many potential benefits for the use of mobile phones. In this paper, we propose a new method of rendering live football game on mobile phones using vibration. A mobile phone is “synchronized” with the ball in the real field. By holding the phone, users are able to experience dynamic movements of the ball, to know attacking directions and which team is leading the attack. The usability test of our system shows that vibrotactile display is suitable for rendering live football information on mobile phones by adopting designed coding schemes with a right training process.

To enhance their social interactive ability, we study how to provide the sight-impaired with reliable, "on-line" emotion information. The technical challenge we address here is how to render rich facial expressions in an intuitive way. We demonstrate that manifold of facial expressions is a compact and natural way to characterize human emotions. To compute manifold of facial expressions the standard locally linear embedding (LLE) algorithm is extended to handle the problem of real-time coding of new videos. Experimental results show that using manifold of facial expressions for vibrotactile rendering is very encouraging.