This paper presents a method of interactively generating natural hand gesture animation using reduced dimensionality from multiple captured data sequences of finger motions conducting specific tasks. This method is achieved by introducing an estimation with multiple regression analysis. Even when the skeletal structure of the user who inputs the motion is different from that of the shape model in the computer, the motion that a user imagines is generated. Experimental results obtained from the interface applied to virtual object manipulation showed that the proposed method generates animation naturally, just as users would expect. This method enables us to make input devices that require minimal user training and computer calibration, and helps to make the user interface intuitive and easy to use.

A technique is proposed for object manipulation with a virtual tool using multiple exact interactions. Exact test is introduced that uses real-time collision detection for both hand-and-tool and tool-and-object interactions. Chopsticks are adopted for one of the trials of our technique; although they have a very simple shape, they do have multiple functions. Here, a virtual object is manipulated by the virtual chopsticks, which are used by the motion of a user's hand captured by a hand gesture input device. Exact interaction is applied between the hand and chopsticks based on correct table manners. Experimental results demonstrate the effectiveness of the proposed multiple exact interactions, especially for precise object alignment tasks.