In this paper, we propose a new approach of Augmented Reality (AR) system for the furniture layout based on a planar object tracking. The planar object tracking methods using natural features are effective methods to estimate the object's pose and position in the AR applications because we are able to use the natural images. However, most of the feature descriptors have a lot of matching procedure. Therefore, by using an efficient feature point descriptor which is very fast both to build and to match, we track the planar objects. Especially, we use floor plans as the planar objects, and then furniture CG models are overlaid on the floor plans. This is because the floor plans are presented in the selection of rooms for rent or buy. Therefore, this system helps borrowers and buyers to select some mansion or apartment rooms. In this system, we propose to use human whistle sounds and color rectangles recognition to operate the furniture layout. In order to show the effectiveness of our proposed system, we perform some planar object tracking experiments when we applied the proposed system to some floor plans.

In this paper, we propose a model-based alignment system using real-coded genetic algorithm (RGA) for mixed reality (MR) or augmented reality (AR). MR/AR is a technique for superimposing useful virtual information on the real world to provide users more effective views. To realize the MR/AR, the alignment between real space and virtual space is a serious problem. In particular, an initial frame alignment for real-time tracking is needed in the previous knowledge based MR/AR. Therefore, we propose an initial frame alignment method using RGA. In this paper, we use the multiple RGA generation alternation models, crossovers, and mutations to design an optimum GA for the alignment system. This paper shows the expanding version of the pre-proposed method by our system. In order to show the effectiveness of proposed method, we perform some matching simulations when we applied to the real space.

We have developed a multi-projector display environment called the projector array system. Tiled images are projected onto a large screen from the multiple projectors, and these images are connected seamlessly by an image transforming mechanism. This mechanism is executed in real-time by a special hardware called the PA board that modifies geometrical errors caused from each projector. In this paper, we apply this environment to a live image display system. In order to capture wide view-angle and high resolution images, we use a multi-camera system that has the same alignment as the multi-projector system. When we configure the total system, a method for modifying geometrical errors caused by the camera system, and another method for modifying errors caused from a parameter mismatch between the camera and the projector are required. In this system, therefore, we implement these methods so that three errors caused from: (1) projection environment; (2) camera system; and (3) parameter's mismatch are modified altogether by the PA board at the same time. A prototype experiment enables a naturalistic image display.

No abstract available.

Seamless and high resolution images that copy a room is expected to be used for many applications (e.g. a guard system, amusement, remote control, and so forth). We are developing a mobile robot system for obtaining such images automatically. This system utilizes single kind of line marker, which is adhesive tape and is attached horizontally by a user beforehand. A mobile robot goes round a room and builds map. The map is used to collect images of above part of each marker. It means that the mobile robot does not need to know prior information of the room. Therefor, the underlying problems in this paper are localization and exploration by a mobile robot without prior information of the environment.

Abstract This paper describes a practical method that enables actual images to be converted so that they can be projected onto an immersive projection display (IPD) screen. IPD screens are particularly unique in that their angle of view is extremely wide; therefore, the images projected onto them need to be taken on a special format. In practice, however, it is generally very difficult to shoot images that completely satisfy the specifications of the targeting IPD environment due to cost, technical problems or other reasons. To overcome these problems, we developed a method to modify the images by abandoning geometrical consistency. We were able to utilize this method by assuming that the given image was shot according to a special projection model. Because this model differed from the actual projection model with which the image was taken, we termed it the pseudo‐projection model. Since our method uses simple geometry, and can easily be expressed by a parametric function, the degree of modification or the time sequence for modification can readily be adjusted according to the features of each type of content. Copyright © 2003 John Wiley & Sons, Ltd.

We have developed an immersive projection system which enables the viewer to experience a truly immersive feeling by looking at a wide-angle image on multiple surrounding screens. Our system is similar to previous systems but has a unique point in that it includes a new motion-based ride system as part of the environment. This ride system includes a seat that can be moved and rotated to give a rider (viewer) a sense of acceleration. We have used this environment to develop an application in which the viewer can experience a sensation of moving around in a virtual world while riding a virtually moving machine, such as a virtual vehicle.

We present a closed-form solution for the rotation-estimation problem, by introducing the same algorithm used for solving the perspective three-point problem. The rotation-estimation problem is defined as estimating the relative rotation of two camera images when the translation is known. The perspective three-point problem, in which the pose of a single camera is estimated from the location of three points, is a classical problem in the field of computer vision, and a closed-form solution for it has already been established. The two problems are not obviously similar, but we show by making some parameter exchanges that they are essentially equivalent. Actual applications using the rotation-estimation problem are also explained.

We introduce a new environment to make and play interactive contents with more than video game quality. The system consists of a projector array, a viewer and an editor for the special contents. The projector array projects multiple digital images seamlessly both in time and space, thus a very high quality video projection system. The viewer features a function to composite a passive video and interactive CG in real time. The editor is a high-end non-linear editing system combined with some new plug-in software to pre-compute the information necessary for real-time compositing. A new method of digital image recognition assisted by human operators is used. Unlike general purpose computer vision algorithms, it minimizes the error of 3D estimation at the compositing position. We call this approach V2R or the video-based virtual reality. It allows the operator to experience interactive communications with objects in a very high quality video.

We propose a method to estimate camera parameters from video sequences for the purpose of natural CG composite remarking the problem of stabilization. When the video is taken under wrong condition, it is inescapable that the estimated parameters contain nonnegligible errors which cause an unexpected shaking of CG object. To avoid this problem, we introduce a smoothing technique taking account of a property of synthesizing object. The method is based on an idea that the estimated camera parameters need not to be correct so far as composite is natural, and can be varied according to the condition of CG object even though the given images are same. Introducing the factor of locational and temporal smoothness to estimate the camera parameters, we can accomplish an appropriate stabilization for particular CG composite.