This paper introduces a system that can recognize different type of paper-folding by users. The system allows users to register and use their desired paper in the interaction, and detect the folding by using Speed Up Robust Feature (SURF) algorithm. The paper also describes a paper-based tower defense game which has been developed as a proof of concept of our method. This method can be considered as the initial step for seamlessly migrating meaningful traditional art of origami into the digital world as a part of the interactive media.

In this demonstration we introduce a system that allows users to register and use their desired paper for the interaction, and recognize the folding during the interaction in real time. This method can be considered as an initial step for seamlessly migrating meaningful traditional art of origami into the digital world and as part of the interactive media.

Fiducial markers are artificial landmarks added to a scene to facilitate locating point correspondences between images, or between images and a known model. Reliable fiducials solve the interest point detection and matching problems when adding markers is convenient. The proper design of fiducials and the associated computer vision algorithms to detect them can enable accurate pose detection for applications ranging from augmented reality, input devices for HCI, to robot navigation. Marker systems typically have two stages, hypothesis generation from unique image features and verification/identification. A set of criteria for high robustness and practical use are identified and then optimized to produce the ARTag fiducial marker system. An edge-based method robust to lighting and partial occlusion is used for the hypothesis stage, and a reliable digital coding system is used for the identification and verification stage. Using these design criteria large gains in performance are achieved by ARTag over conventional ad hoc designs.

Webtag is a marker based system where every marker contains an internationally unique identifier which links to 2D or 3D content from a user's Website. A two stage design combines the basic 10-bit ID (tier-1 ID) of the current ARTag system which is used for pose tracking when the marker is far away, and a smaller and dense array of extra bits allow an additional 32 bits (tier-2 ID) to be recognized when the camera is close. A user brings his/her AR device close to the marker such that the tier-2 ID is read, and then the IDs are mapped to a web address from which the augmenting model, image, or animation is loaded. Thereafter the content is rendered relative to the tier-1 ID which can be seen at greater distances. This allows a user anywhere on internet to access augmented content printed in magazines, seen on posters, etc. Webtag is a prototype system that may allow large scale acceptance of AR by the public.

A magic mirror paradigm is an augmented reality (AR) system where a camera and display device act as a mirror where one can see a reflection of oneself and virtual objects together. Fiducial markers mounted on a number of hand held and wearable objects allow them to be recognized by computer vision, different virtual objects can be rendered relative to the objects depending on the chosen theme. The experience can be enjoyed by many onlookers without special equipment, unlike other AR experiences such as with HMD's or tablet PC's. A series of theoretical and practical problems were overcome to produce a working system suitable for educational and entertainment for the public

Fiducial marker systems consist of patterns that are mounted in the environment and automatically detected in digital camera images using an accompanying detection algorithm. They are useful for augmented reality (AR), robot navigation, and general applications where the relative pose between a camera and object is required. Important parameters for such marker systems is their false detection rate (false positive rate), their inter-marker confusion rate, minimal detection size (in pixels) and immunity to lighting variation. ARTag is a marker system that uses digital coding theory to get a very low false positive and inter-marker confusion rate with a small required marker size, employing an edge linking method to give robust lighting variation immunity. ARTag markers are bi-tonal planar patterns containing a unique ID number encoded with robust digital techniques of checksums and forward error correction (FEC). This proposed new system, ARTag has very low and numerically quantifiable error rates, does not require a grey scale threshold as does other marker systems, and can encode up to 2002 different unique ID's with no need to store patterns. Experimental results are shown validating this system.

Telepresence and teleoperation are immersive viewing and control by a user from a remote location. Usual implementations use a standard narrow field of view (FOV) camera and a communications link, and a head mounted display (HMD). Teleoperating a robotic vehicle or surveying a scene with such system and a computer monitor is difficult for human operators due to the narrow FOV of standard cameras, the unintuitive interface for directing the camera, and the loss of directional sense. For this reason these systems often use a head mounted display (HMD) instead of a monitor, however this introduces the HMD pose latency problem of latency and slow update due to the mechanical motion of the camera and the communications link. Even with good equipment, the experience is disorienting and slow. This paper proposes a pano-presence architecture for telepresence for applications such as teleoperation based on panoramic cameras, a communications link, and an HMD. The panoramic camera, capable of capturing light from all azimuth directions, provides a panorama which is be transported over the communications link to a panorama frame buffer for viewing in the HMD screen(s). The panorama viewing rate is decoupled from the communications latency so the user can look around freely without experiencing HMD pose latency problem, the delay in the HMD's image alignment with the head position. A panorama frame format of an image cube is chosen since it can be viewed at full frame rate with the acceleration in consumer graphics cards. Two prototype systems, one telepresence and one teleoperation, using this architecture are described.

A hand-held object whose pose can be determined automatically is useful for augmented reality (AR) and other applications needing human-computer interaction. Some existing such input devices use active (ex. LED lighting) or passive markers to be recognized in a video image by computer vision. Markers are typically mounted onto flat objects which are not ergonomic, or can only have limited number of sides due to the small library and inter-marker confusion rate of the marker system used. A system is presented based on the ARTag fiducial marker system where objects of arbitrary shape can be covered with many small markers, the pose of the object is recovered automatically and can be used as an input device. Other tangible user interface systems require specialized hardware, whereas this approach needs only a printer, a video camera or Webcam, and a large garden vegetable. The utility of this system both for measuring pose and for 3D modeling is shown.

Omni-directional sensors are useful in obtaining a 360/spl deg/ field of view with a single lens camera. This work describes how sensors can be designed for obtaining stereo. Alternative approaches are presented and evaluated. A technique for calibrating panoramic stereo cameras using colour coding is described. As well, real-time video hardware has been designed and built to support panoramic stereo display.

In underwater environments it is often difficult to obtain a big/clear picture of a scene. For that reason, a system that can integrate small pieces of images (taken from close range) into a composite 3D surface, is developed here. The device, along with 3D position/orientation estimation equipment, can be used for inspection of hulls of ships anchored in a bay, or for examination of underwater pipes and tanks. Experimental results are presented which validate the algorithms developed.