The commoditization of virtual and augmented reality devices and the availability of inexpensive consumer depth cameras have catalyzed a resurgence of interest in spatiotemporal performance capture. Recent systems like Fusion4D and Holoportation address several crucial problems in the real-time fusion of multiview depth maps into volumetric and deformable representations. Nonetheless, stitching multiview video textures onto dynamic meshes remains challenging due to imprecise geometries, occlusion seams, and critical time constraints. In this paper, we present a practical solution towards real-time seamless texture montage for dynamic multiview reconstruction. We build on the ideas of dilated depth discontinuities and majority voting from Holoportation to reduce ghosting effects when blending textures. In contrast to their approach, we determine the appropriate blend of textures per vertex using view-dependent rendering techniques, so as to avert fuzziness caused by the ubiquitous normal-weighted blending. By leveraging geodesics-guided diffusion and temporal texture fields, our algorithm mitigates spatial occlusion seams while preserving temporal consistency. Experiments demonstrate significant enhancement in rendering quality, especially in detailed regions such as faces. We envision a wide range of applications for Montage4D, including immersive telepresence for business, training, and live entertainment.

We present an end-to-end system for augmented and virtual reality telepresence, called Holoportation. Our system demonstrates high-quality, real-time 3D reconstructions of an entire space, including people, furniture and objects, using a set of new depth cameras. These 3D models can also be transmitted in real-time to remote users. This allows users wearing virtual or augmented reality displays to see, hear and interact with remote participants in 3D, almost as if they were present in the same physical space. From an audio-visual perspective, communicating and interacting with remote users edges closer to face-to-face communication. This paper describes the Holoportation technical system in full, its key interactive capabilities, the application scenarios it enables, and an initial qualitative study of using this new communication medium.

Our society is in a state of transformation toward a "virtual society." However, due to the nature of anonymity and less observability, Internet activities have become more diverse and obscure. As a result, unscrupulous individuals or criminals may exploit the Internet as a channel for their illegal activities to avoid the apprehension by law enforcement officials. This paper examined a "Pirated-CD Forum" in Taiwan. We studied the characteristics and conducted a hot thread analysis based on forum statistical data. We also developed two content search schemes for retrieving postings containing inappropriate information items in the forum. The experiment results show that hot threads are correlated to inappropriate postings, but the retrieval effectiveness can be significantly improved by search schemes based on content analysis.

We describe the implementation of one channel of an optoelectronic orientation enhancement algorithm based on a neurally inspired algorithm. An 8/spl times/8 VCSEL (Vertical Cavity Surface Emitting Laser) array, hybridized to CMOS driver circuits, transmits a contrast-enhanced image that would be computed in the early stages of visual processing. A diffractive optical element (DOE) generates a projective field which reinforces pixels of a preferred orientation. A CMOS receiver integrates correlated pulses to produce high output in frequently activated areas. Data from a one channel system shows orientation enhancement.