Journal Article Evaluation of a Mobile Projector-Based Indoor Navigation Interface Get access Ming Li, Ming Li * 1Computer Graphics Group, RWTH Aachen University, Aachen, Germany *Corresponding author: [email protected] Search for other works by this author on: Oxford Academic Google Scholar Katrin Arning, Katrin Arning 2Human Computer Interaction Center, RWTH Aachen University, Aachen, Germany Search for other works by this author on: Oxford Academic Google Scholar Oliver Sack, Oliver Sack 2Human Computer Interaction Center, RWTH Aachen University, Aachen, Germany Search for other works by this author on: Oxford Academic Google Scholar Jiyoung Park, Jiyoung Park 3Ewha Womans University, Seoul, Korea Search for other works by this author on: Oxford Academic Google Scholar Myoung-Hee Kim, Myoung-Hee Kim 3Ewha Womans University, Seoul, Korea Search for other works by this author on: Oxford Academic Google Scholar Martina Ziefle, Martina Ziefle 2Human Computer Interaction Center, RWTH Aachen University, Aachen, Germany Search for other works by this author on: Oxford Academic Google Scholar Leif Kobbelt Leif Kobbelt 1Computer Graphics Group, RWTH Aachen University, Aachen, Germany Search for other works by this author on: Oxford Academic Google Scholar Interacting with Computers, Volume 26, Issue 6, November 2014, Pages 595–613, https://doi.org/10.1093/iwc/iwt053 Published: 06 November 2013 Article history Received: 12 January 2013 Revision received: 09 September 2013 Accepted: 16 September 2013 Published: 06 November 2013

We present a novel low-cost method for visual communication and telepresence in a CAVE -like environment, relying on 2D stereo-based video avatars. The system combines a selection of proven efficient algorithms and approximations in a unique way, resulting in a convincing stereoscopic real-time representation of a remote user acquired in a spatially immersive display. The system was designed to extend existing projection systems with acquisition capabilities requiring minimal hardware modifications and cost. The system uses infrared-based image segmentation to enable concurrent acquisition and projection in an immersive environment without a static background. The system consists of two color cameras and two additional b/w cameras used for segmentation in the near-IR spectrum. There is no need for special optics as the mask and color image are merged using image-warping based on a depth estimation. The resulting stereo image stream is compressed, streamed across a network, and displayed as a frame-sequential stereo texture on a billboard in the remote virtual environment.