Projection mapping with inexpensive hardware often suffers from calibration errors that lead to visually compromised results. In this paper, we classify common errors that lead to typical visual artifacts. Based on this classification, we present the first content-aware brightness solver. It is tailored for high GPU performance, yet efficiently hides the most common calibration artifacts. Moreover, it is specifically designed to handle both single and larger networked projection mapping setups with minimal latency.

We present a pop-up projection painting system that projects onto an unknown three-dimensional surface, while the user creates the projection content on the fly. The digital paint is projected immediately and follows the object if it is moved. If unexplored surface areas are thereby exposed, an automated trigger system issues new depth recordings that expand and refine the surface estimate. By intertwining scanning and projection painting we scan the exposed surface at the appropriate time and only if needed. Like image-based rendering, multiple automatically recorded depth maps are fused in screen space to synthesize novel views of the object, making projection poses independent from the scan positions. Since the user’s digital paint is also stored in images, we eliminate the need to reconstruct and parametrize a single full mesh, which makes geometry and color updates simple and fast.