We propose a novel dynamic display approach using a handheld projector embedded with an ability to be aware of obstructing objects, called clutters. One camera is fixed on a projector to retrieve surface information. By integrating multiple target tracking knowledge using particle filters and gabor filters, the appearance and disappearance of unknown clutters are monitored. As a result, the unknown number of clutters can be tracked efficiently, while spurious objects are filtered out. No computation effort for tracking will be expended unless those clutters are persistently detected. At every time step, the projection target area adapts itself to suit with current situations of clutters and a projector. The biggest undistorted target area is placed on the clutter-free area adaptively with respect to the previous locations. The simulation results revealed that the system is effective for creating clutter-aware dynamic projection when a projector and clutters are moving in an unpredictable manner.

This paper presents a framework for a computationally adaptive projection metaphor using a handheld projector inside a dynamic cluttered environment. In addition to conventional self-correcting projection features, the framework uses multiple clutter tracking and adaptive target generation to define the clutter-aware target area for projection in a reliable manner. Using a paired projector-camera system, the framework first builds high spatial frequency feature maps using a Laplacian pyramid approach. The feature maps are then passed to a rejection step to eliminate spurious features caused by contents of the projected image. After the resulting features representing clutters are processed by the appropriated design tracker, the target area for projection is generated. Finally, the desired information for projection is rendered and sent back to the projector. The framework can be used effectively for a clutter-aware handheld projector-based system without the need for a complex hardware setup or with any prior need to clean up the environment.