We present a real-time 3D camera based on IR (infrared) structured light suitable for robots working in home environment. First, we implemented a HOC (hierarchical orthogonal coding) based FPGA board. The HOC gives robust depth images because the signal separation coding provides not only the separation of overlapped codes, but also a robust decision on pixel correspondence with error correction. The FPGA module can handle high computational cost of HOC based signal separation coding. Second, we implemented a compact optic system of the camera to project and receive IR structured light. The invisible IR pattern light provides users inconvenient in the home environment. Various objects and workspaces which has continuous and/or non-continuous surface are tested and, sensitivity to illumination change and processing time are analyzed. The experiment results show the robust performance for surface smoothness, color, and materials of objects used in home environment. The proposed approach opens a greater feasibility of applying structured light based depth imaging to a 3D modeling of cluttered workspace for home service robots

There has shown a significant interest in a high performance of, at the same time, a compact size and low cost of, 3D sensor, in reflection of a growing need of 3D environmental sensing for service robotics. One of the important requirements associated with such a 3D sensor is that sensing does not irritate or disturb human in any way while working in close and continuous contact with human. Furthermore, such a 3D sensor should be reliable and robust to the change of environmental illumination as service robots are required to work day and night. This paper presents a 3D IR camera with variable structured light that is human friendly and robust enough for application to home service robots. Infrared is chosen as the sensing medium in order to meet the requirement of human friendliness and robustness to illumination change. A Digital Mirror Device (DMD) is employed to generate and project variable patterns at a high speed for real-time operation. In implementation, we emphasize the integration of modular components to support real-time sensing and compactness in size. A number of real-world experimentations are conducted, including a human face, a statue, and a plastic model. The experimental results have demonstrated that the implemented 3D IR Camera is robust to illumination change, in addition to its advantage of human friendliness.

This paper presents an original approach to coding the light patterns for robust depth imaging based on structured light. We have discovered that the degradation of precision and robustness, seen in most conventional approaches to structured light, comes mainly from the overlapping of multiple codes in the signal received at a camera pixel, where the overlapped codes are from the neighbouring and/or, even, distant pixels of the projecting mirror array. Considering the criticality of separating the overlapped codes to precision and robustness, we propose a novel signal separation code, referred to here as “Hierarchical Orthogonal Code (HOC),” for depth imaging. HOC provides not only the separation of overlapped codes, but also a robust decision on pixel correspondence with error correction based on a contextual likelihood among the sets of separated codes from neighbouring camera pixels. The experimental results have shown that the proposed HOC significantly enhances the robustness and precision in depth imaging, compared to the best known conventional approaches. The proposed approach opens a greater feasibility of applying structured light based depth imaging to a 3D modelling of cluttered workspace for home service robots.