We have developed a robust method for estimating camera parameters for live TV production based on infrared markers whose feature-point extraction is simple and two-dimensional color histogram matching that considers the effects of specular reflection due to lighting. We first explain the principle of the proposed technique. We then present the results of a basic experiment for evaluating the accuracy of marker identification and the results of an image-compositing experiment using estimated camera parameters. We show that the proposed technique is effective based on those results.

When making a TV program in a studio, care must be taken that the camera does not shoot beyond the boundary of the studio set. In addition, limitations in cost and space for the set must be taken into account. In a virtual studio, on the other hand, we can solve this cost and space problem, but in turn, actors are requested to perform in front of a blue background screen, which is not always an easy task for them. To solve these problems associated with real studios and virtual studios, we have developed a new type of virtual studio called Real Space-based Virtual Studio in which a real space image and virtual space image are combined naturally with no boundary seam. There are two major advantages in using this new virtual-real hybrid system. One is that the actors can concentrate on their role in the real studio sets, and the other is that camera work can be done without worrying about off-screen areas of the set. In the present study, we constructed an omnidirectional image with ultra high-definition features and combined it as a virtual studio image with a real studio image. We have developed an integration system and from the experimentation we have shown that the omnidirectional images and the real studio images can combine smoothly and naturally.