In this paper, we propose a novel structure for a multi-modal data association referred to as Associative Variational Auto-Encoder (AVAE). In contrast to the existing models using a shared latent space among modalities, our structure adopts distributed latent spaces for multi-modalities which are connected through cross-modal associators. The proposed structure successfully associates even heterogeneous modality data and easily incorporates the additional modality to the entire network via the associator. Furthermore, in our structure, only a small amount of supervised (paired) data is enough to train associators after training auto-encoders in an unsupervised manner. Through experiments, the effectiveness of the proposed structure is validated on various datasets including visual and auditory data.

This paper proposes a new pan-tilt-zoom (PTZ) tracking method to improve the robustness against occlusions and appearance changes by using motion likelihood map and scale change estimation as well as appearance correlation filter. For this purpose, we introduce a motion likelihood map constructed from motion detection result in addition to the correlation filter. The motion likelihood map is generated by blurring the motion detection result, which shows high probability in the center of target. To combine the correlation filter and the motion likelihood map, we formulate an optimization problem. In addition, to handle the scale change of target, we repeat the combining process for various scale of bounding box. The experiments show that the proposed method outperforms the state-of-the-art methods.

This paper proposes a new algorithm for color-to-gray conversion preserving the gradient information in input color image. To preserve the gradient in a color image, we construct a random forest representing the relation between color intensity and gradient in an input image. The leaf nodes of random trees indicate the gray colors (single channel colors) corresponding to the input RGB colored pixels. From these initial gray colors obtained by the random forest, we determine the final gray scale by keeping the balance between intensity and luminance channels. In our experiments, we show that the proposed method outperforms the state-of-the-arts in view of color constrast preserving ratio and mean squared error versus luminance.