We have developed a video processing method that achieves human perceptual visual quality-oriented video coding. The patterns of moving objects are modeled by considering the limited human capacity for spatial-temporal resolution and the visual sensory memory together, and an online moving pattern classifier is devised by using the Hedge algorithm. The moving pattern classifier is embedded in the existing visual saliency with the purpose of providing a human perceptual video quality saliency model. In order to apply the developed saliency model to video coding, the conventional foveation filtering method is extended. The proposed foveation filter can smooth and enhance the video signals locally, in conformance with the developed saliency model, without causing any artifacts. The performance evaluation results confirm that the proposed video processing method shows reliable improvements in the perceptual quality for various sequences and at various bandwidths, compared to existing saliency-based video coding methods.

In this paper, we develop a method for generating thumbnail images from the interlaced H.264/AVC coded bit streams. We devise a method exploiting both the spatial and transform do main while decoding the intra prediction. In comparison to the conventional method of decoding the bit stream then scaling down the decoded images, the developed method reduces the complexity by more than 60% while producing identical thumbnail images.

We propose a fast method for encoding the I-slices of H.264/AVC when only I-slices are used. The proposed intra coding method saves more than 30% of the complexity when compared with the conventional method while producing identical I-slices. The proposed method is applicable to any method which only uses I-slices, such as visual radio, snapshot camcorder and Distributed Video Coding (DVC).