The identification of syntactic or semantic temporal segments is an important process of video-content analysis. The paper proposes a temporal video segmentation method based on global motion in order to analyze meaningful temporal substructures of camera shots. To ensure that the detected segment optimally contributes to the shot global characteristic, the proposed method exploits a state-of-the-art discrete curve evolution. This technique leads to a subdivision of the global motion trajectory, where each segment of the subdivision has a constant relevant global motion. Experimental results based on standard test sequences acknowledge the method functionality, especially for shots characterized by pronounced camera motion.

Digital still cameras use a single charge-coupled device (CCD) sensor array and a color filter array (CFA) to sample a full-color image. Thus, the measured image is an interleaving of the subsampled red, green, and blue images. The red and blue images are sampled at a lower rate, so if standard interpolation techniques are used, the reconstructed red and blue images will be missing some high-frequency information and could contain distortions from aliasing. This paper proposes a method of CFA interpolation that combines information from the green image with the subsampled red and blue images to attack these problems. The green high-frequency information is added to the interpolated red and blue images to increase the sharpness of the output and is also used to estimate the aliasing in the interpolated red and blue images, providing a means of reducing the appearance of the aliasing distortions.

This paper presents a programmable DSP platform for digital still cameras based on the Texas Instruments TMS320C54x family. One major advantage of this platform is that, after capturing an image from a CCD sensor, processing the raw image, and compressing the image for storage is performed on the digital signal processor (DSP). This provides a short shot-to-shot delay and a high degree of flexibility. The system realized also allows instant viewing and selective storing of captured images. This paper outlines the various processing stages necessary to take the raw CCD data and produce a JPEG compressed bit stream and highlighting the advantages of DSPs for this application. The programmable nature of this platform allows for the exploration of different image processing and compression techniques. The low power nature of the digital signal processor provides long battery life.

Quadtree-like pyramids have the advantage of re-suiting in a multiresolution representation where each pyramid node has four unambiguous parents. Such a centered topology guarantees a clearly defined up-projection of labels. This concept has been successfully and extensively used in applications of contour detection, object recognition and segmentation. Unfortunately, the quadtree-like type of pyramid has poor approximation powers because of the employed piecewise-constant image model. This paper deals with the construction of improved centered image pyramids in terms of general approximation functions. The advantages of the centered topology such a symmetry, consistent boundary conditions and accurate up-projection of labels are combined with a more faithful image representation at coarser pyramid levels. We start by introducing a general framework for the design of least squares pyramids using the standard filtering and decimation tools. We give the most general explicit formulas for the computation of the filter coefficients by any (well behaving) approximation function in both the continuous (L(2)) and the discrete (l(2)) norm. We then define centered pyramids and provide the filter coefficients for odd spline approximation functions. Finally, we compare the centered pyramid to the ordinary one and highlight some applications.

A spatially scalable video coding scheme for low bit rates is proposed. The codec is especially well suited for communications applications because it is based on motion-compensated predictive coding which provides the necessary low-delay property. The frames to be coded are decomposed into a Gaussian pyramid. Motion estimation and compensation are performed between corresponding pyramid levels of successive frames. We show that, to fulfill specific needs of spatial scalability, the motion compensation on each level must result in compatible prediction errors (displaced frame differences, DFD). Compatibility of the prediction errors means that the pyramid formed by independently obtained DFD's (the DFD pyramid) is close to a Gaussian pyramid decomposition of the DFD of the highest resolution level. From the DFD pyramid, a least squares Laplacian pyramid is derived, which is quantized and coded. The DFD encoder outputs an embedded bit stream. Thus, the coder control may truncate the bit stream at any point, and can keep a fixed rate. The motion vector fields obtained at the different resolution levels are also encoded by employing a pyramid approach. Simulation results show that the proposed coder achieves a coding gain compared to simulcast coding.

The approach described in this paper improves block-based motion estimation and compensation by introduction of a block segmentation dividing each block into two parts. For each block a segmentation pattern is derived from the motion vectors, which circumvents the transmission of the segmentation as side information. Motion vectors are estimated for both parts of a block. Although the number of motion vectors increases, the coding overhead can be kept sufficiently low by incorporating a Gibbs-criterion into the motion estimation criterion to trade off coding rate versus prediction error.

A method for still image coding is proposed which allows for progressive transmission, because low detailed versions of the image can be reconstructed from a truncated bit stream. The proposed method is in its main aspects close to the classical pyramid approach of Burt and Adelson (1983). While retaining the main idea of using a Laplacian pyramid type decomposition, the new proposal differs in the filters employed for pyramid decomposition and in the bit allocation and quantization. The image is decomposed into an improved Laplacian pyramid. The pyramid is quantized and coded following a layered quantization approach together with a layered coding method based on conditional arithmetic coding. The encoder outputs an embedded bit stream. Thus the decoder may truncate the bit stream at any point, which results in a more or less detailed image. Besides this rate-distortion scalability the coder has a multiresolution property, due to the pyramid decomposition. An extension to hybrid video coding is also discussed.

Image sequences are mostly coded by motion compensated predictive coding. The motion vector field to be transmitted as side information is typically predictive coded. In this paper a new approach is presented for coding of motion vector fields at low bit rates (<64 kbit/s) more efficiently by applying a pyramid decomposition, which is encoded using zero-trees. The embedded coding of the pyramid allows for progressive transmission of the motion vectors and is well suited for source adaptive channel coding.

A new method for coding of displaced frame differences (DFD) is proposed. DFD coding is a necessary task in hybrid video coding. In particular a Laplacian pyramid is employed which decomposes the DFD into several layers with differing spatial resolution. The pyramid is encoded in an embedded fashion using zero-trees. Simulation results show promising rate-distortion performance for low bit rate video coding.