We propose a new method to realize the media conversion between music and image according to the feeling. In this research, we have focused on color combination and corresponded the affect evoked from music with color combination in subjective assessment. As the result, the affective mapping table between music and color combination has been obtained and the reliability of the obtained mapping table has been verified in the viewpoint of media conversion. The selected color combinations based on the mapping table evoke the affect like the musical affect: the maximum concordance rate between music and color combination is 70%. In this research, it is clarified that (1) musical affect and color affect have strong similarity each other, and (2) color combination can be applied to the sophisticated media conversion between music and image.

Beyond the conventional idea that high resolution is equal to high quality on a computer screen, we are making basic research to develop the extra high quality imaging system, which can convey high order sensations. High order sensations mean highly artistic impressions and emotional information. We have carried out an assessment test of extra high quality images by subjective and objective methods. Extra high quality images can convey high order sensations, which include high quantization for one of the important physical factors. We have assessed image quality versus quantization level. It has been observed that, in EEG measurement, the power of /spl alpha/-EEG has been higher value in images with higher quantization level, especially in the "MIROKU" image (a kind of Buddha's image, monochrome). It is expected that EEG measurement is able to assess high order sensations included in extra high quality images practically.

A new methodology for the determination of an objective metric for still image coding is reported. This methodology is applied to obtain a picture quality scale (PQS) for the coding of achromatic images over the full range of image quality defined by the subjective mean opinion score (MOS). This PQS takes into account the properties of visual perception for both global features and localized disturbances. The PQS closely approximates the MOS, with a correlation coefficient of more than 0.92, as compared to 0.57 obtained using the conventional weighted mean-square error (WMSE). Extensions and applications of the methodology and of the resulting metric are discussed.

To design the image communication system including human visual system systematically, the objective quality estimation method of the picture based on the model of the human vision is necessary. We develop the objective picture quality scale (PQSvideo) for video coding considering the relation between the physical distortion factors and the psychological picture estimation factors. The obtained cross correlation coefficient between the PQSvideo and the mean opinion score (MOS), becomes 0.978.

This paper considers an objective picture quality scale for color images (PQScolor). PQScolor approximates the mean opinion score satisfactorily, it takes into account the color perception by using color difference and the properties of visual perception for global features and for localized disturbances. There are two type systems, PQScolor1 is based on Godlove's color difference and PQScolor2 is based on H, V, C signal difference. The correlation coefficient between PQScolor (1, 2) and MOS is more than 0.9, which is very high compared to the value 0.34 obtained for the mean color difference scale.

One of the hard problems in image recognition and understanding is region segmentation. A traditional segmentation method such as clustering is not fully useful for any image, because of the initial values of clusters and the evaluation functions of segmented clusters affect the results of region segmentation. To solve this problem, we introduce the genetic algorithm (GA) for clustering. The experimental result shows the satiable results of region segmentation which have been achieved by applying GA.>

A generalized approach to obtain a family of the reversible linear transform functional sets for the transform compression is proposed in this work. The present method is formulated so as to include the conventional Karhunen-Loeve (KL) transform method in itself, and shows how one might take account of a spatially inhomogeneous and correlated error measure. These new functional sets can be derived minimizing a generalized measure defined in a skew linear error space instead of the conventional orthogonal one. The generalized error measure is minimized to obtain an optimal functional set which is capable of making the errors spatially inhomogeneous and reducing the correlation between them. For a strongly correlated input data sequence, an algebraic equation for the sinusoidal inhomogeneity of errors is analytically solved and found to yield the discrete Mathieu functions (DMF's) expanded m terms of the discrete cosine functions (DCF's). As an example, the simulation results for the DMF's are shown in comparison with the performances of the KL and the DC transform compressions. Since, as is well known, the spatially, highly correlated, and localized errors are very visible to the human eye, one may expect that the present method is effectively applicable to the block transform compression of image data to reduce the visible distortion.

Psychophysical considerations show that the block-shaped distortion peculiar to orthogonal transform coding (OTC) is ten times more objectionable than random noise distortion. Minimizing the blockshaped distortion is considered here by analyzing the process of generation of coding errors, and the required characteristics of the orthogonal transform function (OTF) are clarified. Computer simulations substantiate its validity. Graphical illustration and measures of the block-shaped distortion are proposed and substantiated. With the aid of these measures, one can evaluate the performance of OTC or a new OTF, if proposed, without conducting visual assessment tests.

Interlaced scanning is an effective technique to transmit pictures, but it causes an inherent disturbance in interlaced scanning (interlace disturbance) and deteriorates the picture quality. Recent developments of television signals and picture monitors have increased the interlace disturbance. A dual-beam display method which does not produce the interlace disturbance was constructed. By this apparatus, the effect of interlace disturbance and a tradeoff problem of the picture quality were tested. The results are as follows. 1) When the interlace disturbance is eliminated, the still picture quality is greatly improved. The higher the quality of the input signal, the greater the improvement of the picture quality. 2) The conspicuous scene strongly affects the overall picture quality in spite of the small probability of occurrence.

The method and results are reported of subjective assessment tests on the perception of motion in television signals. Discussed are applications of these results to the transmission technique for the difference between two adjacent frame signals. The main results are as follows. 1) Smoothness of motion is lost by field-repeating or frame-repeating TV signals, unless motion is slow. The just perceptible velocity and acceptable limit of velocity are determined by subjective tests. The velocity of moving objects should be very low in order to obtain smooth motion. 2) The precision required in separating the standard television signal into stationary and moving parts is derived from the just perceptible velocity in 1). It is about 1/3 of a Nyquist interval; that is, equivalent to a viewing angle of 45 s, when the viewing distance is 4 × (height of picture). 3) The apparent Gaussian noise level increases by 1 ∼ 3 dB when television pictures are field-repeated. On the other hand, it decreases in frame-repeated pictures, provided that the number of repetitions is small. 4) From subjective assessment of the degradation of picture quality caused by blurring of the moving part, it becomes clear that the bandwidth of the signal of the moving part can readily be reduced by a factor of 3.5.