We present an interactive sound handling system called SoundPond, in which a sound unit is treated as a virtual sound object. A short recorded sound is visualized as an oval shape that can be changed by the user, leading to modification of characteristics of the sound. Interactions between other sound objects and drawn objects are implemented. Each sound object is also affected by the pond in which it is placed. The proposed system attempts to provide intuitive and versatile interactions for rich sound handling. In the prototype system, basic functions are implemented using a multi-touch display, a microphone, and a pair of stereo speakers. Possible future application areas using SoundPond are graphical sound composition, sound performance, and a sound playground. We believe that SoundPond has the potential to be used for sound expression based on the creativity of the user.

This demonstration shows an interactive visual-to-auditory scene sensing system called Eyeke (Eye Mike), which converts visual features of what it sees into sound output aiming at helping us to interact with our surroundings. Eyeke works robustly by restricting colors in its image processing and easy-and-effective calibration. Demonstrations of Eyeke as a music instrument and a camera-based scene sonar are shown.

"Environment of intellect" implies that we need different kinds of intellect to consider the future from an environmental viewpoint. The author proposes 7 issues we should think about for the future: (1) ICT as key environment; (2) macroscopic view; (3) human-conscious technology; (4) a sound mind with a sound technology; (5) essential solutions; (6) fault tolerance; and (7) harmony in diversity

To enable existing cell phones to interact with contents shown on large public screens in town, we propose “C-Blink,” a new light signal marker method that uses the color liquid-crystal display of a cell phone as a visible light source. We overcome the performance limitations of such displays by developing a hue-difference-blink technique. In combination with a screen-side sensor, we describe a system that detects and receives light signal markers sent by cell phone displays. Evaluations of a prototype system confirm that C-Blink performs well under common indoor lighting. The C-Blink program can be installed in any mobile terminal that has a color display, and the installation costs are low. C-Blink is a very useful way of enabling screens to become interfaces for existing mobile terminals.

This paper proposes the chart-style video playback interface PlayWatch; it displays a chart of semantic indices for locating video scenes. The main features of PlayWatch are: 1) the user understands the distribution of the scenes because PlayWatch shows the indices in order. 2) The user can access a desired scene directly through the indices since they also act as link buttons. This paper also describes the evaluation of PlayWatch. Experiments on scene searching show that PlayWatch is effective in accessing precisely indexed scenes.

The lifting structured wavelet transform (lifting wavelet) attracts researchers' attention as a key technology to a lossless and lossy unified coding system of digital image data. For VLSI circuit implementation, multiplier coefficients in the transform must be truncated into finite word length binary values. This report investigates how to appropriately assign error tolerance to each coefficient considering its sensitivity to a typical image signal under a given tolerable total hardware cost. As a result, it is confirmed that the total hardware scale of the multipliers is reduced to 51%.

To enable common mobile terminals to interact with contents shown on large screens, we propose "C-Blink", a new light signal marker method that uses the color liquid-crystal display of a mobile terminal as a visible light source. We overcome the performance limitations of such displays by developing a hue-difference-blink technique. In combination with a screen-side sensor, we describe a system that detects and receives light signal markers sent by cell phone displays. Evaluations of a prototype system confirm that C-Blink performs well under common indoor lighting. The C-Blink program can be installed in any mobile terminal that has a color display, and the installation costs are small. C-Blink is a very useful way of enabling ubiquitous large screens to become interfaces for mobile terminals.

Whisper is a new wrist-worn handset, which is used by inserting the fingertip into the ear canal. A received signal is conveyed from a wrist-mounted actuator to the ear canal via the hand and a finger by bone conduction. The users voice is captured by a microphone mounted on the inside of the wrist. All components of Whisper can be mounted on the wrist, and usability does not de- crease if the size of components is miniaturized. So, both wearability and usability can be achieved together. The way Whisper is operated is similar to that of an ordinary telephone handset. Thus, onlookers may not look upon Whispers operation as talking to oneself, even if the associated PDA is controlled by voice commands. Whis- per is especially effective in a noisy environment. Signals received via bone conduction can be heard clearly in the presence of noise without raising the volume (-12 dB at noise = 90 dB(A) in comparison to cellular phone hand- set). Whisper is also effective in avoiding the annoying problem of the users voice being raised in a noisy situa- tion. Feedback of the users utterance is boosted by bone conduction when covering the ear canal with a fingertip, then the users voice does not need to raised in the pres- ence of noise (-6 dB at noise = 90 dB(A) in comparison to cellular phone handset). Whisper is useful as a voice interface for a wrist-worn PDA and cellular phone.

No abstract available.

A really wearable input device "FingeRing" is developed for coming wearable PDAs.By attaching ring shaped sensors on each finger, many commands or characters can be input by finger-tip typing action."FingeRing" can be used on any typing surface such as a knee or desk, so quick operation is realized in any situation while standing or walking.To improve wearability, a very small, ultra low power wireless transmitter is developed that uses the human body ss part of an electric circuit."Direct Coupling" method enables stable communication even when body contacts any grounded surface.A new symbol coding method that combines order and chord typing is also proposed, and useful typing patterns are chosen by typing speed evaluations.Expert users of musical keyboards can input 52 different symbols at speeds of over 200 symbols per minute by using the combination of FingeRing and the new coding method.

Because digital video is becoming increasingly important for the networked multimedia society, the audio-visual access environment should allow us to do more than just passively watch. We propose a new video user interface concept made possible by multi-dimensional video computing. Multidimensional video computing offers a framework for analyzing a video, creating new structures, and restyling and visualizing the video according to the user's demands. The video interface visualizes video content and context structure comprehensibly to allow us to access the spatiotemporal information in videos intuitively. In this paper, we introduce our research activities toward a video interface based on the information extracted from the video. New video interfaces called VideoBrowser, PanoramaVideo, and VideoJigsaw are described.

Browsing is a fundamental function in multimedia systems.This paper presents PanoramaExcerpts -a video browsing interface that shows a catalogue of two types of video icons: panoramic and keyframe icons.A panoramic icon is synthesized from a video segment taken with camera pan or tilt, and extracted using a camera operation estimation technique.A keyframe icon is extracted to supplement the panoramic icons; a shot-change detection algorithm is used.A panoramic icon represents the entire visible contents of a scene extended with camera pan or tilt, which is difficult to summarize using a single keyframe.For the automatic generation of PanoramaExcerpts, we propose an approach to integrate the following: (a) a shot-change detection method that detects instantaneous cuts as well as dissolves, with adaptive control over the sampling rate for efficient processing; (b) a method for locating segments that contain smooth camera pans or tilts, from which the panoramic icons can be synthesized; and (c) a layout method for packing icons in a space-efficient manner.We also describe the experimental results of the above three methods and the potential applications of PanoramaExcerpts.

We propose VideoStyler, a new eloquent video interface concept made possible by multi-dimensional video computing. VideoStyler allows the user to visualize video structures in several different ways. The implementation described in this paper offers VideoSpaceIcon, VideoPanorama, and VideoJigsaw by using multi-dimensional video computing that robustly supports camera operations estimation at speeds much faster than conventional optical flow methods. The accuracy of the estimation using the proposed method was better than 90% in a simulated experiment. VideoStyler is an efficient interface for intuitively understanding the spatio-temporal structure of related video shots. It explicitly permits spatio-temporal interaction: the temporal replay point can be selected directly from the visualized representation.

No abstract available.

This paper proposes a new, efficient and practical way to extract lens zoom, camera pan and camera tilt information using modified motion analysis. The proposed method is called the Video Tomography Method (VTM), in which tomographic techniques are introduced into a motion estimation algorithm. By using the VTM, one is able to visualize motion as a spatiotemporal flow for motion analysis. The VTM is an extremely robust [resistant to noise] method for estimating camera operation due to its tomographic nature. The practicality of this type of motion estimation and analysis is confirmed by the results of our simulations and experiments in testing the prototype platform with a low quality video source. Other possible applications that might use extracted motion data are discussed. This method is targeted towards video handling applications that attribute extracted motion data into a video index. It will enhance the process of editing and browsing structured video, and will allow the visualization of scenes spatiotemporally so that video may be accessed intuitively and spatially in relation to its temporal location. This type of access is a new interface for structured video. Scene reconstruction techniques can be extended to apply to the problem of reconstructing occluded images and resolution enhancement.

Article Free Access Share on Projection detecting filter for video cut detection Authors: Kiyotaka Otsuji View Profile , Yoshinobu Tonomura View Profile Authors Info & Claims MULTIMEDIA '93: Proceedings of the first ACM international conference on MultimediaSeptember 1993 Pages 251–257https://doi.org/10.1145/166266.166295Published:01 September 1993Publication History 45citation505DownloadsMetricsTotal Citations45Total Downloads505Last 12 Months29Last 6 weeks4 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteeReaderPDF