In compute-intensive multimedia applications, the computer not only manipulates media, but also digests it and performs independent actions based on media content. We present a design approach that applies the programming techniques of visualization systems to the development of compute-intensive multimedia applications. We describe an implementation based on this approach, and report performance measurements that demonstrate it is practical. We conclude with a description of some applications that have been implemented and a discussion of the implications for the design and engineering of operating systems.

The VuNet is a gigabit-per-second desk-area ATM network that interconnects general-purpose workstations, network-based multimedia devices, and bridges to other networks, workstations access the multimedia devices over the network and coordinate the movement of information streams among the different parts of the system. This architecture presents several advantages over the traditional workstation-centric models, including the ability to easily share network-based devices, to access nonlocal devices, and to relieve the workstation of a portion of the I/O work. This paper describes the philosophy, implementation choices, advantages, and limitations of the VuNet ATM network implementation, as well as performance and current status.>

This paper describes applications built on the ViewStation, a distributed multimedia system based on Unix workstations and a gigabit per second local area network. A key tenet of the ViewStation project is the delivery of media data not just to the desktop but all the way to the application program. As processing power continues to improve, our approach enables applications that perform intensive processing of audio and video data. We hypothesize that as media data are shaped by this software-based processing, the resultant network traffic patterns will be dominated more by software behavior than by so-called real-time issues. We have written applications that directly process live video to provide more responsive human-computer interaction. We have also developed applications to explore the potential of media processing to support content-based retrieval of prerecorded television broadcasts. These applications perform intelligent processing on video, as well as straightforward presentation. They demonstrate the utility of network-based multimedia systems that deliver audio and video data all the way to the application. The network requirements of the applications are modeled as a combination of bursty transfers and periodic packet-trains.>

In computer-participative multimedia applications, the computer not only manipulates media, but also digests it and performs independent actions based on media content. We present a design approach that applies the programming techniques of visualization systems to the development of computer-participative multimedia applications. We describe an implementation based on this approach, and report performance measurements that demonstrate it is practical. We conclude by describing three applications written with the system, and suggest future directions for research in the area.