Detail-on-demand hypervideo will provide a powerful mechanism to allow viewers to see additional information of video segments through hyperlinks. A large number of tools are devoted to the identification of selectable video objects and the synchronizatio

This paper describes a new method for authoring video-based hypermedia. It defines an XML-based (Extensible Markup Language) data modeling language called HyperVideo Authoring Language (HyVAL) for constructing structured documents in which the composition of internal video objects (segments, scenes, shots, frames and visual objects in frames) and external media objects (text, audio, images, html pages, etc.) is specified. The model allows an author to interactively specify various internal objects and relationship among internal and external objects. Through the language, a flexible presentation of video-based hypermedia is achieved and comprehensive viewer interactions with video objects are carried out. The experiment of structuring video-based hypermedia using HyVAL in our authoring and presentation environment is also described in this paper.