We present the development and evaluation of the Virtual Experience Test (VET). The VET is a survey instrument used to measure holistic virtual environment experiences based upon the five dimensions of experiential design: sensory, cognitive, affective, active, and relational. Experiential Design (ED) is a holistic approach to enhance presence in virtual environments that goes beyond existing presence theory (i.e. a focus on the sensory aspects of VE experiences) to include affective and cognitive factors. To evaluate the VET, 62 participants played the commercial video game Mirror's Edge. After gameplay both the VET and the ITC-Sense of Presence Inventory (ITC-SOPI) were administered. A principal component analysis was performed on the VET and it was determined that the actual question clustering coincided with the proposed dimensions of experiential design. Furthermore, scores from the VET were shown to have a significant relationship with presence scores on the ITC-SOPI. The results of this research produced a validated measure of holistic experience that could be used to evaluate virtual environments. Furthermore, our experiment indicates that virtual environments utilizing holistic designs can result in significantly higher presence.

This report presents a survey of computer based simulators for unmanned vehicles. The simulators examined cover a wide spectrum of vehicles including unmanned aerial vehicles, both full scale and micro size; unmanned surface and subsurface vehicles; and unmanned ground vehicles. The majority of simulators use simple numerical simulation and simplistic visualization using custom OpenGL code. An emerging trend is to used modified commercial game engines for physical simulation and visualization. The game engines that are commercially available today are capable of physical simulations providing basic physical properties and interactions between objects. Newer and/or specialized engines such as the flight simulator X-Plane or Ageia PhysX and Havok physics engines, are capable of simulating more complex physical interactions between objects. Researchers in need of a simulator have a choice of using game engines or available open source and commercially available simulators, allowing resources to be focused on research instead of building a new simulator. We conclude that it is no longer necessary to build a new simulator from scratch.

Augmented reality (AR) entails overlaying the real world with information from computer-generated displays. Current AR technologies support limited mobility, although this is expected to change in the future. This paper presents experimental results of effects of various AR display strategies on human performance in a simulation-based analog of a ldquosearch and rescuerdquo navigation task. The augmentation scheme was a spatially and temporally registered map that was overlaid onto a corresponding real-world maze. The experiment required the participants to traverse the maze, periodically answer orientation questions, obtain a target object, and exit the maze as quickly as possible. One hundred twenty participants were evaluated in six different conditions. There were two control conditions (paper map or compass prior to entering the maze), and four experimental conditions (combinations of egocentric and exocentric maps, and continuously on or on-demand map display). Performance measures consisted of duration of time to traverse the maze and percentage of maze covered. AR resulted in better performance than the control conditions in terms of accuracy by facilitating the participants' coverage of the maze. Results show that the better performance with respect to time was in the map control condition. This result may be due to the small size of the maze, which could be memorized. However, AR is expected to exhibit better performance compared to a paper map, when more complex environments are employed. These results demonstrate promising benefits in mobile AR usage in specific navigation tasks. Design guidelines were extracted to guide future AR systems continued progress in enhancing performance.

Virtual environment systems, especially those supporting multi-modal interactions require a robust and flexible software infrastructure that supports a wide range of devices, interaction techniques, and target applications. In addition to interactivity needs, a key factor of robustness of the software is the minimization of latency and more importantly, reduction of jitter (the variability of latency). This paper presents a flexible software infrastructure that has demonstrated robustness in initial prototyping. The infrastructure, based on the VESS Libraries from the University of Central Florida, simplifies the task of creating multi-modal virtual environments. Our extensions to VESS include numerous features to support new input and output devices for new sensory modalities and interaction techniques, as well as some control over latency and jitter.

As technology advances, systems are increasingly able to provide more information than a human operator can process accurately. Thus, a challenge for designers is to create interfaces that allow operators to process the optimal amount of data. It is herein proposed that this may be accomplished by creating multimodal display systems that augment or switch modalities to maximize user information processing. Such a system would ultimately be informed by a user's neurophysiological state. As a first step toward that goal, relevant literature is reviewed and a set of preliminary design guidelines for multimodal information systems is suggested.