We present an interface for exploring large design spaces as encountered in simulation-based engineering, design of visual effects, and other tasks that require tuning parameters of computationally-intensive simulations and visually evaluating results. The goal is to enable a style of design with simulations that feels as-direct-as-possible so users can concentrate on creative design tasks. The approach integrates forward design via direct manipulation of simulation inputs (e.g., geometric properties, applied forces) in the same visual space with inverse design via 'tugging' and reshaping simulation outputs (e.g., scalar fields from finite element analysis (FEA) or computational fluid dynamics (CFD)). The interface includes algorithms for interpreting the intent of users' drag operations relative to parameterized models, morphing arbitrary scalar fields output from FEA and CFD simulations, and in-place interactive ensemble visualization. The inverse design strategy can be extended to use multi-touch input in combination with an as-rigid-as-possible shape manipulation to support rich visual queries. The potential of this new design approach is confirmed via two applications: medical device engineering of a vacuum-assisted biopsy device and visual effects design using a physically based flame simulation.

Studies of motion are fundamental to science. For centuries, pictures of motion have factored importantly in making scientific discoveries possible. Today, there is perhaps no tool more powerful than interactive virtual reality (VR) for conveying complex space-time data to scientists, doctors, and others; however, relatively little is known about how to design virtual environments in order to best facilitate these analyses. In designing virtual environments for presenting scientific motion data (e.g., 4D data captured via medical imaging or motion tracking) our intuition is most often to “reanimate” these data in VR, displaying moving virtual bones and other 3D structures in virtual space as if the viewer were watching the data being collected in a biomechanics lab. However, recent research in other contexts suggests that although animated displays are effective for presenting known trends, static displays are more effective for data analysis.

Abstract We present a study of interactive virtual reality visualizations of scientific motions as found in biomechanics experiments. Our approach is threefold. First, we define a taxonomy of motion visualizations organized by the method (animation, interaction, or static presentation) used to depict both the spatial and temporal dimensions of the data. Second, we design and implement a set of eight example visualizations suggested by the taxonomy and evaluate their utility in a quantitative user study. Third, together with biomechanics collaborators, we conduct a qualitative evaluation of the eight example visualizations applied to a current study of human spinal kinematics. Results suggest that visualizations in this style that use interactive control for the time dimension of the data are preferable to others. Within this category, quantitative results support the utility of both animated and interactive depictions for space; however, qualitative feedback suggest that animated depictions for space should be avoided in biomechanics applications.

We present Interactive Slice World-in-Miniature (WIM), a framework for navigating and interrogating volumetric data sets using an interface enabled by a virtual reality environment made of two display surfaces: an interactive multitouch table, and a stereoscopic display wall. The framework addresses two current challenges in immersive visualization: 1) providing an appropriate overview+detail style of visualization while navigating through volume data, and 2) supporting interactive querying and data exploration, i.e., interrogating volume data. The approach extends the WIM metaphor, simultaneously displaying a large-scale detailed data visualization and an interactive miniature. Leveraging the table+wall hardware, horizontal slices are projected (like a shadow) down onto the table surface, providing a useful 2D data overview to complement the 3D views as well as a data context for interpreting 2D multitouch gestures made on the table. In addition to enabling effective navigation through complex geometries, extensions to the core Slice WIM technique support interacting with a set of multiple slices that persist on the table even as the user navigates around a scene and annotating and measuring data via points, paths, and volumes specified using interactive slices. Applications of the interface to two volume data sets are presented, and design decisions, limitations, and user feedback are discussed.

We present Slice WIM, a method for overview+detail visualization of volume datasets that explores the potential of new interfaces made possible by a virtual reality (VR) environment made of two display surfaces: an interactive multi-touch table, and a stereoscopic display wall. Slice WIM displays a miniature version of the 3D dataset within a head-tracked stereoscopic view such that it appears to float directly above the multi-touch table. Multi-touch gestures on the table are then used to navigate through the dataset and to set slices (cutting planes) through the data. Leveraging the unique table+wall hardware setup, horizontal slices through the data are projected (like a shadow) down onto the table surface, providing a useful 2D data overview to complement the 3D views as well as a data context for interpreting 2D multi-touch gestures made on the table. We demonstrate several strategies for interacting with 2D "shadow slices" on the table surface as a method for controlling the WIM and exploring volumetric datasets. Applications of the interface to explore two different volume datasets are presented, and design decisions and limitations are discussed along with feedback from both casual users and domain scientists.