We explore the challenges in expressing and managing concurrency in browsers on mobile devices. Browsers are complex applications that implement multiple standards, need to support legacy behavior, and are highly dynamic and interactive. We present ZOOMM, a highly concurrent web browser engine prototype and show how concurrency is effectively exploited at different levels: speed up computation performance, preload network resources, and preprocess resources outside the critical path of page loading. On a dual-core Android mobile device we demonstrate that ZOOMM is two times faster than the native WebKit based browser when loading the set of pages defined in the Vellamo benchmark.

We have developed a system built on our mobile AR platform that provides users with see-through vision, allowing visualization of occluded objects textured with real-time video information. We present a user study that evaluates the userpsilas ability to view this information and understand the appearance of an outdoor area occluded by a building while using a mobile AR computer. This understanding was compared against a second group of users who watched video footage of the same outdoor area on a regular computer monitor. The comparison found an increased accuracy in locating specific points from the scene for the outdoor AR participants. The outdoor participants also displayed more accurate results, and showed better speed improvement than the indoor group when viewing more than one video simultaneously.

This paper describes the results of a study conducted to determine the efficiency of visual cues for a collaborative navigation task in a mixed-space environment. The task required a user with an exocentric view of a virtual room to navigate a fully immersed user with an egocentric view to an exit. The study compares natural hand-based gestures, a mouse-based interface and an audio only technique to determine their relative efficiency on task completion times. The results show that visual cue-based collaborative navigation techniques are significantly more efficient than an audio-only technique.

This paper presents a new interaction metaphor for mixed space collaboration: HOG on a WIM. Hand of god (HOG) on a world in miniature (WIM) is the first collaborative WIM. It enables a table-top display user to collaborate with a virtual reality (VR) user. The tabletop display user has a god's eye view of the virtual world and communicates with the VR user through natural gestures and speech. The VR user controls a WIM to navigate and manipulate the virtual world with the aid of the tabletop display user's guidance.

Digital Foam is a new input sensor developed to support clay like sculpting and modeling operations. We present techniques facilitating navigation and manipulation operations performed using Spherical Digital Foam as a sole input device. Our free-form sculpting technique allows manipulation of new and existing 3D models using accumulated sculpting like motions. Digital Foam's multi-point pressure sensitive surface captures the separate locations of a user's fingertips allowing controlled manipulation of multiple model vertices simultaneously. Additionally, we developed a technique that allows the camera view and zoom to be controlled by applying varying pressure to the Digital Foam surface. Furthermore, we have designed a menu system tailored for operation using Spherical Digital Foam as a sole input device using both the internal orientation sensor and the pressure sensitive surface.

This paper describes techniques to allow both the visualization of hidden objects, and removal of real objects, for a mobile augmented reality user. A gesture based technique is also described which allows the user to select when to view occluded objects. By using the real-time modeling techniques of the Tinmith system, the user is able to create the required geometry to allow image based rendering techniques to be used to render corrected images on the user's display. The images of the hidden objects are captured by a mobile robot platform that is controlled by the mobile user.

This paper describes the design of hand-worn gloves for interacting with mobile outdoor augmented reality systems. Most existing systems rely on more traditional 2D input devices such as mice and keyboards. Since augmented reality information is typically registered in 3D to the environment, user interfaces need to be designed that are capable of supporting the more complex operations possible. This paper describes how we used metallic thread and adhesive fabric to add conduction sensing to a standard set of gloves which can survive harsh treatment; how Bluetooth and MSP430 microcontrollers are used to build a small circuit that is wireless and highly portable; and how AR-ToolKit is used for 3D tracking of fiducial markers on the thumbs. While we have previously demonstrated this technology with a number of our previous systems, this paper explains the various techniques we use in the implementation.

This paper presents a new interaction metaphor we have termed "god-like interaction". This is a metaphor for improved communication of situational and navigational information between outdoor users, equipped with mobile augmented reality systems, and indoor users, equipped with tabletop projector display systems. Physical objects are captured by a series of cameras viewing a table surface indoors, the data is sent over a wireless network, and is then reconstructed at a real-world location for outdoor augmented reality users. Our novel god-like interaction metaphor allows users to communicate information using physical props as well as natural gestures. We have constructed a system that implements our god-like interaction metaphor as well as a series of novel applications to facilitate collaboration between indoor and outdoor users. We have extended a well-known video based rendering algorithm to make it suitable for use on outdoor wireless networks of limited bandwidth. This paper also describes the limitations and lessons learned during the design and construction of the hardware that supports this research.

This work describes the combination of two technologies, augmented reality and GIS, to provide a new way to visualise viticulture GIS data using outdoor mobile computers. Viticulturists use GIS to assist with accurately understanding the parameters that affect their yields and quality of the grapes from different vineyards. The ability to view this data in the field digitally would be advantageous to the viticulturist. This work describes the ARVino system; an AR platform that was built for visualising 3D data outdoors using a movable tripod-based computer. We describe the user interface, some problems that were encountered, and how the visualisation and interface were evaluated through an expert review.

This paper presents the design for our latest backpack to support mobile outdoor augmented reality, and how it evolved from lessons learned with our previous designs. We present a number of novel features which help to reduce size and weight, improve reliability and ease of configuration, and reduce CPU usage on laptop computers.

This paper introduces the concept of augmented reality working planes to action and construction at a distance for mobile outdoor augmented reality systems. We have based our new AR working planes technique on CAD working planes, but by using coordinate systems relative to the body they can be specified and used much more intuitively than on a desktop system. We demonstrate in this paper how AR working planes can be used for the display of information, the manipulation of existing 3D objects, and the creation of new geometry. AR working planes are particularly well suited to supporting 3D modelling in mobile outdoor AR systems. This modelling task is a particularly difficult problem, because the environment is typically at a scale much larger than the user, and direct manipulation techniques can not be used.

This paper describes a new hybrid tracking system that integrates standard outdoor augmented reality trackers with a low cost indoor tracker based on the use of fiducial markers. We use multiple cameras, separate orientation sensing, and scene graph integration to improve on similar previous systems. This hybrid tracker allows applications to operate within large indoor and outdoor environments with minimal scaling costs. Tracking is performed using GPS style world coordinates both indoors and outdoors, and has been integrated into our existing mobile 3D modelling applications.

This paper presents a new software architecture for 3D mixed reality applications, named Tinmith-evo5. Currently there are a limited number of existing toolkits for the development of 3D mixed reality applications, each optimized for particular feature but at the detriment of others. Complex interactive user interfaces and applications require extensive supporting infrastructure, and can be hampered by inadequate support. The Tinmith-evo5 architecture is optimised to develop mobile augmented reality and other interactive 3D applications on portable platforms with limited resources. This architecture is implemented in C++ with an object-oriented data flow design, an object store based on the Unix file system model, and uses other ideas from existing previous work.

This paper outlines some of the capabilities of the Tinmith-Metro modeling system, based on mobile outdoor augmented reality technology. This system implements a new user interface based on tracked pinch gloves and a series of techniques named construction at a distance for the capture and creation of 3D geometry. The user controls the modeling process using hand and head motions, with modelling accuracy guided by the requirements of the user. Using Tinmith-Metro, users are able to model outdoor geometry representing buildings and natural features in an intuitive fashion.

This paper presents user interface technology for mobile outdoor augmented reality systems, and a set of new techniques we have named construction at a distance for the capture and creation of 3D geometry. Using a pair of vision tracked pinch gloves and a specially designed menu system, a user is able to use the physical presence of their body to perform modelling tasks in ways not previously possible.

The authors present a model for bringing the coordination power of workflow management systems to outdoor wearable augmented reality (AR) systems. They portray how mobile equipment may be integrated with adaptive, context-aware work environments. A scenario of a medical emergency task is described to illustrate the functionality of this form of collaboration system. Appropriate information stickers are introduced to support data collection in medical emergency scenarios in a sophisticated form through a hands-free user interface for medical personnel. They propose the use of new user interface technology, including multimedia, AR information stickers, and the allocation of patient medical records to identified locations of the human body. A key feature is the access to relevant information for users in the mobile environment as well as for those in the advanced control room. An additional advantage is the automatic recording of on-site data, which helps to build the medical record of a patient without interfering with the work of the emergency team.

This paper presents a new technique we have created, known as Bread Crumbs, which allows the modelling of large outdoor ground features using a mobile augmented reality system and a user's physical presence. Using this technique, we demonstrate an example of modelling a large grassy area on campus. This technique is one component of a larger set of tools which allow users to capture and work with complex outdoor geometry interactively, and to view this geometry in new and interesting ways.

This paper presents a unified user interface technology, using 3D interaction techniques, constructive solid geometry and a glove-based menuing system, known as Tinmith-Hand, to support mobile outdoor augmented reality (AR) applications and indoor virtual reality (VR) applications. Tinmith-Hand uses similar concepts for both domains, so that AR and VR applications are consistent and simple to use. The future goal of this user interface is to allow collaboration between outdoor AR and indoor VR systems.

This paper describes an architecture to support a hardware and software platform for research into the use of wearable computers and augmented reality in an outdoor environment. The architecture supports such devices as a GPS, compass, and head-mounted display. A prototype system was built to support novel applications by drawing graphics (such as maps, building plans, and compass bearings) on the head-mounted display, projecting information over that normally seen by the user and hence augmenting a user's perception of reality. This paper presents a set of novel augmented reality and multimedia applications operated in an outdoor environment.