In designing for engagement at a public multi-touch installation, we identified supporting multiple users and allowing for gradual discovery as challenges. In this paper, we present Worlds of Information, a multi-touch application featuring 3D Worlds, which provide access to different content. These 3D widgets gradually unfold and allow for temporal navigation of multimedia in parallel, while also providing a 2D plane where media can be shared. We report on a field trial at an exhibition using questionnaires and video ethnography. We studied engagement through questions adapted from Flow, Presence and Intrinsic Motivation questionnaires, which showed that users, overall, had a positive and social experience with the installation. The worlds effectively invited multiple users and provided for parallel interaction. While functionality was discovered gradually through social learning, the study demonstrates the challenges of designing multi-touch applications for walk-up-and-use displays.

We present findings from field trials of MapLens, a mobile augmented reality (AR) map using a magic lens over a paper map. Twenty-six participants used MapLens to play a location-based game in a city centre. Comparisons to a group of 11 users with a standard 2D mobile map uncover phenomena that arise uniquely when interacting with AR features in the wild. The main finding is that AR features facilitate place-making by creating a constant need for referencing to the physical, and in that it allows for ease of bodily configurations for the group, encourages establishment of common ground, and thereby invites discussion, negotiation and public problem-solving. The main potential of AR maps lies in their use as a collaborative tool.

The fundamental nature of grocery shopping makes it an interesting domain for intelligent mobile assistants. Even though the central role of shopping lists is widely recognized, relatively little attention has been paid to facilitating shopping list creation and management. In this paper we introduce a predictive text input technique that is based on association rules and item frequencies. We also describe an interface design for integrating the predictive text input with a web-based mobile shopping assistant. In a user study we compared two interfaces, one with text input support and one without. Our results indicate that, even though shopping list entries are typically short, our technique makes text input significantly faster, decreases typing error rates and increases overall user satisfaction.

We present data from detailed observations of CityWall, a large multi-touch display installed in a central location in Helsinki, Finland. During eight days of installation, 1199 persons interacted with the system in various social configurations. Videos of these encounters were examined qualitatively as well as quantitatively based on human coding of events. The data convey phenomena that arise uniquely in public use: crowding, massively parallel interaction, teamwork, games, negotiations of transitions and handovers, conflict management, gestures and overt remarks to co-present people, and "marking" the display for others. We analyze how public availability is achieved through social learning and negotiation, why interaction becomes performative and, finally, how the display restructures the public space. The multi-touch feature, gesture-based interaction, and the physical display size contributed differentially to these uses. Our findings on the social organization of the use of public displays can be useful for designing such systems for urban environments.

In this paper we describe modifications to a natural language grocery retrieval system, introduced in our earlier work. We also compare our system against an off-the-shelf retrieval tool, and show that our system is significantly better for top-ranked retrieval results.

Most large public displays have been used for providing information to passers-by with the primary purpose of acting as one-way information channels to individual users. We have developed a large public display to which users can send their own media content using mobile devices. The display supports multi-touch interaction, thus enabling collaborative use of the display. This display called CityWall was set up in a city center with the goal of showing information of events happening in the city. We observed two user groups who used mobile phones with upload capability during two large-scale events happening in the city. Our findings are that this kind of combined use of personal mobile devices and a large public display as a publishing forum, used collaboratively with other users, creates a unique setting that extends the group's feeling of participation in the events. We substantiate this claim with examples from user data.