Collaborative games, played across multiple co-located mobile devices are gaining popularity because of their location flexibility, low hardware requirements, players’ close proximity, and their promise of generating excitement and collaborative social experience. Even though the integration of spatial device rearrangement (i.e., physically picking up a device and positioning it in another location) in cross-device applications in other domains has demonstrated higher potential for collaboration, this form of interaction remains relatively unexplored in ad hoc cross-device gaming applications. That is because these interactions typically require additional hardware support, which can hinder the ad hoc nature of the cross-device social games. In this paper, we present the iterative user-centred design process of creating an ad hoc co-located cross-device maze exploration game named Snap-To-Eat that supports both on-screen cross-device interactions (e.g., moving elements across devices) and spatial device rearrangement interactions without requiring any additional hardware. We refined the game design by conducting two rounds of workshops, the first with a low-fidelity paper prototype and the second with a high-fidelity digital prototype, with 36 undergraduate and graduate students in total. Findings from both workshops demonstrated that integrating spatial device rearrangement interactions in an ad hoc co-located cross-device game created opportunities for collaboration and engagement among the players, which elevated their overall social experience. These findings also suggested new design opportunities and future research directions for ad hoc collocated cross-device games, e.g., introducing new interactions, as well as exploring the game mechanics in a 3D space to elevate the gaming experience.

Computer-aided simulation-based platforms have been shown to be effective tools for teaching STEM concepts. At the same time, Computer Supported Collaborative Learning (CSCL) platforms encourage different viewpoints and approaches from the learners which can enrich the learning experience in STEM classrooms. The deployment in recent years of networked personal devices such as Chromebooks in classrooms has motivated educators to design collaborative learning tools for these devices. However, prior work has shown that using one-on-one devices may discourage students from talking among each other, which hinders collaboration. To understand the affordances of personal devices for CSCL tools within Biology curricula, we designed a collaborative plant growth simulation application that provides mirrored plant growth simulation views for every group member to facilitate a common visualization. In this paper, we present our findings from an in-the-wild study that evaluated the affordance and usability of the plant growth simulation application and investigated the nature of collaboration and engagement aided through the simulation mirroring feature. Our study results showed that the plant simulation application had high usability and acceptance. Moreover, mirroring the plant growth simulation improved collaboration, generated excitement, and stimulated conversation. We also identified episodes where collaboration was hindered due to off-task activities, troubleshooting, group dynamics, and lack of understanding that led us to outline some potential guidelines to improve the collaborative learning experience for the students in Biology classroom.

Creating effective middle school STEM curricula requires a combination of individual and collaborative learning. Prior studies showed that finding a proper balance and providing uninterrupted knowledge transmission between different learning modes can be challenging in such mixed pedagogical approaches. In this paper, we present a multi-device interactive educational platform named SimSnap to teach biology curriculum to middle school children. SimSnap facilitates interactions among touchscreen Chromebooks to perform in-class individual and group activities. We present a usability analysis study with eight middle school children where they learn about the influence of temperature on tomato plant growth. Our study demonstrated that SimSnap facilitates group discussions to complete collaborative tasks. It also creates seamless knowledge propagation between prior to current tasks to learn about more complex concepts from previous simpler activities. Middle school children gave overall high usability ratings and positive feedback on SimSnap. This study also helped to outline some design recommendations for future improvements of SimSnap.

We present two proof-of-concept narrative VR experiences with a focus on sound-based physical interactions. Responding to a call to expand upon current design conceptualizations, we draw on tangible sound-based design in order to develop considerations for the body and physical environments within VR narratives. We propose that a focus on the actions the player is asked to perform (e.g., touch, stand, kneel, grasp, walk, listen, reach, dance) can contribute to an understanding of VR as a sensory, embodied medium that offers ways to playfully engage with physical reality rather than simulate it entirely.

We present two proof of concept experiences for a virtual reality (VR) game that draws on several medium-specific qualities of mobile, location-based, and tangible storytelling. In contemporary smartphone-VR, experiences are limited by short playtimes, limited interactions, and limited movement within a physical space. To address these limitations, we suggest a reconceptualization of smartphone-VR. Rather than design that deems the smartphone the least capable VR platform, we propose design that adds VR to an already rich mobile storytelling platform. We argue that by drawing on otherwise separate storytelling media, designers can circumvent limitations related to smartphone-VR while also extending the range of smartphone-based storytelling. We conclude by reflecting on possible implications of this extended design space.

Advances in biology and computational power have led to the availability of large biological data sets, yet these advances raise new design challenges. Designers must build effective tools that cater to the needs of biologists and data scientists in order to visually explore and manipulate data for modeling and analysis. We present the Tangible Tensors system, a new tensor-based visualization and tangible manipulation tool that serves to improve functionality over previous data analytics approaches. We designed a platform that supports iterative exploration of the solution space and better interpretation tools for biologists. User study results indicate that our system is easy to learn and use, and useful for data modeling and analysis tasks.

We present a system for diegetic tangible objects in virtual reality (VR) narratives. The system integrates a custom-designed sensor unit, built with low-cost off-the-shelf hardware, to track objects in VR and to support a variety of custom-made and found tangibles. In its current form, the sensor unit tracks the objects' orientation and supports the authoring of specifically designed interactions for each tangible object. We contribute our design rationale, sensor unit, and four proof of concept prototypes, including a cube, a stuffed animal, a treasure chest, and a wooden boat, demonstrating how we leverage passive and active haptics to create a closer link between real and virtual worlds. For developers and users of VR, we expand interaction possibilities to include the physical characteristics of tangible objects. For the field of tangible narratives, we expand the current use of diegetic objects.

TEI researchers/designers are often discouraged from building complex interactive environments by the requirement of high technical knowledge. In this studio/workshop, we present the ROSS Toolkit that offers tools to abstract/automate low-level programming of technical details, thereby simplifying the design and programming of interactions between heterogeneous networked devices. Participants will be first introduced to the toolkit functionality to cope with different technical issues. In a second part, they will experiment with the toolkit by developing use cases of increasing complexity that will involve off-the-shelf devices, interactive surfaces, and custom-made tangible artifacts. We expect participants to learn what are the opportunities and challenges for the development of responsive and interactive environments.

Stacking physical documents is one of the main forms of spatio-temporal organization of information. We present DisplayStacks, a system that enables physical stacking of digital documents via piles of flexible E Ink displays. With a conductive dot pattern sensor attached to the flexible display, we dynamically track the position and orientation of these displays in relation to one another. We introduce mechanisms for interacting with these physical stacks for access and manipulation of information using asymmetric bi-manual interactions, such as providing contextual overviews. Initial user experiences indicate a preference for linear overlaps as a stacking configuration.

Interest in flexible and non-planar devices has put a spotlight on flexible circuits, a technology that has been around for more than forty years. This Studio will introduce the prototyping of flexible electronic circuits at a low cost. The participants will be participating in brainstorming an interesting electronic project, designing circuit layout for it, etching and building functional flexible circuits.