This work aims to explore the application potential of utilizing the rich medium of olfaction in Immersive Virtual Experiences (IVEs) by engaging a broader range of non-expert users. Considering the inherent properties of scent (e.g., the absence of base odors and storage challenges) and the diverse application demands in IVEs, we introduce OdorCarousel. This design tool encompasses (1) a tiny, lightweight odor-emitting device that integrates with VR headsets and can store 25 distinct aromas. We conducted user-involved technical tests on scent release performance, focusing on identifying odor type, intensity, and transitions. (2) Based on two types of smell interactions in IVEs (active and passive), we devised and implemented three Unreal Engine-based olfactory interaction blueprints and user interfaces facilitating design. A case study illustrates the operation and design process of using OdorCarousel. We recruited 17 participants for a workshop-based user study, successfully executing six concept designs validating the usability and feasibility of OdorCarousel. Finally, we analyzed the design results and the olfactory interaction intentions, discussing the multi-dimensional potential and considerations of smell-enhanced virtual experiences and OdorCarousel, providing design guidance for future works.

To enhance the engagement and significance of olfaction as a novel medium in multimedia systems, we aim to integrate different hedonic odorous cues into narratives to augment immersion in virtual experiences. We introduce the ScentClue system, comprising (1) an original and murder-themed experimental film incorporating four distinct hedonic odor cues synchronized with audiovisual elements, (2) a neck-worn scent delivery device capable of dispensing four different odors, and (3) an Unreal Engine-based virtual cinema environment enabling rapid control of video playback and odor dissemination. Experimenting with 18 participants divided into control groups with and without odor stimuli, we validated the system’s usability and effectiveness of odor cue settings. Furthermore, we found that the use of odors with different hedonic qualities could enhance odor recognition, amplify thematic story ambiance, and aid in the rapid differentiation of complex relationships. Finally, we discussed expanded scenarios and interaction modalities for ScentClue, proposing future narrative-driven olfaction-enhanced multimedia designs with considerations for odor cue settings, odor material selection, and scent-releasing setup, particularly unpleasant odors.

To support children’s food interaction and enhance their understanding of food through morphing food technology, we develop a design exploration through the Research through Design (RtD) methodology. Our exploration integrates four stages: (1) defining design objectives through empathy with stakeholders, (2) investigating morphing food materials to understand their deformation mechanisms, (3) designing and iteratively developing tools based on user feedback, and (4) conducting a workshop-based evaluation. Our design outcome is a toolkit, comprising a morphing food library, trigger tools, and instructional interfaces. The workshop showed that through interaction with morphing food, children learned not only scientific principles but also developed culinary skills, as well as the diversity of food forms and functions. We discussed the detailed findings, insights, and implications for future design.

In this work, we present MorphingScents, a thin-film, five-layer, flexible, shape-changing odor-emitting mechanism that uses Joule heating to drive both scent release and morphological changes, aiming to provide lightweight, intricate, dynamic, and aesthetic olfactory displays and experiences. Based on the direction of scent release and shape change, we propose two fundamental scent release mechanisms: Inward Gathering Release and Outward Dispersing Release. Combining four deformation mechanisms and three multi-scent release methods, we compiled a shape-changing olfactory interfaces library and further provided a detailed design and fabrication pipeline. We conducted a series of technical tests, including relation to heating and deformation angles and olfactory concentration across different areas, thicknesses, and directions of the odor layer. We demonstrated five applications. We conducted a user-involved workshop to validate MorphingScents’s usability and feasibility. Finally, we discuss the potential for expansion, usage precautions, and design iterations of MorphingScents.

To increase the ubiquity and merging of Olfactory Interfaces (OIs) into daily scenarios seamlessly and aesthetically, we propose OlfacKit, a fully integrated pipeline, which consists of (1) an interactive design tool that enables novice users to quickly model the physical forms of OIs and automatically generate fabrication-ready designs; (2) a construction workflow with a series of assembly kits and a video tutorial; (3) a WebUI for rapidly testing and prototyping smell control through Wi-Fi communication. We tested the atomization performance with different voltages and aroma liquids and further guided the implementation of the WebUI. Six applications have been explored, showing the flexibility and scalability of our toolkit. We conducted a workshop to evaluate the feasibility and usability of OlfacKit, involving 15 participants who proposed 108 creative ideas and implemented 13 working prototypes. We reported the detailed findings and discussed the insights and implications for future design.

Existing methods in human-computer interaction to enhance children’s eating habits predominantly rely on digital interactive technologies, which pose the risk of increasing sensory stimulation and diverting children’s attention away from the food itself. Drawing inspiration from shape-changing food research, we propose an approach that combines deformable wafer paper for food preparation. We summarize the principles of wafer paper controllable deformation and develop a toolkit to facilitate its use. We support children in creating personalized, transformable food items using this method, aiming to provide a playful, convenient, and safe food-making experience tailored for children, thereby enhancing children’s mealtime engagement and habits.

Voice user interfaces (VUI) are becoming indispensable in car for offering drivers the opportunity to make distraction-free inputs and conduct complex tasks. However, the usability and control efficiency of today’s VUI remain to be enhanced due to its sequential nature. In this work, we explored gestural input on the steering wheel to improve the interaction efficiency of VUI. Based on limitations in VUI, we designed novel gestural commands on the steering wheel to augment them. We also elicited corresponding user-defined gestures by exploring drivers’ touch behavior. Then, we implemented a prototype attached to the steering wheel for recognizing gestures. Finally, we evaluated our system’s usability regarding driving performance, interaction efficiency, cognitive workload and user feedback. Results revealed that our system improved the control efficiency of VUI and reduced workload without a significant reduction in driving distraction than just using VUI.

Human epidermis, as the largest organ on body, has become a new design platform for wearable computing. The availability of miniature electronics makes more possibilities for on-skin designs. In this paper, we present AnimSkin, a thin-film interface, which will emit dynamic color animations directly on skin. This is done by using thermochromic material embedded with transparent electrode acting as a capacitive sensor. Moreover, an accessible and low-cost fabrication method is introduced. Individuals could also customize aesthetic graphic designs by following the detailed fabrication process to achieve personalized patterns. We propose four different dynamic types of color animation by applying certain voltage to the heating circuitry. With two examples, Email Reminder and Light Control System, we demonstrate how AnimSkin can be integrated into everyday life, and specifically, we show how AnimSkin can benefit areas such as on-skin design, thin-film interface and beauty technology.