Current smart home technologies rely on touchscreens and voice assistants for interaction. These interfaces lack tactile engagement and fail to support users’ daily routines and preferences, leading to poor user experiences (UX). Designing tangible user interfaces (TUIs) that align with user preferences can improve the status quo. This paper explores the potential of TUIs using everyday objects for smart home control. Four prototypes — a vase, pillow, coaster, and flower — were evaluated for UX and metaphor alignment through a within-subjects study with 25 participants. Using meCUE questionnaires and semi-structured interviews, we examined how physical and contextual attributes influence UX. Our findings indicate that everyday objects are effective TUI and produce positive UX, provided careful consideration is given to their physical and contextual attributes. This research expands our understanding of TUIs’ role in bridging the digital-physical divide and offers practical guidelines for embedding intuitive smart home controls into everyday objects.

Smart home appliances are becoming more popular, yet their user interfaces (UI) often lack integration into living spaces and daily practices. To facilitate more natural interactions, reduce clutter and promote better integration in our living spaces, we propose embedding controls into everyday objects. This paper outlines our approach in three steps: identifying suitable household objects through ethnographic research, gathering interaction ideas via user gesture elicitation, and evaluating the intuitiveness of conceptual interfaces through a Wizard-of-Oz study. Our findings suggest that an object's primary function has less influence on its potential as a smart home controller. Instead, its location, physical characteristics, and intuitive affordances play a more significant role in shaping its potential. Designers should, therefore, focus on making these affordances easily discoverable by concurrently considering the object's physical properties, function, and interaction context.

In today’s rapidly evolving technological landscape, the convergence of innovation and tradition has given rise to a fundamental question: Can we embrace the convenience of smart devices without sacrificing the aesthetics and emotional resonance of our cherished everyday objects? We help answer this question through our demo, Vasi-Light, a decorative vase enhanced with concealed sensors and conductive ink to allow end-users to control a smart bulb. Vasi-Light seeks to blend the beauty of familiar household items with the intelligence of modern technology. While a smart bulb and vase are used in the demo, the design process and technologies apply to various everyday object/smart appliance pairings and offer exciting opportunities for research into rich interactions with everyday objects and surfaces for future smart homes.

Conducting gesture elicitation studies (GES) in personal spaces such as smart homes is crucial to achieving high ecological validity of elicited gestures. However, supervising such studies is considered intrusive and negatively affects the results' quality. The alternative is to conduct unsupervised GES under similar conditions, but more side-by-side comparisons documenting the similarities and differences between both approaches are necessary. Consequently, we need more data describing the preferred approach and whether the differences or similarities in the results are so significant to cause concern. This research distributed a DIY observation kit, which 30 participants assembled and used to propose gestures for controlling elements in a smart living room using a pillow's surface, with and without supervision. Our results show that gestures from supervised and unsupervised studies differ in quantity and max-consensus but not in gesture Agreement Scores. Our results also show that participants preferred conducting unsupervised studies but proposed fewer gesture sets in this condition.

For an improved user experience in smart homes, there is a need to enhance the current interaction methods by embedding control interfaces in everyday household objects. Embedded interfaces will allow smart home inhabitants to control their surroundings using more familiar interaction concepts and techniques than those imposed by appliance manufacturers and vendors. However, to achieve this state, technology designers need to understand the behaviours and attitudes of end users when they interact with different elements of a smart home using everyday objects as control media. We present a set of exploratory investigations focused on understanding the behaviours and attitudes of end-users as they control elements of a fictional smart home. Accordingly, we investigate how two highly different locations and form factors -- a table surface and a couch pillow -- impact user expectations about gestures used to control various smart home features. To this end, we conducted explorative elicitation with 14 participants. Our results highlight that an object's physicality significantly impacts the types of gestures users perceive as intuitive and that deforming an interface has the potential to bring playfulness to interaction. Following our observations, we formulated four design implications for conceiving interaction modalities with deformable interfaces for domestic environments.

The need for remote usability testing has increased during the ongoing COVID-19 global pandemic. However, lockdown and physical distancing regulations have affected how HCI researchers conduct in-person tests of systems and technologies under design. We present a Pop-Up Observation Kit, which serves as an affordable mobile usability lab. The kit is sent to participants of a study alongside the system they are testing. The Pop-Up Observation Kit provides a simple, unobtrusive form factor that enables the study participant to concentrate on the task itself and not on documenting the task they are performing. While initially developed to observe hand and finger gestures on a pressure sensor mat for the Rich Interactive Materials for everyday objects project, the Pop-up Observation Kit also applies to other use cases. Additionally, the kit is extensible with additional functionalities combined with the sensor mat to enable better data collection or unmoderated remote observations.