Generative AI technologies are reshaping everyday environments by enabling multimodal interaction. As their ubiquity and agentic capacities grow, there is a pressing need to understand how these systems reshape human–computer interaction in relational, social, and systemic terms. We introduce a scenario-based design pack for investigating Human–GenAI relations. Grounded in assemblage theory and structured around a three-stage process—Prepare, Make, Reflect—the pack supports the prototyping, analysis, and critical reflection of emergent sociotechnical configurations. We evaluated the pack across three deployments: an ACM workshop (n=22), a multidisciplinary design session (n=20), and a university HCI class (n=260). Participants generated scenarios that surfaced relational issues of power, agency, visibility, and care. We contribute the design pack alongside an exploratory framework to advance relational enquiry into multimodal Human–GenAI relations, support more inclusive and socially responsive GenAI practices, and complement FATE approaches by grounding fairness, accountability, and transparency in lived, multimodal configurations.

1. Within HCI, there appears to be an interest in the human-computer integration paradigm (Farooq & Grudin, 2016; Grudin et al., 2018; Mueller et al., 2020), wherein computer and user form a close ...

Cycling Human-Computer Interaction (CyclingHCI) refers to the study and design of user interfaces and interactions between bicycles and riders in the context of cycling-related experiences. To date, however, there has yet to be a structured agenda for CyclingHCI to clarify the immediate challenges researchers should address next and facilitate the advancement of the field. We, three CyclingHCI researchers who collectively designed, developed, evaluated 18 CyclingHCI projects, reflected on our experiences to derive 10 grand challenges that we articulate with design opportunities and considerations grouped into: (1) Pushing the technological boundaries for cycling, (2) Understanding and protecting cyclists, and (3) Spatially situated cycling interaction. Our findings provide practical implications for research and practice in CyclingHCI, with which we aim to enrich the cycling experience through the safe integration of technology.

Achieving effective collaboration and trust has been shown to be harder for virtual vs. in-person teams. Related work has confirmed that introductions are a key mechanism to form trust in newly-formed teams. The rise of remote work necessitated by the COVID-19 pandemic highlighted the need for accelerating the development of effective collaboration in virtual teams. In response to this need, based on the research around introductions and trust in team settings, we have developed a novel approach for virtual introductions. This is what we term as asynchronous, semi-guided, professional introductions. Participants pre-record an introduction that uses a set of professionally-focused questions and watch these introductions prior to the meeting. Our study examines the impact of these introductions on virtual teams in three conditions: video, text, and no introduction. In this study, we used the Team Diagnostic Survey post-task completion to assess team effectiveness and interpersonal processes of 28 dyads. Thematic coding was used to collect dyads’ experience and engagement. The introduction conditions demonstrated significantly improved collaboration, effectiveness, and engagement amongst participants. Notably, the video condition was particularly well-received by participants and resulted in higher levels of engagement and effectiveness compared to the text and no introduction conditions. Ultimately, the use of these introductions led to a marked increase in trust and collaboration amongst participants. We reflect on the effects of this finding in the mainstream and propose further research to support newly-formed virtual dyadic teams to increase team effectiveness. This study contributes to the existing literature by introducing a novel asynchronous, semi-guided approach to virtual dyadic team introductions, offering insights crucial for contemporary remote work dynamics.

Spectating digital games can be exciting. However, due to its vicarious nature, spectators often wish to engage in the gameplay beyond just watching and cheering. To blur the boundaries between spectators and players, we propose a novel approach called "Fused Spectatorship", where spectators watch their hands play games by loaning bodily control to a computational Electrical Muscle Stimulation (EMS) system. To showcase this concept, we designed three games where spectators loan control over both their hands to the EMS system and watch them play these competitive and collaborative games. A study with 12 participants suggested that participants could not distinguish if they were watching their hands play, or if they were playing the games themselves. We used our results to articulate four spectator experience themes and four fused spectator types, the behaviours they elicited and offer one design consideration to support each of these behaviours. We also discuss the ethical design considerations of our approach to help game designers create future fused spectatorship experiences.

Ingestible sensors have become smaller and more powerful and allow us to envisage new human-computer interactions and bodily play experiences inside our bodies. Users can swallow ingestible sensors, which facilitate interior body sensing functions that provide data on which play experiences can be built. We call bodily play that uses ingestible sensors as play technologies “ingestible play”, and we have adopted a research-through-design (RtD) approach to investigate three prototypes. For each prototype, we conducted a field study to understand the player experiences. Based upon these results and practical design experiences, we have developed a design framework for ingestible play. We hope this work can guide the future design of ingestible play; inspire the design of play technologies inside the human body to expand the current bodily play design space; and ultimately extend our understanding of how to design for the human body by considering the bodily experience of one’s interior body.

Human–computer integration is an HCI trend in which computational machines can have agency, i.e., take control. Our work focuses on a particular form of integration in which the user and the computational machine share agency over the user's body, that is, can simultaneously (in contrast to a traditional turn-taking approach) control the user's body. The result is a user experience where the agency of the user and the computational machine is so intertwined that it is often no more discernable who contributed what to what extent; we call this “intertwined integration”. Due to the recency of advanced technologies enabling intertwined integration systems, we find that little understanding and documented design knowledge exist. To begin constructing such an understanding, we use three case studies to propose two key dimensions (“awareness of machine's agency” and “alignment of machine's agency”) to articulate a design space for intertwined integration systems. We differentiate four roles that computational machines can assume in this design space (angel, butler, influencer, and adversary). Based on our craft knowledge gained through designing such intertwined integration systems, we discuss strategies to help designers create future systems. Ultimately, we aim at advancing the HCI field's emerging understanding of sharing agency.

In recognition of food's significant experiential pleasures, culinary practitioners and designers are increasingly exploring novel combinations of computing technologies and food. However, despite much creative endeavors, proposals and prototypes have so far largely maintained a traditional divide, treating food and technology as separate entities. In contrast, we present a “Research through Design” exploration of the notion of food as computational artifact: wherein food itself is the material of computation. We describe the Logic Bonbon, a dessert that can hydrodynamically regulate its flavor via a fluidic logic system. Through a study of experiencing the Logic Bonbon and reflection on our design practice, we offer a provisional account of how food as computational artifact can mediate new interactions through a novel approach to food-computation integration, that promotes an enriched future of Human-Food Interaction.

Human–computer interaction (HCI) is increasingly interested in supporting exertion experiences so more people can benefit from physical activity. So far, most systems have focused on sensing and presenting information to the user via screens to support the exertion experience. Interestingly, emerging technology can also act on the exerting user's body based on sensed information, granting researchers the potential to develop technology that not only “presents” but also “acts” on information throughout an integrated exertion experience. As a result, design opportunities surrounding computing machinery as contextually aware exertion partners are now available. However, there are currently no frameworks to guide the design of human–computer integration in an exertion context. To contribute to closing this gap, we designed three eBike systems to investigate different forms of integration with the exerting user and we studied the resulting user experiences. Based on the results of these three case studies, we present the first framework, including associated design tactics, to offer guidance on how to design human–computer integration in an exertion context.

Interest in combining interactive play and the human body, using “bodily play” systems, is increasing. While these systems primarily prioritize a player's control over their bodily actions, we see intriguing possibilities in the pursuit of “limited control over the body” as an intriguing design resource for bodily play systems. In this paper, we use three of our bodily play systems to illustrate how designers can engage with limited control over the body by varying the player's degree of indirect control (for instance, via other bodily activity and external triggers). We also propose four strategies for employing limited control over the body: Exploration, Reflection, Learning and Embracement. We hope our own work and the strategies developed from it will assist designers to employ limited control over the body, ultimately helping people benefit from engaging their bodies through play.

Ground-truth labeling is an important activity in machine learning. Many studies have examined how crowdworkers apply labels to records in machine learning datasets. However, there have been few studies that have examined the work of domain experts when their knowledge and expertise are needed to apply labels.

Data science (DS) projects often follow a lifecycle that consists of laborious tasks for data scientists and domain experts (e.g., data exploration, model training, etc.). Only till recently, machine learning(ML) researchers have developed promising automation techniques to aid data workers in these tasks. This paper introduces AutoDS, an automated machine learning (AutoML) system that aims to leverage the latest ML automation techniques to support data science projects. Data workers only need to upload their dataset, then the system can automatically suggest ML configurations, preprocess data, select algorithm, and train the model. These suggestions are presented to the user via a web-based graphical user interface and a notebook-based programming user interface. Our goal is to offer a systematic investigation of user interaction and perceptions of using an AutoDS system in solving a data science task. We studied AutoDS with 30 professional data scientists, where one group used AutoDS, and the other did not, to complete a data science project. As expected, AutoDS improves productivity; Yet surprisingly, we find that the models produced by the AutoDS group have higher quality and less errors, but lower human confidence scores. We reflect on the findings by presenting design implications for incorporating automation techniques into human work in the data science lifecycle.

Human labeling of training data is often a time-consuming, expensive part of machine learning. In this paper, we study "batch labeling", an AI-assisted UX paradigm, that aids data labelers by allowing a single labeling action to apply to multiple records. We ran a large scale study on Mechanical Turk with 156 participants to investigate labeler-AI-batching system interaction. We investigate the efficacy of the system when compared to a single-item labeling interface (i.e., labeling one record at-a-time), and evaluate the impact of batch labeling on accuracy and time. We further investigate the impact of AI algorithm quality and its effects on the labelers' overreliance, as well as potential mechanisms for mitigating it. Our work offers implications for the design of batch labeling systems and for work practices focusing on labeler-AI-batching system interaction.

In this work we introduce peripheral awareness as a neurological state for real-time human-computer integration, where the human is assisted by a computer to interact with the world. Changes to the field of view in peripheral awareness have been linked with quality of human performance. This instinctive narrowing of vision that occurs as a threat is perceived has implications in activities that benefit from the user having a wide field of view, such as cycling to navigate the environment. We present "Ena", a novel EEG-eBike system that draws from the user's neural activity to determine when the user is in a state of peripheral awareness to regulate engine support. A study with 20 participants revealed various themes and tactics suggesting that peripheral awareness as a neurological state is viable to align human-machine integration with internal bodily processes. Ena suggests that our work facilitates a safe and enjoyable human-computer integration experience.

The subjective experience of emotion is notoriously difficult to interpersonally communicate. We believe that technology can challenge this notion through the design of neuroresponsive systems for interpersonal communication. We explore this through "Neo-Noumena", a communicative neuroresponsive system that uses brain-computer interfacing and artificial intelligence to read one's emotional states and dynamically represent them to others in mixed reality through two head-mounted displays. In our study five participant pairs were given Neo-Noumena for three days, using the system freely. Measures of emotional competence demonstrated a statistically significant increase in participants' ability to interpersonally regulate emotions. Furthermore, participant interviews revealed themes regarding Spatiotemporal Actualization, Objective Representation, and Preternatural Transmission. We also suggest design strategies for future augmented emotion communication systems. We intend that work gives guidance towards a future in which our ability to interpersonally communicate emotion is augmented beyond traditional experience.

Artificial Intelligence (AI) can now automate the algorithm selection, feature engineering, and hyperparameter tuning steps in a machine learning workflow. Commonly known as AutoML or AutoAI, these technologies aim to relieve data scientists from the tedious manual work. However, today's AutoAI systems often present only limited to no information about the process of how they select and generate model results. Thus, users often do not understand the process, neither do they trust the outputs. In this short paper, we provide a first user evaluation by 10 data scientists of an experimental system, AutoAIViz, that aims to visualize AutoAI's model generation process. We find that the proposed system helps users to complete the data science tasks, and increases their understanding, toward the goal of increasing trust in the AutoAI system.

Inbodied interaction is an emerging area in HCI that aligns how the body performs internally with our designs to support and optimise human performance. Inbodied Interaction therefore relies on knowledge of our physiology/neurology/kinesiology etc, to blend with HCI methodology. Recent, Inbodied Interaction workshops and summer schools, have been designed to share models of these processes to accelerate access to these areas of specialisation for HCI researchers. As such this one-day-hands-on-studio presents an extension of this work - an Inbodied interaction framework - to (1) make inbodied sciences accessible and (2) usable for HCI practitioners when it comes to crafting experiences, whether for health, performance or play. Our framework also offers a design alternative to cyborging futures that seek to augment human performance, Inbodied Interaction seeks to help discover and optimise human potential. As such, in this studio, we will explore where inbodied interaction fits in the narrative of our future bodies.

There is an increasing trend in utilizing interactive technology for bodily integrations, such as additional limbs and ingestibles. Prior work on bodily integrated systems mostly examined them from a productivity perspective. In this article, we suggest examining this trend also from an experiential, playful perspective, as we believe that these systems offer novel opportunities to engage the human body through play. Hence, we propose that there is an opportunity to design "bodily integrated play". By relating to our own and other's work, we present an initial set of design strategies for bodily integrated play, aiming to inform designers on how they can engage with such systems to facilitate playful experiences, so that ultimately, people will profit from bodily play's many physical and mental wellbeing benefits even in a future where machine and human converge.

Bodily play systems are becoming increasingly prevalent, with research aiming to understand the associated player experience. We argue that a more nuanced lexicon describing "bodily play experience" can be beneficial to drive the field forward. We provide game designers with two German words to communicate two different aspects of experience: "Erfahrung", referring to experience where one is actively engaged in and gains knowledge from; and "Erlebnis", referring to a tacit experience often translated as "lived experience". We use these words to articulate a suite of design strategies for bodily play experiences by referring to past design work. We conclude by discussing these two aspects of experience in conjunction with two previously established perspectives on the human body. We believe this more nuanced lexicon can provide a clearer understanding for designers about bodily play allowing them to guide players in gaining the many benefits from such experiences.

Researchers are increasingly exploring interactive technology supporting human-system partnership in an exertion context, such as cycling. So far, most investigations have supported the rider cognitively, by the system "sensing and presenting" information to assist the rider to make informed decisions. In contrast, we propose systems that promote user-system co-operation, by "sensing and acting" on information to assist the rider, not only "cognitively" but also "physically", with the aim of facilitating user-system co-operation in an exertion context. Our prototype, "Ari", is a novel augmented eBike designed to facilitate user-system co-operation, where the information that each party can sense is used in regulating the speed to cross all traffic lights on green. A study with 20 bike riders resulted in five themes and six design tactics to further the design of interactive systems at the intersection of human-computer integration in an exertion context, thereby facilitating user-system co-operation to augment the exertion experience.

Games research in HCI is continually interested in the human body. However, recent work suggests that the field has only begun to understand how to design bodily games. We propose that the games research field is advancing from playing with digital content using a keyboard, to using bodies to play with digital content, towards a future where we experience our bodies as digital play. To guide designers interested in supporting players to experience their bodies as play, we present two phenomenological perspectives on the human body (Körper and Leib) and articulate a suite of design tactics using our own and other people's work. We hope with this paper, we are able to help designers embrace the point that we both "have" a body and "are" a body, thereby aiding the facilitation of the many benefits of engaging the human body through games and play, and ultimately contributing to a more humanized technological future.

Sports fans are increasingly using social media platforms like Twitter to express emotions and share their opinions while watching sports on TV. These commentaries describe a intense subjective experience of a fan watching a sport passionately. We see an opportunity to attend to these nostalgic moments by capturing them into a physical form. We present, Fantibles, personalized sports memorabilia that highlights an individual's commentary about sports on Twitter along with the uniqueness of each sports match. As a first case study, we investigate Fantibles for one popular sport, Cricket. We report insights from field deployments of Fantibles during an ODI Cricket match series between India and Bangladesh and offer reflections on the design in the form of four themes: self-expression, layered sense making, ad-hoc interactions and distributed social interactions. We believe our work opens up new interaction possibilities to support social sports viewing experience and design thinking on creating personalized sports memorabilia.