Existing approaches to combat the opacity of large language models tend to centre around post-hoc explanations of model processes. We explore an alternative approach to fostering critical understanding through intuitive, experience-driven exploration of an LLM’s inner workings. Toward that end, we present “Stepping Into the Black Box” (SIBB): a critical artefact which enables participants to “see like an LLM” and take on an active role in its generative process. Through the box, pairs of participants enact a dynamic interaction with a chatbot presented as a local expert. Participants are invited to intervene in its algorithmic decisions, building responses in tandem with the model. Their interactions and reflections speak to the kinds of criticality developed by experiential learning, highlighting the particular ways that exploring an enclosed system from within affects trust. In this way, SIBB demonstrates the potential of collaborative, experiential research-through-design practices to foster community understanding of emerging technologies.

The rapid expansion of the AI industry relies heavily on the production, verification, and maintenance of data, otherwise known as "data work". Companies outsource and offshore this work through global AI supply chains that operate under exploitative conditions. Drawing on semi-structured interviews with Kenyan data workers across platforms and BPOs, this paper examines how such conditions take shape and persist. We argue that workers are caught within a regime of entrapment, a system of interconnected mechanisms that make it difficult for workers to leave or improve their positions. These mechanisms include the push to invest in the promise of ‘AI’ jobs, the use of precarious contracts to govern workers, the capture of regulatory institutions, and the exploitation of global labor arbitrage. Using complementary lenses of neoliberal governmentality, precarity, and supply chain capitalism, we analyze why labor mobilization in this sector remains uniquely constrained. We conclude by outlining an orientation for research and scholarly practice that can support workers’ organizing efforts and contest the structural conditions sustaining this regime.

Vinodkumar Prabhakaran, Christopher Homan, Lora Aroyo, Aida Mostafazadeh Davani, Alicia Parrish, Alex Taylor, Mark Diaz, Ding Wang, Gregory Serapio-García. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2024.

In this paper, we examine the work of data annotation. Specifically, we focus on the role of counting or quantification in organising annotation work. Based on an ethnographic study of data annotation in two outsourcing centres in India, we observe that counting practices and its associated logics are an integral part of day-to-day annotation activities. In particular, we call attention to the presumption of total countability observed in annotation - the notion that everything, from tasks, datasets and deliverables, to workers, work time, quality and performance, can be managed by applying the logics of counting. To examine this, we draw on sociological and socio-technical scholarship on quantification and develop the lens of a 'regime of counting' that makes explicit the specific counts, practices, actors and structures that underpin the pervasive counting in annotation. We find that within the AI supply chain and data work, counting regimes aid the assertion of authority by the AI clients (also called requesters) over annotation processes, constituting them as reductive, standardised, and homogenous. We illustrate how this has implications for i) how annotation work and workers get valued, ii) the role human discretion plays in annotation, and iii) broader efforts to introduce accountable and more just practices in AI. Through these implications, we illustrate the limits of operating within the logic of total countability. Instead, we argue for a view of counting as partial - located in distinct geographies, shaped by specific interests and accountable in only limited ways. This, we propose, sets the stage for a fundamentally different orientation to counting and what counts in data annotation.

This article considers how subjectivities are enlivened in algorithmic systems. We first review related literature to clarify how we see “subjectivities” as emerging through a tangled web of processes and actors. We then offer two case studies exemplifying the emergence of algorithmic subjectivities: one involving computational topic modeling of blogs written by parents with children on the autism spectrum and one involving algorithmic moderation of social media content. Drawing on these case studies, we then articulate a series of qualities that characterizes algorithmic subjectivities. We also compare and contrast these qualities with a number of related concepts from prior literature to articulate how algorithmic subjectivities constitute a novel theoretical contribution, as well as how it offers a focal lens for future empirical investigation and for design. In short, this article points out how certain worlds are being made and/or being made possible via algorithmic systems, and it asks Human–Computer Interaction (HCI) to consider what other worlds might be possible.

Diversity in datasets is a key component to building responsible AI/ML. Despite this recognition, we know little about the diversity among the annotators involved in data production. We investigated the approaches to annotator diversity through 16 semi-structured interviews and a survey with 44 AI/ML practitioners. While practitioners described nuanced understandings of annotator diversity, they rarely designed dataset production to account for diversity in the annotation process. The lack of action was explained through operational barriers: from the lack of visibility in the annotator hiring process, to the conceptual difficulty in incorporating worker diversity. We argue that such operational barriers and the widespread resistance to accommodating annotator diversity surface a prevailing logic in data practices—where neutrality, objectivity and ‘representationalist thinking’ dominate. By understanding this logic to be part of a regime of existence, we explore alternative ways of accounting for annotator subjectivity and diversity in data practices.

Machine learning approaches often require training and evaluation datasets with a clear separation between positive and negative examples. This requirement overly simplifies the natural subjectivity present in many tasks, and obscures the inherent diversity in human perceptions and opinions about many content items. Preserving the variance in content and diversity in human perceptions in datasets is often quite expensive and laborious. This is especially troubling when building safety datasets for conversational AI systems, as safety is socio-culturally situated in this context. To demonstrate this crucial aspect of conversational AI safety, and to facilitate in-depth model performance analyses, we introduce the DICES (Diversity In Conversational AI Evaluation for Safety) dataset that contains fine-grained demographics information about raters, high replication of ratings per item to ensure statistical power for analyses, and encodes rater votes as distributions across different demographics to allow for in-depth explorations of different aggregation strategies. The DICES dataset enables the observation and measurement of variance, ambiguity, and diversity in the context of safety for conversational AI. We further describe a set of metrics that show how rater diversity influences safety perception across different geographic regions, ethnicity groups, age groups, and genders. The goal of the DICES dataset is to be used as a shared resource and benchmark that respects diverse perspectives during safety evaluation of conversational AI systems.

Why is the solution the end point to a problem? While many in HCI and design have examined the impulse to solve problems–the solutionist or techno-solutionist mindset–we examine the logic that binds the solution and the problem together as a pair. Focusing on the timely and consequential problem of systemic racial injustice, we think through the paradoxical possibility that the pairing of the problem and solution (so often treated as the default in design and HCI) perpetuates the very conditions we seek to improve. With Calvin Warren’s profound Afro-pessimism, we recognize how the tools used to solve structural inequities around Black life are constructed with inequities themselves. The problem-solution, therefore, is a dead end. We use this paradox as an invitation to rethink ongoing efforts to seek equity and justice more broadly, setting out a fragile but hopeful path for HCI and design.

Opportunities for AI and machine learning (ML) are vast in current interactive systems development. However, comparatively little is known about how functionality for the system behind the interface is designed and how design methodologies such as user-centered design have influence. This research focuses on how interdisciplinary teams that include UX practitioners design real-world enterprise ML systems outside of big technology companies. We conducted a survey with product managers, and interviews with interdisciplinary teams and individual UX practitioners. The findings show that nontechnical UX practitioners are highly capable in designing AI/ML systems. In addition to applying UX and interaction design expertise to make decisions regarding functionality, they employ skills that aid collaboration across interdisciplinary teams. However, our findings suggest existing HCI design techniques such as prototyping and simulating complexity of enterprise ML systems are insufficient. We propose adaptations to design practices and conclude that some existing research should be reconsidered.

The relationships that constitute the global industrial food system tend towards two dominant values that are creating unsustainable social and environmental inequalities. The first is a human-centered perspective on food that privileges humans over all other species. The second is a view of food as a commodity to be traded for maximum economic value, rewarding a small number of shareholders. We present work that explores the unique algorithmic affordances of blockchain to create new types of value exchange and governance in the food system. We describe a project that used roleplay with urban agricultural communities to co-design blockchain-based food futures and explore the conditions for creating a thriving multispecies food commons. We discuss how the project helped rethink algorithmic food justice by reconfiguring more-than-human values and reconfiguring food as more-than-human commons. We also discuss some of the challenges and tensions arising from these explorations.

AI technologies are often used to aid people in performing discrete tasks with well-defined goals (e.g., recognising faces in images). Emerging technologies that provide continuous, real-time information enable more open-ended AI experiences. In partnership with a blind child, we explore the challenges and opportunities of designing human-AI interaction for a system intended to support social sensemaking. Adopting a research-through-design perspective, we reflect upon working with the uncertain capabilities of AI systems in the design of this experience. We contribute: (i) a concrete example of an open-ended AI system that enabled a blind child to extend his own capabilities; (ii) an illustration of the delta between imagined and actual use, highlighting how capabilities derive from the human-AI interaction and not the AI system alone; and (iii) a discussion of design choices to craft an ongoing human-AI interaction that addresses the challenge of uncertain outputs of AI systems.

Prior work on AI-enabled assistive technology (AT) for people with visual impairments (VI) has treated navigation largely as an independent activity. Consequently, much effort has focused on providing individual users with wayfinding details about the environment, including information on distances, proximity, obstacles, and landmarks. However, independence is also achieved by people with VI through interacting with others, such as in collaboration with sighted guides. Drawing on the concept of interdependence, this research presents a systematic analysis of sighted guiding partnerships. Using interaction analysis as our primary mode of data analysis, we conducted an empirical, qualitative study with 4 couples, each made up of person with a vision impairment and their sighted guide. Our results show how pairs used interactional resources such as turn-taking and body movements to both co-constitute a common space for navigation, and repair moments of rupture to this space. This work is used to present an exemplary case of interdependence and draws out implications for designing AI-enabled AT that shifts the emphasis away from independent navigation, and towards the carefully coordinated actions between people navigating together.

Current approaches to AI and Assistive Technology (AT) often foreground task completion over other encounters such as expressions of care. Our paper challenges and complements such task-completion approaches by attending to the care work of access-the continual affective and emotional adjustments that people make by noticing and attending to one another. We explore how this work impacts encounters among people with and without vision impairments who complete tasks together. We find that bound up in attempts to get things done are concerns for one another and how well people are doing together. Reading this work through emerging disability studies and feminist STS scholarship, we account for two important forms of work that give rise to access: (1) mundane attunements and (2) non-innocent authorizations. Together these processes work as sensitizing concepts to help HCI scholars account for the ways that intelligent ATs both produce access while sometimes subverting people with disabilities.

For individuals with mental illness, social media platforms are considered spaces for sharing and connection. However, not all expressions of mental illness are treated equally on these platforms. Different aggregates of human and technical control are used to report and ban content, accounts, and communities. Through two years of digital ethnography, including online observation and interviews, with people with eating disorders, we examine the experience of content moderation. We use a constructivist grounded theory approach to analysis that shows how practices of moderation across different platforms have particular consequences for members of marginalized groups, who are pressured to conform and compelled to resist. Above all, we argue that platform moderation is enmeshed with wider processes of conformity to specific versions of mental illness. Practices of moderation reassert certain bodies and experiences as 'normal' and valued, while rejecting others. At the same time, navigating and resisting these normative pressures further inscribes the marginal status of certain individuals. We discuss changes to the ways that platforms handle content related to eating disorders by drawing on the concept of multiplicity to inform design.

Why is it so hard for chatbots to talk about race? This work explores how the biased contents of databases, the syntactic focus of natural language processing, and the opaque nature of deep learning algorithms cause chatbots difficulty in handling race-talk. In each of these areas, the tensions between race and chatbots create new opportunities for people and machines. By making the abstract and disparate qualities of this problem space tangible, we can develop chatbots that are more capable of handling race-talk in its many forms. Our goal is to provide the HCI community with ways to begin addressing the question, how can chatbots handle race-talk in new and improved ways?

This research takes an orientation to visual impairment (VI) that does not regard it as fixed or determined alone in or through the body. Instead, we consider (dis)ability as produced through interactions with the environment and configured by the people and technology within it. Specifically, we explore how abilities become negotiated through video ethnography with six VI athletes and spectators during the Rio 2016 Paralympics. We use generated in-depth examples to identify how technology can be a meaningful part of ability negotiations, emphasizing how these embed into the social interactions and lives of people with VI. In contrast to treating technology as a solution to a 'sensory deficit', we understand it to support the triangulation process of sense-making through provision of appropriate additional information. Further, we suggest that technology should not try and replace human assistance, but instead enable people with VI to better identify and interact with other people in-situ.

There has been a surge in artificial intelligence (AI) technologies co-opted by or designed for people with visual disabilities. Researchers and engineers have pushed technical boundaries in areas such as computer vision, natural language processing, location inference, and wearable computing. But what do people with visual disabilities imagine as their own technological future? To explore this question, we developed and carried out tactile ideation workshops with participants in the UK and India. Our participants generated a large and diverse set of ideas, most focusing on ways to meet needs related to social interaction. In some cases, this was a matter of recognizing people. In other cases, they wanted to be able to participate in social situations without foregrounding their disability. It was striking that this finding was consistent across UK and India despite substantial cultural and infrastructural differences. In this paper, we describe a new technique for working with people with visual disabilities to imagine new technologies that are tuned to their needs and aspirations. Based on our experience with these workshops, we provide a set of social dimensions to consider in the design of new AI technologies: social participation, social navigation, social maintenance, and social independence. We offer these social dimensions as a starting point to forefront users' social needs and desires as a more deliberate consideration for assistive technology design.

We present insights from an extended engagement and design intervention at an urban regeneration site in SE Lon-don. We describe the process of designing a walking trail and system for recording and playing back place-specific stories for those living and working on the housing estate, and show how this is set within a wider context of urban renewal, social/affordable housing and "community building". Like prior work, the research reveals the frictions that arise in participatory engagements with heterogeneous actors. Here we illustrate how material interventions can re-arrange existing spatial configurations, making productive the plurality of accounts intrinsic in community life. Through this, we provide an orientation to HCI and design interventions that are concerned with civic engagement and participation in processes of making places.

We present findings from a year-long engagement with a street and its community. The work explores how the production and use of data is bound up with place, both in terms of physical and social geography. We detail three strands of the project. First, we consider how residents have sought to curate existing data about the street in the form of an archive with physical and digital components. Second, we report endeavours to capture data about the street's environment, especially of vehicle traffic. Third, we draw on the possibilities afforded by technologies for polling opinion. We reflect on how these engagements have: materialised distinctive relations between the community and their data; surfaced flows and contours of data, and spatial, temporal and social boundaries; and enacted a multiplicity of 'small worlds'. We consider how such a conceptualisation of data-in-place is relevant to the design of technology.

Recent years have seen the possibilities of new imaging and interaction technologies for minimally invasive surgery such as touchless interaction and high definition renderings of three-dimensional anatomy. With this paper we take a step back to review the historical introduction and assimilation of imaging technologies in the surgical theatre in parallel with the productive and cross-referential nature of surgical practice and image use. We present findings from a field study of image use during neurosurgery where we see that the work to see medical images is highly constructed and embodied with the action of manipulating the body. This perspective lends itself to a discussion of the directions for new imaging interaction technologies.

Representing a new class of tool for biological modeling, Bio Model Analyzer (BMA) uses sophisticated computational techniques to determine stabilization in cellular networks. This paper presents designs aimed at easing the problems that can arise when such techniques - \'14using distinct approaches to conceptualizing networks\'14 - are applied in biology. The work also engages with more fundamental issues being discussed in the philosophy of science and science studies. It shows how scientific ways of knowing are constituted in routine interactions with tools like BMA, where the emphasis is on the practical business at hand, even when seemingly deep conceptual problems exist. For design, this perspective refigures the frictions raised when computation is used to model biology. Rather than obstacles, they can be seen as opportunities for opening up different ways of knowing.

This paper examines routine family car journeys, looking specifically at how passengers assist during a mobile telephone call while the drivers address the competing demands of handling the vehicle, interacting with various artefacts and controls in the cabin, and engage in co-located and remote conversations while navigating through busy city roads. Based on an analysis of video fragments, we see how drivers and child passengers form their conversations and requests around the call so as to be meaningful and paced to the demands, knowledge and abilities of their co-occupants, and how the conditions of the road and emergent traffic are oriented to and negotiated in the context of the social interaction that they exist alongside. The study provides implications for the design of car-based collaborative media and considers how hands- and eyes-free natural interfaces could be tailored to the complexity of activities in the car and on the road.

research-article On the naturalness of touchless: Putting the "interaction" back into NUI Authors: Kenton O'hara Microsoft Research, Cambridge, UK Microsoft Research, Cambridge, UKView Profile , Richard Harper Microsoft Research, Cambridge, UK Microsoft Research, Cambridge, UKView Profile , Helena Mentis Microsoft Research, Cambridge, UK Microsoft Research, Cambridge, UKView Profile , Abigail Sellen Microsoft Research, Cambridge, UK Microsoft Research, Cambridge, UKView Profile , Alex Taylor Microsoft Research, Cambridge, UK Microsoft Research, Cambridge, UKView Profile Authors Info & Claims ACM Transactions on Computer-Human InteractionVolume 20Issue 1March 2013 Article No.: 5pp 1–25https://doi.org/10.1145/2442106.2442111Published:11 April 2013Publication History 72citation2,167DownloadsMetricsTotal Citations72Total Downloads2,167Last 12 Months94Last 6 weeks9 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteGet Access

Over the past decade, a diverse community of biologists, artists, engineers and hobbyists has emerged to pursue biology projects outside of traditional laboratories. Though still in its nascent form, this DIYbio (Do It Yourself Biology) movement has given rise to a host of technical innovations and sharing mechanisms that enable hobbyists to experiment with organic materials. As these developments continue to expand science practice beyond professional settings and into hackspaces, art studios and private homes, HCI research is presented with a range of new opportunities and concerns.

DIYbio (Do It Yourself Biology) aims to 'open source', tinker and experiment with biology outside of professional settings. In this paper, we present the origins, practices, and challenges of DIYbio initiatives around the world. Our findings depict DIYbio as operating across intersections ('seams') between a range of stakeholders, materials and concerns. To map out the role of Human Computer Interaction (HCI) across these seams, we present design exercises (functional prototypes) that explore three areas for future work: internal collaboration tools within the DIYbio and professional community; mechanisms for external communication with stakeholders from the general public; and bio-electronic assemblies of organic and digital materials. In doing so, we hope to critically re-envision the role of HCI at the emerging intersection of biology, computation and DIY.

As technologies age, they experience wear and degradation, sometimes resulting in loss of functionality. In response, parts are replaced and software is updated. Yet restoration - the process of returning something to a previous condition, often regardless of its instrumental value -"is a relatively rare practice with computational technologies. The aim of this paper is to enrich HCI design practices by considering the material qualities of restoration. We consider what makes a technology worth restoring and what constitutes the process of restoration by examining data collected from a three-month apprenticeship-based qualitative study of bookbinding. Building on relevant literatures, we offer antiquarian books -"long-established information technologies - as a lens onto the ways values are enacted through material engagements. We conclude with a discussion of restoration's role in HCI.

In any design process, a medium's properties need to be considered. This is nothing new in design. Still we find that in HCI and interactive systems design the properties of a technology are often glossed over. That is, technologies are black-boxed without much thought given to how their distinctive properties open up design possibilities. In this paper we describe what we call inspirational bits as a way to become more familiar with the design material in HCI, the digital material. We describe inspirational bits as quick and dirty but fully working systems in both hardware and software built with the aim of exposing one or several of the dynamic properties of a digital material. We also show how they provide a means of sharing design knowledge across the members of a multi-disciplined design team.

"Out there" is increasingly becoming a topic of concern in HCI. Thanks to various clarion calls, researchers in the field are turning their attention to technology-mediated activities that are shaped less by Euro-American sensibilities and defined more by how they are culturally and geographically distinct. Fieldwork and ethnography researchers, for instance, are beginning to investigate ICT use at religious and spiritual sites, by the socially excluded and disenfranchised, and by people in developing regions. In this paper, I concentrate on the latter focus on development to reflect on HCI's disciplinary turn "out there". Specifically, I take the following three themes as common rhetorical devices in such work: (i) the network, (ii) difference and (iii) complexity. Through examples, I discuss how each of these themes has been mobilised. I then use materials from anthropology, science and technology studies, and to a lesser extent geography and postcolonial studies to complicate and in some cases question the interpretative frames that are being applied. Thus, my hope is that this paper is seen as a thought piece that deepens our thinking around HCI's efforts to look "out there" by paying critical attention to what is going on "in here".

The complexities and costs of deploying Ubicomp applications seriously compromise our ability to evaluate such systems in the real world. To simplify Ubicomp deployment we introduce the robotic pseudopod (P.Pod), an actuator that acts on mechanical switches originally designed for human control only. P.Pods enable computational control of devices by hijacking their mechanical switches -- a term we refer to as mechanical hijacking. P.Pods offer simple, low-cost, non-destructive computational access to installed hardware, enabling functional, real world Ubicomp deployments. In this paper, we illustrate how three P.Pod primitives, built with the Lego MindStorm NXT toolkit, can implement mechanical hijacking, facilitating real world Ubicomp deployments which otherwise require extensive changes to existing hardware or infrastructure. Lastly, we demonstrate the simplicity of P.Pods by observing two middle school classes build working smart home applications in 4 hours.

In any design process, a medium's properties need to be considered. This is generally well established, yet still within interactive systems design, the properties of a technological medium are often glossed over. That is, technologies are often black-boxed without much thought given to how their distinctive material properties open up the design space. In this paper, we experiment with a technology to see what might be gained from intentionally and systematically investigating its properties. Specifically, we look upon Bluetooth from the perspective of being a design material and examine how its properties from that perspective can be used to shape design thinking. Using four example cases or "sketches", we show that Bluetooth's properties, often seen as constraints, can provide useful building blocks for designing interactive systems.

This work describes the design process and installation of three speculative, rudimentary machines, or rudiments. Through careful iterations in their design, the rudiments are intended to provoke curiosity and discussion around the possibility of autonomy in interactive systems. The design of the rudiments is described in detail, alongside the design decisions that were made to suggest a machine autonomy and to provoke discussion. Some preliminary reflections from installing the rudiments in two separate households are also reported. Widely divergent opinions of the rudiments from the two households are used to discuss a number of themes for thinking about autonomy and interactive systems design. Overall, the presented work adopts a perspective strongly oriented towards guiding future research, but, importantly, aims to do so by opening up and exposing the design possibilities rather than constraining them.

In this paper, we examine the ideas behind and reactions to a prototype online tool designed, in-house, for an art college's interaction design department. The web-based prototype, the Digital Scrapbook, was initially intended as a tool for tutors to oversee their students' work. However, our ongoing discussions with the department's members indicate that it is more interesting to its target audience for a variety of other reasons, including its role in design inspiration; group representation and collaboration; and as a repository for documenting the creative process. We speculate on the reasons behind this by further reflecting on the reactions to the tool. We come to the conclusion that members of the department value the Digital Scrapbook because it is seen to reflect the processional character of design. That is, we suggest the system is seen as promising because it reveals the often messy, unintended and meandering routes design can follow. In closing, we suggest how we might support further ways of displaying design's processional character and discuss the broader implications of displaying collective processes.

People now routinely carry radio frequency identification (RFID) tags - in passports, driver's licenses, credit cards, and other identifying cards - from which nearby RFID readers can access privacy-sensitive information. The problem is that people are often unaware of security and privacy risks associated with RFID, likely because the technology remains largely invisible and uncontrollable for the individual. To mitigate this problem, we introduce a collection of novel yet simple and inexpensive tag designs. Our tags provide reader awareness, where people get visual, audible, or tactile feedback as tags come into the range of RFID readers. Our tags also provide information control, where people can allow or disallow access to the information stored on the tag by how they touch, orient, move, press or illuminate the tag.

"Light bodies" are mobile and portable, hand-held lights that respond to audio and vibration input. The motivation to build these devices is grounded in a historical reinterpretation of street lighting. Before fixed infrastructure illuminated cities at night, people carried lanterns with them to make their presence known. Using this as our starting point, we asked how we might engage people in more actively shaping the lightscapes which surround them. We prototyped a first iteration of sound and vibration responsive, LED-based coloured lights that we placed in three different settings including a choreographed dance performance, an outdoor public installation and an audio-visual event. We report on our experiences with these preliminary investigations.

Under certain conditions, we appear willing to see and interact with computing machines as though they exhibited intelligence, at least an intelligence of sorts. Using examples from AI and robotics research, as well as a selection of relevant art installations and anthropological fieldwork, this paper reflects on some of our interactions with the kinds of machines we seem ready to treat as intelligent. Broadly, it is suggested that ordinary, everyday ideas of intelligence are not fixed, but rather actively seen and enacted in the world. As such, intelligence does not just belong to the province of the human mind, but can emerge in quite different, unexpected forms in things. For HCI, it is proposed this opens up a new set of possibilities for design; examining the ways intelligence is seen and enacted gives rise to a very different way of thinking about the intersection between human and machine, and thus promotes some radically new types of interactions with computing machines.

In this report we discuss some of the challenges when applying a user-centred design approach in the field of human-robot interaction (HRI). The discussion is based on a one-day workshop at the NordiCHI'08 conference, investigating how methods, techniques and perspectives from the field of Human Computer Interaction (HCI) could contribute to and learn from recent developments in the area of HRI. Emphasis was put on topics that are infrequent in mainstream HCI such as machine movement, autonomy, anthropomorphism, physical interaction, environmental issues and issues concerned more generally with cultural notions of robots.

This paper examines an under explored area of digital photography, namely photo display. Using examples from a study undertaken with six families, we examine photo displays on mantelpieces, sideboards, and hallway walls, and in homeoffices. Using the examples, we make a case relating to the material properties of photo displays, suggesting that families routinely (and often unintentionally) express something of themselves in the ways they display their photos. The very ideas of family and home, we suggest, are tightly interwoven with the methods of photo display. This position is used to offer up some early design considerations for digital photo displays. We outline some basic properties that might be designed around and contend that the ideas of family and home impose constraints on which of these properties might be best combined and exploited. We also present three design concepts to illustrate how we have been developing this position.

In this article, we examine the containment of clutter in family homes and, from this, outline considerations for design. Selected materials from an ethnographically informed study of home life are used to detail the ways in which families contain their clutter in bowls and drawers. Clutter, within these containers, is found to be made up of a heterogeneous collection of things that, for all manner of reasons, hold an ambiguous status in the home. It is shown that bowls and drawers provide a “safe” site of containment for clutter, giving the miscellany of content the “space” to be properly dealt with and classified, or to be left unresolved. The shared but idiosyncratic practices families use to contain their clutter are seen to be one of the ways in which the home, or at least the idea of home, is collectively produced. It is also part of the means by which families come to make their homes distinct and unique. These findings are used to consider what it might mean to design for the home, and to do so in ways that are sensitive to the idiosyncratic systems of household organization. In conclusion, thought is given to how we design for people's ideas of home, and how we might build sites of uncertainty into homes, where physical as well as digital things might coalesce.

In this paper we describe a field trial designed to investigate the potential of remote, situated messaging within the home. Five households used our "HomeNote" device for approximately a month. The results show a diversity of types of communication which highlight the role of messaging both to a household and to a place. It also shows the ways in which these kinds of messages enable subtle ways of requesting action, expressing affection, and marking identity in a household -- communication types which have received little attention in the research literature. These in turn point to new concepts for technology which we describe.

In this paper we introduce the idea of organizing systems. Through a number of examples from an ongoing ethnographic study of family life, we suggest that organizing systems come about through the artful design and use of informational artifacts in the home, such as calendars, paper notes, to-do lists, etc. These systems are not only seen to organize household routines and schedules, but also, crucially, to shape the social relations between family members. Drawing attention to the material properties of informational artifacts and how assemblies of these artifacts come to make up organizing systems, we discuss some general implications for designing information technology for the home. Most importantly, we suggest that technologies must be designed to accommodate the rich and diverse ways in which people organize their homes, providing them with the resources to artfully construct their own systems rather than enforcing ones that are removed from their own experiences.

This paper presents research on the use of household lists. Drawing on an ethnographic study of mothers' work, it focuses on the centrality of paper lists in home- and child-care arrangements, and reveals that they provide a useful means for organizing the complex interrelations between a household's people, activities and tasks. However, paper lists are also shown to be poor at handling the separation, or classification, of these things. In conclusion, both these positive and negative aspects of list making are used to raise broad pointers for CSCW and system design.

In this paper, we demonstrate how ethnographic fieldwork studies can be used to inform the design of third generation mobile phones. We draw on a field study of teenage mobile phone users and, specifically, their participation in gift-giving practices to design the user interface and form of a concept mobile phone. The concept device is designed to support teenagers' social practices through a novel multimedia messaging system and the augmentation of the phone's address book. We report on the process adopted to design the concept and briefly describe preliminary reactions from potential users. To conclude the paper, we comment on the lessons we have learnt in applying ethnographic findings to design.

In this paper, we present an overview of the data collected from an ethnographic study of teenagers and their use of mobile phones. Through the data, we suggest that teenagers use their phones to participate in social practices that closely resemble forms of ritualised gift-giving. Such practices, we claim, shape the way teenagers understand and thus use their phones. We go onto show that this insight into everyday, phone-mediated activities has practical implications for mobile phone design. Using an example, we describe how teenagers' gift-giving practices can inform design, providing an initial means to conceptualise future emerging technologies