Artificial intelligence (AI) supported clinical decision support (CDS) technologies can parse vast quantities of patient data into meaningful insights for healthcare providers. Much work is underway to determine the technical feasibility and the accuracy of AI-driven insights. Much less is known about what insights are considered useful and actionable by healthcare providers, their trust in the insights, and clinical workflow integration challenges. Our research team used a conceptual prototype based on AI-generated treatment insights for type 2 diabetes medications to elicit feedback from 41 U.S.-based clinicians, including primary care and internal medicine physicians, endocrinologists, nurse practitioners, physician assistants, and pharmacists. We contribute to the human-computer interaction (HCI) community by describing decision optimization and design objective tensions between population-level and personalized insights, and patterns of use and trust of AI systems. We also contribute a set of 6 design principles for AI-supported CDS.

In the last decade, interest in accessible and eyes-free text entry has continued to grow. However, little research has been done to explore the feasibility of using audibly distinct phrases for text entry tasks. To better understand whether preexisting phrases used in text entry research are sufficiently distinct for eyes-free text entry tasks, we used Microsoft’s and Apple’s desktop text-to-speech systems to generate all 500 phrases from MacKenzie and Soukoreff’s set [32] using the default male and female voices. We then asked 392 participants recruited through Amazon’s Mechanical Turk to transcribe the generated audio clips. We report participant transcription errors and present the 96 phrases that were observed with no comprehension errors. These phrases were further tested with 80 participants who identified as low-vision and/or blind recruited through Twitter. We contribute the 92 phrases that were observed to maintain no comprehension errors across both experiments.

Voice assistants are fundamentally changing the way we access information. However, voice assistants still leverage little about the web beyond simple search results. We introduce Firefox Voice, a novel voice assistant built on the open web ecosystem with an aim to expand access to information available via voice. Firefox Voice is a browser extension that enables users to use their voice to perform actions such as setting timers, navigating the web, and reading a webpage’s content aloud. Through an iterative development process and use by over 12,000 active users, we find that users see voice as a way to accomplish certain browsing tasks efficiently, but struggle with discovering functionality and frequently discontinue use. We conclude by describing how Firefox Voice enables the development of novel, open web-powered voice-driven experiences.

The advancement of text-to-speech (TTS) voices and a rise of commercial TTS platforms allow people to easily experience TTS voices across a variety of technologies, applications, and form factors. As such, we evaluated TTS voices for long-form content: not individual words or sentences, but voices that are pleasant to listen to for several minutes at a time. We introduce a method using a crowdsourcing platform and an online survey to evaluate voices based on listening experience, perception of clarity and quality, and comprehension. We evaluated 18 TTS voices, three human voices, and a text-only control condition. We found that TTS voices are close to rivaling human voices, yet no single voice outperforms the others across all evaluation dimensions. We conclude with considerations for selecting text-to-speech voices for long-form content.

Researchers and the media have become increasingly interested in protest users, or people who change (protest use) or stop (protest non-use) their use of a company's products because of the company's values and/or actions. Past work has extensively engaged with the phenomenon of technology non-use but has not focused on non-use (nor changed use) in the context of protest. With recent research highlighting the potential for protest users to exert leverage against technology companies, it is important for technology stakeholders to understand the prevalence of protest users, their motivations, and the specific tactics they currently use. In this paper, we report the results of two surveys (n = 463 and n = 398) of representative samples of American web users that examine if, how, and why people have engaged in protest use and protest non-use of the products of five major technology companies. We find that protest use and protest non-use are relatively common, with 30% of respondents in 2019 reporting they were protesting at least one major tech company. Furthermore, we identify that protest users' most common motivations were (1) concerns about business models that profit from user data and (2) privacy; and the most common tactics were (1) stopping use and (2) leveraging ad blockers. We also identify common challenges and roadblocks faced by active and potential protest users, which include (1) losing social connections and (2) the lack of alternative products. Our results highlight the growing importance of protest users in the technology ecosystem and the need for further social computing research into this phenomenon. We also provide concrete design implications for existing and future technologies to support or account for protest use and protest non-use.

Social media platforms offer people a variety of ways to interact, ranging from public broadcast posts, to comments on posts, to private messages, to paralinguistic interactions such as "liking" posts. In 2015, the commenting function "replies" was temporarily removed from Tumblr, providing a unique opportunity to study the deprivation of a standard social media feature. We administered a survey to investigate Tumblr users' perceptions and use of replies. Respondents reported that they used replies to simultaneously support others' performance and their own. Respondents compared replies to other digital interaction channels such as paralinguistic interactions, the sharing feature "reblogs", and "direct messages" (DMs), citing social considerations and norms around each. We used Goffman's performance theory to draw insights on the perceived semi-public / semi-private space of replies, which enabled users to perform supportive actions that did not belong in their main blogging identity frontstage but that were not backstage either. We discuss the limitation of performance theory to describe a presentation to a limited but unknown audience, and we describe how replies enabled new frontstages such as the delicate ramp up to the performance of intimacy in DMs. We discuss implications for performing support and identity on social media with audiences that are perceived as limited but are unknown.

Dominance is a key aspect of interpersonal relationships. To what extent do nonverbal indicators related to dominance status translate to a nonanthropomorphic robot? An experiment ( N = 25) addressed whether a mobile robot's motion style can influence people's perceptions of its status. Using concepts from improv theater literature, we developed two motion styles across three scenarios (robot makes lateral motions, approaches, and departs) to communicate a robot's dominance status through nonverbal expression. In agreement with the literature, participants described a motion style that was fast, in the foreground, and more animated as higher status than a motion style that was slow, in the periphery, and less animated. Participants used fewer negative emotion words to describe the robot with the purportedly high-status movements versus the purportedly low-status movements, but used more negative emotion words to describe the robot when it made departing motions that occurred in the same style. This result provides evidence that guidelines from improvisational theater for using nonverbal expression to perform interpersonal status can be applied to influence perception of a nonanthropomorphic robot's status, thus suggesting that useful models for more complicated behaviors might similarly be derived from performance literature and theory.

Voice has become a widespread and commercially viable interaction mechanism with the introduction of voice assistants (VAs), such as Amazon’s Alexa, Apple’s Siri, Google Assistant, and Microsoft’s Cortana. Despite their prevalence, we do not have a detailed understanding of how these technologies are used in domestic spaces. To understand how people use VAs, we conducted interviews with 19 users, and analyzed the log files of 82 Amazon Alexa devices, totaling 193,665 commands, and 88 Google Home Devices, totaling 65,499 commands. In our analysis, we identified music, search, and IoT usage as the command categories most used by VA users. We explored how VAs are used in the home, investigated the role of VAs as scaffolding for Internet of Things device control, and characterized emergent issues of privacy for VA users. We conclude with implications for the design of VAs and for future research studies of VAs.

his paper reports on design strategies for critical and experimental work that remains constructive. We report findings from a design workshop that explored the "home hub" space through "imaginary design workbooks". These feature ambiguous images and annotations written in an invented language to suggest a design space without specifying any particular idea. Many of the concepts and narratives which emerged from the workshop focused on extreme situations: some thoughtful, some dystopian, some even mythic. One of the workshop ideas was then developed with a senior social worker who works with young offenders. A "digital social worker" concept was developed and critiqued simultaneously. We draw on Foucault's history of surveillance to "defamiliarise" both the home hub technology and the current youth justice system. We argue that the dichotomy between "constructive" and "critical" design is false because design is never neutral.

Web users are increasingly turning to ad blockers to avoid ads, which are often perceived as annoying or an invasion of privacy. While there has been significant research into the factors driving ad blocker adoption and the detrimental effect to ad publishers on the Web, the resulting effects of ad blocker usage on Web users' browsing experience is not well understood. To approach this problem, we conduct a retrospective natural field experiment using Firefox browser usage data, with the goal of estimating the effect of adblocking on user engagement with the Web. We focus on new users who installed an ad blocker after a baseline observation period, to avoid comparing different populations. Their subsequent browser activity is compared against that of a control group, whose members do not use ad blockers, over a corresponding observation period, controlling for prior baseline usage. In order to estimate causal effects, we employ propensity score matching on a number of other features recorded during the baseline period. In the group that installed an ad blocker, we find significant increases in both active time spent in the browser (+28% over control) and the number of pages viewed (+15% over control), while seeing no change in the number of searches. Additionally, by reapplying the same methodology to other popular Firefox browser extensions, we show that these effects are specific to ad blockers. We conclude that ad blocking has a positive impact on user engagement with the Web, suggesting that any costs of using ad blockers to users' browsing experience are largely drowned out by the utility that they offer.

As computing technologies become ubiquitous in social life, social science increasingly becomes the study of those technosystems. Similarly, as technology corporations compete to design new ubicomp products, social science research is recruited as a design method. This paper presents an interpretive bricolage, exploring the relationship between social science and corporate technology research. It draws on a specific case study: the history of ethnomethodology during the lifetime of the Xerox EuroPARC laboratory. This interpretation relates to the ways that social and organisational authority is maintained through scientific knowledge, and the ways in which interdisciplinary design research engages with product users, customers and markets.

People taking photographs with their tablets is an increasingly common sight. While the design of hardware is larger and more cumbersome than the smaller and more often carried cameraphones, the underlying photographic software is essentially the same. At the same time, cameraphone hardware usually contains objectively better quality cameras with more megapixels, better lenses, and faster image processing. So why do people choose one over the other? In this paper we explore the experience of tablet photography and aim to compare it with camera phone photography. In a mixed-methods study, we use quantitative and qualitative data to explore perceptions of photo quality, factors influencing photo quality, and the affordances of tablet computers that lead users to prefer them over camera phones. Our results indicate that participants take photos with their camera phone for the convenience of the small device form factor, but prefer taking photos with their larger tablet for photos that require higher definition. We discuss the design implications of this research for the design of mobile cameras.

Animated GIFs have been around since 1987 and recently gained more popularity on social networking sites. Tumblr, a large social networking and micro blogging platform, is a popular venue to share animated GIFs. Tumblr users follow blogs, generating a feed or posts, and choose to "like' or to "reblog' favored posts. In this paper, we use these actions as signals to analyze the engagement of over 3.9 million posts, and conclude that animated GIFs are significantly more engaging than other kinds of media. We follow this finding with deeper visual analysis of nearly 100k animated GIFs and pair our results with interviews with 13 Tumblr users to find out what makes animated GIFs engaging. We found that the animation, lack of sound, immediacy of consumption, low bandwidth and minimal time demands, the storytelling capabilities and utility for expressing emotions were significant factors in making GIFs the most engaging content on Tumblr. We also found that engaging GIFs contained faces and had higher motion energy, uniformity, resolution and frame rate. Our findings connect to media theories and have implications in design of effective content dashboards, video summarization tools and ranking algorithms to enhance engagement.

Temporal terms, such as 'winter', 'Christmas', or 'January' are often used in search queries for personal images. But how do people's memories and perceptions of time match with the actual dates when their images were captured? We compared the temporal terms that 74 Flickr users used to search their own photo collections, and compared them to the date captured data in the target image. We also conducted a larger study across several billion images, comparing user-applied tags for holidays and seasons to the dates the images were captured. We demonstrate that various query terms and tags can be in conflict with the actual dates photos were taken for specific types of temporal terms up to 40% of the time. We will conclude by highlighting implications for search systems where users are querying for personal content by date.

Participants in social media systems must balance many considerations when choosing what to share and with whom. Sharing with others invites certain risks, as well as potential benefits; achieving the right balance is even more critical when sharing photos, which can be particularly engaging, but potentially compromising. In this paper, we examine photo-sharing decisions as an interaction between high-level user preferences and specific features of the images being shared. Our analysis combines insights from a 96-user survey with metadata from 10.4M photos to develop a model integrating these perspectives to predict permissions settings for uploaded photos. We discuss implications, including how such a model can be applied to provide online sharing experiences that are more safe, more scalable, and more satisfying.

Usability testing is an everyday practice for usability professionals in corporations. But, as in all experimental situations, who you study can be as important as what you study. In this Note we explore a common practice in the corporation: experimenting on the company's employees. While fellow employees can be convenient and avoid issues such as confidentiality, we use two usability studies of mobile and web applications to show that employees spend less time-on-task on competitor websites than non-employees. Non-employees reliably rate competitor websites and apps higher than employees on both usability (on the 10-question SUS scale) and ease of use (on the 1-question SEQ scale). We conclude with recommendations for best practices for usability testing in the corporation.

We present an interview study of 34 participants in the US and Korea who described how they manage their personal data, from work files to family photos. Through their 'data narratives' - accounts of their data management practices, including device usage patterns and negotiations with system and brand ecosystems' we explore how individuals negotiate a complex, multi-service, and morally-charged sociotechnical landscape, balancing demands to share and to safeguard their data in appropriate ways against a shifting background of changing technologies, relationships, individuals, and corporations. We describe the guiding framework that people use to make decisions as a 'moral economy' of data management, contributing to our understanding of context-specific system choices.

HCI research has explored mobile technologies to support social activity and to support greater feelings of connectedness. Much of this has focused on different mobile devices, individual preferences and modes of use. Yet social activity and connectedness are about ongoing enactments of relationships across technologies. We propose the relational lens as a way to include a notion of relational tension in addition to individual preferences in the design and analysis of mobile communication technologies. We discuss three strategies people use to manage tensions in their relationships: selection, segmentation and integration. Our data show that use of social technologies can at times destabilize social relations and occasion relational tensions, forcing users to renegotiate how they enact these relationships.

How do people keep track of their money? In this paper we present a preliminary scoping study of how 14 individuals in the San Francisco Bay Area earn, save, spend and understand money and their personal and family finances. We describe the practices we developed for exploring the sensitive topic of money, and then discuss three sets of findings. The first is the emotional component of the relationship people have with their finances. Second, we discuss the tools and processes people used to keep track of their financial situation. Finally we discuss how people account for the unknown and unpredictable nature of the future through their financial decisions. We conclude by discussing the future of studies of money and finance in HCI, and reflect on the opportunities for improving tools to aid people in managing and planning their finances.

We present a qualitative study of 13 farm families who intentionally merge their home and work lives. This is in contrast to most families studied in CSCW, who are urban/ suburban, white-collar and often dual-income, where the goal is to balance separate home and work spheres. We analyze the farm families' coordination practices along three dimensions -- space, time, and roles -- and contrast their experiences to what is known in CSCW about family coordination practices. Through this, we reveal blind spots in CSCW's study of and support for family coordination toward building better tools to support such activities. We emphasize considering co-location rather than assuming geographic distribution across life spheres, the value of natural rhythms in understanding and supporting family life, and how taking on simultaneous roles can be viewed as a life goal rather than a source of conflict.

In rural Northern China, many people own a mobile phone without ever having purchased it: they received it as a gift from better off relatives, usually their migrant children. Drawing from ethnographic field work in three Chinese villages, we describe practices of mobile phone gifting and the social relations that underlie them, as well as the consequences of the circulation of mobile phones, from the change of use that happens when they move from an urban environment to the countryside, to the possibilities that they open up or close out for rural users. We conclude with implications for technology design that emphasize the situated nature of these experiences and thoughtful approaches to the design of 'traveling' mobiles.

This paper contributes to the growing body of literature on privacy and security by looking at self-reported password sharing practices. 62 men and 60 women recruited through a combination of snowball sampling and small ads answered a series of open-ended questions about their password sharing strategies. One third of respondants shared their personal email password, and a quarter shared their Facebook password, both primarily with partners and close friends. Approximately 20% of people who had work email passwords reported sharing them with colleagues. These results support understanding password sharing not as a deviant practice to be stamped out, but rather a nuanced practice engaged in with thought and care.

StoryVisit allows children and long-distance adults to experience a sense of togetherness by reading children's story books together over a distance. StoryVisit combines video conferencing and connected books: remote grown-up and child readers can see and hear each other, and can also see and control the same e-book. We report on research with 61 families - over 200 users including parents, children and long-distance readers - who used StoryVisit in their homes with a long-distance reader for at least one reading session. In addition, we report qualitative findings regarding nineteen of the families who participated in telephone interviews and four families who were monitored and interviewed by researchers at home. Results show that connected e-book video chat sessions last about five times as long as the typical video chats reported in previous research on families with young children. Moreover, the addition of an animated character increased session lengths by another 50%. StoryVisit usage peaked for families with three year olds, showing that sustained distance interactions with very young children are possible if communication technologies incorporate joint activities that engage children and adults.

This ethnographic study of 22 diverse families in the San Francisco Bay Area provides a holistic account of parents' attitudes about their children's use of technology. We found that parents from different socioeconomic classes have different values and practices around technology use, and that those values and practices reflect structural differences in their everyday lives. Calling attention to class differences in technology use challenges the prevailing practice in human-computer interaction of designing for those similar to oneself, which often privileges middle-class values and practices. By discussing the differences between these two groups and the advantages of researching both, this research highlights the benefits of explicitly engaging with socioeconomic status as a category of analysis in design.

Mobile devices have become an important part of adult life, where they are now used for media consumption and creation instead of traditional telephony function only. The same trend is visible in teens and children, both of whom are using mobile devices increasingly.

We introduce Family Story Play, a system that supports grandparents to read books together with their grandchildren over the Internet. Family Story Play is designed to improve communication across generations and over a distance, and to support parents and grandparents in fostering the literacy development of young children. The interface encourages active child participation in the book reading experience by combining a paper book, a sensor-enhanced frame, video conferencing technology, and video content of a Sesame Street Muppet (Elmo). Results with users indicate that Family Story Play improves child engagement in long-distance communication and increases the quality of interaction between young children and distant grandparents. Additionally, Family Story Play encourages dialogic reading styles that are linked with literacy development. Ultimately, reading with Family Story Play becomes a creative shared activity that suggests a new kind of collaborative story telling.

In this paper, we explore the benefits of videochat for families and the corresponding work that home users engage in to make a video call run smoothly. We explore the varieties of social work required, including coordination work, presentation work, behavioral work, and scaffolding work, as well as the technical work necessary. We outline the benefits families enjoy for doing this work and discuss the ways in which families use videochat to reinforce their identity as a family and reinforce their family values, in effect making - as in creating - love. We conclude with recommendations for improving videochat and for designing with family values in mind more generally.

tutorial Share on Connecting families: new technologies, family communication, and the impact on domestic space Authors: Carman Neustaedter Simon Fraser University, Surrey, BC, Canada Simon Fraser University, Surrey, BC, CanadaView Profile , Tejinder K. Judge Virginia Tech, Blacksburg, VA, USA Virginia Tech, Blacksburg, VA, USAView Profile , Steve Harrison Virginia Tech, Blacksburg, VA, USA Virginia Tech, Blacksburg, VA, USAView Profile , Abigail Sellen Microsoft Research Cambridge, Cambridge, United Kingdom Microsoft Research Cambridge, Cambridge, United KingdomView Profile , Xiang Cao Microsoft Research Cambridge, Cambridge, United Kingdom Microsoft Research Cambridge, Cambridge, United KingdomView Profile , David Kirk University of Nottingham University of NottinghamView Profile , Joseph Kaye Nokia Research Nokia ResearchView Profile Authors Info & Claims GROUP '10: Proceedings of the 16th ACM international conference on Supporting group workNovember 2010 Pages 363–366https://doi.org/10.1145/1880071.1880152Online:07 November 2010Publication History 8citation633DownloadsMetricsTotal Citations8Total Downloads633Last 12 Months38Last 6 weeks3 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteGet Access

This workshop aims to explore different approaches and challenges in studying playfulness as a mode of interacting with mobile technology. Researchers, designers and developers with interest in this theme are welcome to participate in a full day activity of demos, presentations and discussions. In particular, our emphasis is on how to introduce, explore and understand playful interaction in mobile applications used in the wild.

Increasingly, smartphones are being used to access all manner of information: email messages, Facebook status updates, tweets, RSS feeds, photographs and more. Approaches to dealing with this multi-faceted information stream developed on the desktop, such as switching between multiple applications or multiple browser windows, are unwieldy and scale poorly for mobile devices. In this paper, we propose the combination of the universal inbox and a system called 'Lenses' for extracting information of interest as part of a solution to this problem. These mechanisms allow the user to easily specify ways to sort, filter and manage their universal inbox in an intuitive way. We culminate with a discussion of implications for mobile phone interface design.

We interviewed and observed families in their homes to understand how they communicate across generations and across distances. The phone is still the most common way for keeping children in touch with distant relatives. However, many children can't talk on the phone by themselves until 7 or 8 years old. This paper examines the challenges children have with phone conversations, and looks at how families are currently working around these issues. These findings can help inform the design of future family communications technologies.

Domestic ubiquitous computing systems often rely on inferences about activities in the home, but the open-ended, dynamic and heterogeneous nature of the home poses serious problems for such systems. In this paper, we propose that by shifting the responsibility for interpretation from the system to the user, we can build systems that interact with people at humanly meaningful levels, preserve privacy, and encourage engagement with suggested topics. We describe a system that embodies this hypothesis, using sensors and inferencing software to assess 'domestic wellbeing' and presenting the results to inhabitants through an output chosen for its ambiguity. In a three-month field study of the system, customised for a particular volunteer household, users engaged extensively with the system, discussing and challenging its outputs and responding to the particular topics it raised.

The personal archive is not only about efficient storage and retrieval of information. This paper describes a study of forty-eight academics and the techniques and tools they use to manage their digital and material archiving of papers, emails, documents, internet bookmarks, correspondence, and other artifacts. We present two sets of results: we first discuss rationales behind subjects' archiving, which go beyond information retrieval to include creating a legacy, sharing resources, confronting fears and anxieties, and identity construction. We then show how these rationales were mapped into our subjects' physical, social and electronic spaces, and discuss implications for development of digital tools that allow for personal archiving.

We present a preliminary and ongoing study into intimate objects: technological devices for maintaining intimacy at a distance. We use the notion of critical technical practice to provide a theoretical framework on which to base our designs, building devices that differ from mass communication devices in three ways: they are for couples in a relationship to communicate with each other, not with everybody else, they are for a specific couple to use, not a generic couple, and they are for the transmission of specific intimate communication, not all-purpose communication.We present an overview of the study, give some examples of intimate object sketches produced by our subjects, and discuss questions posed by the study, particularly those concerning the generalizability of the results.

The last twenty years have seen enormous leaps forward in computers' abilities to generate sound and video. What happens when computers can produce scents on demand? In this talk, I present three approaches to this question. I first look at human olfactory processing: what is our olfactory bandwidth, and what are the limitations of our sense of smell? I then explore the use of scent to accompany other media, from historical examples like Sense-o-Rama and Aromarama, to more recent work including firefighter training systems, augmented gaming, and food and beverage applications. Finally, I look at the possibilities of olfactory output as an ambient display medium. I conclude with an overview of current computer-controlled olfactory output devices: off the shelf solutions for incorporating scent into user interface applications.