Despite its constitutional relevance, the technical “individual fairness” criterion has not been operationalized in U.S. state or federal statutes/regulations. We conduct a human subjects experiment to address this gap, evaluating which demographic features are relevant for individual fairness evaluation of recidivism risk assessment (RRA) tools. Our analyses conclude that the individual similarity function should consider age and sex, but it should ignore race.

PDF documents are usually not born-accessible, and so document authors need to put in additional work (remediation) to make them accessible for people with disabilities. Unfortunately, this step is often overlooked and hard to execute, resulting in a large number of inaccessible PDF documents on the internet. Previously, there have been research efforts to investigate potential solutions for remediating PDF documents for accessibility. However, most of the existing research focuses on accessibility of long or scientific PDF documents meant for passive reading. PDF documents come in different types, and this research project focuses on a distinct type of PDF document-forms-where the user is required to interact with the PDF document and enter data. Through our research work we identified that the PDF form remediation process is non-intuitive, repetitive, and overwhelming due to the high-information density of PDF forms, and existing research and tools do not yet address the challenges. Our research work culminated in the creation of a tool - FormA11y - that addresses these challenges by making the repetitive and painstaking process of form remediation easier. To evaluate the effectiveness and efficiency of FormA11y against the industry standard tool - Adobe Acrobat - for PDF form remediation, we performed a within-subject user study with 20 participants. With FormA11y, users remediated forms 2.8 times faster while creating more accurately accessible PDF forms.

Inclusivity for blind and low vision (BLV) professionals in data science and analytics is limited by a gap in understanding their unique data analysis needs. We contribute to the literature by reporting on a two-step online survey delving into the experiences and challenges faced by BLV individuals engaged in data-related roles. Our findings highlight that despite expertise in programming and GUI-based analysis tools, BLV professionals faced accessibility issues at various points in the data analysis pipeline—issues ranging from data loading and transformation, availability and compatibility of data tools with assistive technology, and visualization authoring. The prevalent use of tools such as Excel, Python, and SAS alongside heavy reliance on assistive technologies highlights persistent accessibility challenges. Furthermore, frequent collaboration with sighted colleagues indicates compromised independence. These results underscore the urgent need for “born accessible” tools that ensure the inclusivity and autonomy of BLV professionals in the field of data science.

Tactile graphics are one of the best ways for a blind person to perceive a chart using touch, but their fabrication is often costly, time-consuming, and does not lend itself to dynamic exploration. Refreshable haptic displays tend to be expensive and thus unavailable to most blind individuals. We propose TACTUALPLOT, an approach to sensory substitution where touch interaction yields auditory (sonified) feedback. The technique relies on embodied cognition for spatial awareness-i.e., individuals can perceive 2D touch locations of their fingers with reference to other 2D locations such as the relative locations of other fingers or chart characteristics that are visualized on touchscreens. Combining touch and sound in this way yields a scalable data exploration method for scatterplots where the data density under the user's fingertips is sampled. The sample regions can optionally be scaled based on how quickly the user moves their hand. Our development of TactualPlot was informed by formative design sessions with a blind collaborator, whose practice while using tactile scatterplots caused us to expand the technique for multiple fingers. We present results from an evaluation comparing our TactualPlot interaction technique to tactile graphics printed on swell touch paper.

Despite their growing popularity, many public kiosks with touchscreens are inaccessible to blind people. Toucha11y is a working prototype that allows blind users to use existing inaccessible touchscreen kiosks independently and with little effort. Toucha11y consists of a mechanical bot that can be instrumented to an arbitrary touchscreen kiosk by a blind user and a companion app on their smartphone. The bot, once attached to a touchscreen, will recognize its content, retrieve the corresponding information from a database, and render it on the user’s smartphone. As a result, a blind person can use the smartphone’s built-in accessibility features to access content and make selections. The mechanical bot will detect and activate the corresponding touchscreen interface. We present the system design of Toucha11y along with a series of technical evaluations. Through a user study, we found out that Toucha11y could help blind users operate inaccessible touchscreen devices.

Technologies that help users overcome their limitations and integrate with the human body are often termed “human augmentations”. Such technologies are now available on the consumer market, potentially supporting people in their everyday activities. To date, there is no systematic understanding of the perception of human augmentations yet. To address this gap and build an understanding of how to design positive experiences with human augmentations, we conducted a mixed-method study of the perception of augmented humans (AHs). We conducted two scenario-based studies: interviews (n = 16) and an online study (n = 506) with participants from four countries. The scenarios include one out of three augmentation categories (sensory, motor, and cognitive) and specify if the augmented person has a disability or not. Overall, results show that the type of augmentation and disability impacted user attitudes towards AHs. We derive design dimensions for creating technological augmentations for a diverse and global audience.

Abstract When a website is not accessible for users with disabilities, there is a cost imposed on that user. This study quantifies the time disparity experienced by blind users when they encounter web accessibility barriers. The resulting data illustrates a significant reason why web accessibility is imperative, by highlighting and measuring the cost of inaccessibility through the lens of the inequity that accessibility barriers place on the time of users with disabilities in both personal and business settings. This data is needed for policymakers who are creating new regulations or statutes, as well as for informing future technical standards for web accessibility.

For all its potential in supporting data analysis, particularly in exploratory situations, visualization also creates barriers: accessibility for blind and visually impaired individuals. Regardless of how effective a visualization is, providing equal access for blind users requires a paradigm shift for the visualization research community. To enact such a shift, it is not sufficient to treat visualization accessibility as merely another technical problem to overcome. Instead, supporting the millions of blind and visually impaired users around the world who have equally valid needs for data analysis as sighted individuals requires a respectful, equitable, and holistic approach that includes all users from the onset. In this paper, we draw on accessibility research methodologies to make inroads towards such an approach. We first identify the people who have specific insight into how blind people perceive the world: orientation and mobility (O&M) experts, who are instructors that teach blind individuals how to navigate the physical world using non-visual senses. We interview 10 O&M experts-all of them blind-to understand how best to use sensory substitution other than the visual sense for conveying spatial layouts. Finally, we investigate our qualitative findings using thematic analysis. While blind people in general tend to use both sound and touch to understand their surroundings, we focused on auditory affordances and how they can be used to make data visualizations accessible-using sonification and auralization. However, our experts recommended supporting a combination of senses-sound and touch-to make charts accessible as blind individuals may be more familiar with exploring tactile charts. We report results on both sound and touch affordances, and conclude by discussing implications for accessible visualization for blind individuals.

In his ASSETS 2020 keynote talk, Dr. Lazar discusses how technology accessibility researchers and practitioners have been working during the pandemic to improve the quality of life for people with disabilities. Adults with disabilities are three times more likely than adults without disabilities to have the serious underlying medical conditions which place them at a higher risk of severe illness from COVID-19. Dr. Lazar discusses two data collection efforts in the accessibility community to understand technology-related needs during the pandemic, and then highlights current initiatives to address these needs. Accessibility researchers and practitioners are currently working on projects that are 1) providing for accessible public health information and data (such as fully accessible data dashboards), 2) developing tools and technologies for helping people with disabilities stay healthy and avoid the virus (such as accessible masks and technologies for social distancing), and 3) ensuring that online learning and teleconferencing can be accessible for people with various disabilities and needs (such as Deaf users and users of AAC). Dr. Lazar challenges accessibility researchers and practitioners to get more involved in researching and developing digital technologies to improve the quality of life for people with disabilities. Specifically, he suggests some potential areas of research and development work: technologies to allow for priority scheduling of deliveries and purchasing of items with limited quantities for people with disabilities, new uses of crowdsourcing to empower people with disabilities during the pandemic, and studying the impact of masks on the use of automated speech recognition. Dr. Lazar ends the speech by challenging everyone to find accessibility projects that give you joy, are intellectually challenging, and meet the needs of the world!

Users frequently have trouble finding and changing technology settings, even when adjusting those settings to personalize their technology devices may significantly improve their user experience. This paper describes the Morphic project, a cloud-based auto-personalization tool. Primarily designed for improving accessibility, the auto-personalization in Morphic may also help a broader audience. This paper describes: 1) the technical infrastructure needed to support cloud-based auto-personalization, 2) the interaction design approaches necessary to support users during the personalization of their settings, and 3) which settings and modifications have been most frequently used. This paper presents the evolution of the Morphic project, the building of the infrastructure, the formative evaluation of various interaction design approaches (NFC cards, physical keypads, on-screen buttons, and menus), and implications for researchers and developers. It also includes preliminary findings from six technology probes.

Courses in user-centered design, where students learn about centering design on the needs of individuals, is one natural point in which accessibility content can be injected into the curriculum. We describe the approach we have taken with sections in the undergraduate User-Centered Design Course at the University of Maryland, College Park. We initially introduced disability and accessibility in four modules: 1) websites and design portfolios, 2) introduction to understanding user needs, 3) prototyping, and 4) UX evaluation. We present a description of this content that was taught as an extended version in one Fall 2018 section and as an abbreviated version in all sections in Spring 2019. Survey results indicate that students' understanding of accessibility and assistive technology increased with the introduction of these modules.

The Web Content Accessibility Guidelines (WCAG) is the most well-documented, well-accepted, set of interface guidelines on the planet, based on empirical research and a participatory process of stakeholder input. A recent case in a U.S. Federal District Court, Robles v. Dominos Pizza LLC, involved a blind individual requesting that Dominos Pizza make their web site and mobile app accessible for people with disabilities, utilizing the WCAG. The court ruled that, due to the legal concepts of due process and primary jurisdiction doctrine, the plaintiff loses the case simply for asking for the WCAG. This court ruling minimizes the importance of evidence-based accessibility research and guidelines, and this poster will provide a background of the case, describe preliminary analysis of related cases, and discuss implications for accessibility researchers.

The SoundsRight Audio Completely Automated Public Turing tests to tell Computers and Humans Apart (CAPTCHA) was developed with the goal of providing a usable and secure audio CAPTCHA for people with visual impairments. Its design requires users to repeatedly identify a specific sound from a group of different sounds (e.g. baby crying and bird chirping) in real time. Adding background noise (sound masks) to the sounds may make it more difficult for automated software to recognise the sounds and therefore, improve security. However, the sound masks may also make it more challenging for human users to recognise the sound. We conducted a user study involving 20 blind participants and 20 sighted participants to investigate the effect of sound masks on the usability of the SoundsRight CAPTCHA. The results suggest that sound masks do have a significant impact on the failure rate and response time. Sighted participants had significantly a higher failure rate than blind participants and were more vulnerable to the negative effect of sound masks.

Although there have been numerous studies investigating password usage by neurotypical users, a paucity of research has been conducted to examine the use of authentication methods used by individuals with cognitive impairment. In this paper, we report a longitudinal study that investigates how individuals with Down syndrome interact with three user authentication mechanisms. It confirms that many individuals with DS are capable of using traditional alphanumeric passwords as well as learning other authentication methods. Contrary to previous belief, the result suggests that mnemonic passwords may not be easier to remember for individuals with DS during initial usage.

In this paper we describe the development of a new audio CAPTCHA called the SoundsRight CAPTCHA, and the evaluation of the CAPTCHA with 20 blind users. Blind users cannot use visual CAPTCHAs, and it has been documented in the research literature that the existing audio CAPTCHAs have task success rates below 50% for blind users. The SoundsRight audio CAPTCHA presents a real-time audio-based challenge in which the user is asked to identify a specific sound (for example the sound of a bell or a piano) each time it occurs in a series of 10 sounds that are played through the computer's audio system. Evaluation results from three rounds of usability testing document that the task success rate was higher than 90% for blind users. Discussion, limitations, and suggestions for future research are also presented.

Recent survey research suggests that individuals with Down syndrome use computers for a variety of educational, communication, and entertainment activities. However, there has been no analysis of the actual computer knowledge and skills of employment-aged computer users with Down syndrome. We conducted an ethnographic observation that aims at examining the workplace-related computer skills of expert users with Down syndrome. The results show that expert users with Down syndrome have the ability to use computers for basic workplace tasks such as word processing, data entry, and communication.

Numerous studies have investigated task performance times for selection from hierarchical menus, with structures containing many choices at each of a few levels (broad, shallow structures) generally outperforming structures containing fewer choices at each of many levels (narrow, deep structures). To see if these results applied to blind users who rely on screen reader software for computer access, we replicated an earlier published study, using 19 blind screen-reader users. Consistent with earlier studies, broader, shallow hierarchies outperformed narrow, deep hierarchies. Task performance times and hypertext lostness measures were correlated. Although further work will be needed to understand specific determinants of task performance rates, these results support the use of broad, shallow menus for blind as well as sighted users.

No abstract available.

In this paper, we discuss the results of an online survey that investigates how children and young adults with Down syndrome use computers and computer-related devices. The survey responses cover 561 individuals with Down syndrome between the age of four to 21. The survey results suggest that the majority of the children and young adults with Down syndrome can use the mouse to interact with computers, which requires spatial, cognitive, and fine motor skills that were previously believed to be quite challenging for individuals with Down syndrome. The results show great difficulty in text entry using keyboards. Young individuals with Down syndrome are using a variety of computer applications and computer related devices, and computers and computer-related devices play important roles in the life of individuals with Down syndrome. There appears to be great potential in computer-related education and training to broaden existing career opportunities for individuals with Down syndrome, and there needs to be further research on this topic.

Three National Science Foundation (NSF) programs—Human–Computer Interaction, Universal Access, and Digital Society and Technologies—were recently combined into one new cluster called “Human-Centered Computing” (HCC). Two workshops were held to share information about this new cluster with researchers, provide guidance to researchers who are early in their research careers and have yet to receive NSF funding, and provide feedback to NSF from the affected research communities regarding topics that are considered particularly important by this community. Continuing and emerging research opportunities identified included privacy and security issues in HCC context, intelligent user interfaces, universal access including research for different populations such as children and older adults, mobile and ubiquitous computing, and social computing, among others. Various issues concerning interdisciplinary research opportunities were also raised, including understanding the disciplines, promotion and tenure concerns, administrative overhead, and where to publish. Education discussions produced a list of curricular recommendations and a number of opportunities to enhance the education of future HCC practitioners and researchers.

We describe the development and evaluation of a tool, iSonic, to assist users with visual impairment in exploring georeferenced data using coordinated maps and tables, augmented with nontextual sounds and speech output. Our in-depth case studies with 7 blind users during 42 hours of data collection, showed that iSonic enabled them to find facts and discover trends in georeferenced data, even in unfamiliar geographical contexts, without special devices. Our design was guided by an Action-by-Design-Component (ADC) framework, which was also applied to scatterplots to demonstrate its generalizability. Video and download is available at www.cs.umd.edu/hcil/iSonic/.

CAPTCHAs are widely used by websites for security and privacy purposes. However, traditional text-based CAPTCHAs are not suitable for individuals with visual impairments. We proposed and developed a new form of CAPTCHA that combines both visual and audio information to allow easy access by users with visual impairments. A preliminary evaluation suggests strong potential for the new form of CAPTCHA for both blind and visual users.

Human-computer interaction (HCI) is much broader than the study of interface design and input devices. It includes considerations of the social, political, ethical, and societal implications of computer systems. Concerns such as privacy, accessibility, universal design, and voting usability have led to active HCI research. Our examination of HCI responses to these and other issues informs a model of social engagement based on societal influences that motivate various responses from the HCI community. This model provides suggestions for engagement with issues that are likely to grow in importance over the next several years. By focusing on these issues, HCI researchers may make still greater contributions toward addressing societal concerns.

In previous research, the computer frustrations of student and workplace users have been documented. However, the challenges faced by blind users on the Web have not been previously examined. In this study, 100 blind users, using time diaries, recorded their frustrations using the Web. The top causes of frustration reported were (a) page layout causing confusing screen reader feedback; (b) conflict between screen reader and application; (c) poorly designed/unlabeled forms; (d) no alt text for pictures; and (e) 3-way tie between misleading links, inaccessible PDF, and a screen reader crash. Most of the causes of frustration, such as inappropriate form and graphic labels and confusing page layout, are relatively simple to solve if Webmasters and Web designers focus on this effort. In addition, the more technically challenging frustrations, such as screen reader crashes and conflicts, need to be addressed by the screen reader developers. Blind users in this study were likely to repeatedly attempt to solve a frustration, not give up, and not reboot the computer. In this study, the blind users reported losing, on average, 30.4% of time due to these frustrating situations. Implications for Web developers, screen reader developers, and screen reader users are discussed in this article.

While previous studies have investigated the impact of frustration on computer users ’ mood as well as the causes of frustration, no research has ever been conducted to examine the relationship between computer frustrations and mood change for users with visual impairment. In this paper, we report on a study that examined the frustrating experiences and mood change of 100 participants, all with visual impairments, when they were browsing the web. The result shows that frustration does cause the participants ’ mood to deteriorate. However, the amount of time lost due to frustrating situations does not have a significant impact on users ’ mood, which is very different from the previous research on users without visual impairment. The impact on work seems to have the greatest impact on user mood. Categories & Subject Descriptors:

When hard-to-use computers cause users to become frustrated, it can affect workplace productivity, user mood and interactions with other co-workers. Previous research has examined the frustration that students and their families face in using computers. To learn more about the causes and measure the severity of user frustration with computers in the workplace, we collected modified time diaries from 50 workplace users, who spent an average of 5.1 hours on the computer. In this exploratory research, users reported wasting on average, 42 – 43% of their time on the computer due to frustrating experiences. The largest number of frustrating experiences occurred while using word processors, email and web browsers. The causes of the frustrating experiences, the time lost due to the frustrating experiences, and the effects of the frustrating experiences on the mood of the users are discussed in this paper. Implications for designers, managers, users, information technology staff and policymakers are discussed.

User frustration with information and computing technology is a pervasive and persistent problem. When computers crash, network congestion causes delays, and poor user interfaces trigger confusion there are dramatic consequences for individuals, organizations, and society. These frustrations, not only cause personal dissatisfaction and loss of self-efficacy, but may disrupt workplaces, slow learning, and reduce participation in local and national communities. Our exploratory study of 107 student computer users and 50 workplace computer users shows high levels of frustration and loss of 1/3–1/2 of time spent. This paper reports on the incident and individual factors that cause of frustration, and how they raise frustration severity. It examines the frustration impacts on the daily interactions of the users. The time lost and time to fix problem, and importance of task, strongly correlate with frustration levels for both student and workplace users. Differences between students and workplace users are discussed in the paper, as are implications for researchers.

The rapid growth of personal email communication, instant messaging and online communities has brought attention to the important role of interpersonal trust in online communication. An empirical study was conducted focusing on the effect of empathy on online interpersonal trust in textual IM. To be more specific, the relationship between empathic accuracy, response type and online interpersonal trust was investigated. The result suggests both empathic accuracy and response type have significant influence on online interpersonal trust. The interaction between empathic accuracy and response type also significantly influences online trust. Interestingly, the results imply a relationship between daily trust attitude and online interpersonal trust. People who are more trusting in their daily life may experience more difficulty in developing trust online. There is also some evidence to suggest that different communication scenarios may have an influence on online trust.

Although computers are beneficial to individuals and society, frequently users encounter frustrating experiences when using computers. This study represents an attempt to measure, in 111 participants, the frequency, the cause, and the level of severity of frustrating experiences. The data show that frustrating experiences happen on a frequent basis. The applications in which the frustrating experiences happened most frequently were Web browsing, e-mail, and word processing. The most-cited causes of frustrating experiences were error messages, dropped network connections, long download times, and hard-to-find features. The time lost due to frustrating experiences ranged from 47% to 53% of time spent on a computer, depending on the location and study method. After extreme cases were discarded, the time lost was still above 38%. These disturbing results should be a basis for future study.

Novice users frequently make errors when learning a new computer task and spend a large portion of their time trying to recover from errors. Three methods for helping novice users respond to errors have been presented in the literature: error management training, exploratory training, and conceptual models. In error management training, errors are presented as opportunities for learning, and users are instructed in strategies for coping with errors. In exploration, users are given an overview of their environment and are taught how to navigate through their task environment. Conceptual models are graphical or mathematical representations of a system that correspond closely to the real-world system. This experiment tested the effectiveness of these different approaches on training novice users to use the Internet. In this experiment, users received 3 hr of training on the World Wide Web and then were asked to perform a set of information retrieval tasks. Performance was measured in two ways: task performance and performance time. Participants who received exploratory training had significantly higher task performance. Participants who received exploration and conceptual models, both individually and together, were able to complete the tasks in less time. Error management had no significant effect on the performance of participants. In the task application of Web browsing, exploration seems to be the most appropriate training method for novice users.