Abstract This paper presents a brainstorming tool combined with pointing gestures to improve the brainstorming meeting experience for blind and visually impaired people (BVIP). In brainstorming meetings, BVIPs are not able to participate in the conversation as well as sighted users because of the unavailability of supporting tools for understanding the explicit and implicit meaning of the non-verbal communication (NVC). Therefore, the proposed system assists BVIP in interpreting pointing gestures which play an important role in non-verbal communication. Our system will help BVIP to access the contents of a Metaplan card, a team member in the brainstorming meeting is referring to by pointing. The prototype of our system shows that targets on the screen a user is pointing at can be detected with 80% accuracy.

Abstract Adaptive user interfaces are user interfaces that dynamically adapt to the users’ preferences and abilities. These user interfaces have great potential to improve accessibility of user interfaces for people with cognitive disabilities. However automatic changes to user interfaces driven by adaptivity are also in contradiction to accessibility guidelines, as consistence of user interfaces is of utmost importance for people with cognitive disabilities. This paper describes how such user interfaces are implemented within the Easy Reading framework, a framework to improve the accessibility of web-pages for people with cognitive disabilities.

Abstract In recent years, assistive technology and digital accessibility for blind and visually impaired people (BVIP) has been significantly improved. Yet, group discussions, especially in a business context, are still challenging as non-verbal communication (NVC) is often depicted on digital whiteboards, including deictic gestures paired with visual artifacts. However, as NVC heavily relies on the visual perception, whichrepresents a large amount of detail, an adaptive approach is required that identifies the most relevant information for BVIP. Additionally, visual artifacts usually rely on spatial properties such as position, orientation, and dimensions to convey essential information such as hierarchy, cohesion, and importance that is often not accessible to the BVIP. In this paper, we investigate the requirements of BVIP during brainstorming sessions and, based on our findings, provide an accessible multimodal tool that uses non-verbal and spatial cues as an additional layer of information. Further, we contribute by presenting a set of input and output modalities that encode and decode information with respect to the individual demands of BVIP and the requirements of different use cases.

Abstract This paper discusses the design and evaluation of AUDiaL (Accessible Universal Diagrams through Language). AUDiaL is a web-based, accessible natural language interface (NLI) prototype that allows blind persons to access statistical charts, such as bar and line charts, by means of free-formed analytical and navigational queries expressed in natural language. Initial evaluation shows that NLIs are an innovative, promising approach to accessibility of knowledge representation graphics, since, as opposed to traditional approaches, they do not require of additional software/hardware nor user training while allowing users to carry out most tasks commonly supported by data visualization techniques in an efficient, natural manner.

Abstract This paper introduces a proof of concept software reasoner that aims to detect whether an individual user is in need of cognitive assistance during a typical Web browsing session. The implemented reasoner is part of the Easy Reading browser extension for Firefox. It aims to infer the user’s current cognitive state by collecting and analyzing user’s physiological data in real time, such as eye tracking, heart beat rate and variability, and blink rate. In addition, when the reasoner determines that the user is in need of help it automatically triggers a support tool appropriate for the individual user and Web content being consumed. By framing the problem as a Markov Decision Process, typical policy control methods found in the Reinforcement Learning literature, such as Q-learning, can be employed to tackle the learning problem.

Abstract Digital technologies can improve the daily lives of people with cognitive disabilities, allowing them to participate and communicate in society. However the success of a technical product depends not only on the price or lifespan, but also on its user experience. To ensure user satisfaction when creating new technology or products, it is necessary to know their needs. This article presents methods of requirements analysis and elicitation for digital participation together with people with cognitive impairments.

For comprehensively participating in society, independent and safe mobility is an important skill for many daily activities. Spatial cognition is one of the most important human capabilities and addresses the acquisition, processing and utilization of knowledge about the spatial layout of environments. Humans predominantly use the visual sense for this and for blind and low vision people, the lack of spatial perception reduces their quality of life and their ability of independent living. In particular the spatial navigation in unknown environments imposes challenges, since there is no possibility to train navigation tasks in advance. Today, blind and visually impaired people still rely on traditional navigation aids such as a cane for micro-navigation, which - however - does not help for developing orientation at larger scale or for planning of routes. To overcome this problem, this paper introduces the concept of a virtual environment that allows experiencing unknown locations by real walking while still staying in a sage controlled environment. Since this virtual environment can be controlled in its complexity, it can be adjusted from an abstract training scenario to a real-life situation such as train stations or airports.

Abstract Natural language interfaces (NLIs) are a novel approach to non-visual accessibility of diagrammatic representations, such as statistical charts. This paper introduces a number of methods that aim to compensate for the lack of sight when accessing semantically-enhanced diagrams through a Web-based NLI.

In this paper we describe a software model that we have developed within the framework of the MaWEn project (Mathematical Working Environment). Based on the MathML standard, this model enables collaboration between sighted people and users of Braille. It allows for synchronisation of Braille and graphical views of scientific contents as well as offering improved navigational functions for Braille users, in both reading and editing modes. The UMCL (Universal Maths Conversion Library) is used to support various national Braille Mathematical notations. After presenting the model, its implementation in MaWEn prototypes is described.

We describe the UMA system, a system developed under a multi-institution collaboration for making mathematics universally accessible. The UMA system includes translators that freely inter-convert mathematical documents transcribed in formats used by unsighted individual (Nemeth, Marburg) to those used by sighted individuals (LaTeX, Math-ML, OpenMath) and vice versa. The UMA system also includes notation-independent tools for aural navigation of mathematics. In this paper, we give an overview of the UMA system and the techniques used for realizing it.