Spreadsheets are a widespread functional programming paradigm that offer liveness and directness of interaction. However, spreadsheets are notoriously error-prone and difficult to debug. To overcome this limitation and improve the expressive power of spreadsheets, we propose an extension to the spreadsheet paradigm in the form of sheet-defined lambdas – user-defined functions that abstract computations on the sheet. This concept was developed and deployed in our web-based spreadsheet application named Lattice. We evaluate this approach through a user study which compared the user experience of programming in a spreadsheet with and without lambdas, as well as the difference in performance between learner (N = 12) and experienced (N = 12) programmers. The study measured participant task performance (task time, success rate and number of errors) and the quality of their user experience of using Lattice (video recordings of use, interviews and questionnaire responses). Our findings indicate that programming with lambdas is not only more efficient than writing formulas in a conventional way, but also provides a rewarding hedonic experience. However, we found that learners perceived the concept of functional abstractions with lambdas as difficult to comprehend; while experienced programmers noted potential utilitarian advantages that aid in managing the complexity of a spreadsheet program. The results obtained in this work contribute to a better understanding of human-spreadsheet interaction and can inform the future design of user-friendly computational systems.

This paper describes the process we undertook to develop a game-based approach to collect data for the diagnosis of dyslexia in children between the ages of 6 and 12 years old. A number of data collection approaches have been used previously such as eye tracking, MRI, EEG and game based approaches. Data collection can be a challenging task, as many of these approaches rely on use of specialized technology and in the case of MRI and EEG approaches, also require the presence of experts. In contrast, game based data collection is less intrusive and does not require the presence of experts or specialized devices. The content of the game in this research work was designed by identifying the problems faced by children with dyslexia in different age groups, designing questions to evaluate these problems and finally, validating the game design through two formative evaluations and with domain experts. This initial study and its statistical analysis showed a significant difference in the performance of children with dyslexia from children without dyslexia when playing the game.

The emergence of new technologies is providing opportunities to develop novel solutions that facilitate the integration of visually-impaired people in different activities of our daily life, including collective music making. This paper presents a study conducted with visually-impaired music performers, which involved a participatory approach to the design of accessible technologies for musical communication in group playing. We report on three workshops that were conducted together with members of an established ensemble of solely visually-impaired musicians. The first workshop focused on the identification of the participants’ needs during the activity of playing in groups and how technology could satisfy such needs. The second and third workshops investigated, respectively, the activities of choir singing and instrument playing in ensemble, focusing on the key issue of synchronisation that was identified in the first workshop. The workshops involved prototypes of musical haptic wearables, which were co-designed and evaluated by the participants. Overall, results indicate that wireless tactile communication represents a promising avenue to cater effectively to the needs of visually-impaired performers.

Graphical displays are a typical means for conveying awareness information in groupware systems to help users track joint activities, but are not ideal when vision is constrained. Understanding how people maintain awareness through non-visual means is crucial for designing effective alternatives for supporting awareness in such situations. We present a lab study simulating an extreme scenario where 32 pairs of participants use an audio-only tool to edit shared audio menus. Our aim is to characterise collaboration in this audio-only space in order to identify whether and how, by itself, audio can mediate collaboration. Our findings show that the means for audio delivery and choice of working styles in this space influence types and patterns of awareness information exchange. We thus highlight the need to accommodate different working styles when designing audio support for awareness, and extend previous research by identifying types of awareness information to convey in response to group work dynamics.

The objective of the work reported here is to develop an understanding of cross-modal collaborative information-seeking (CCIS) between visually impaired (VI) and sighted users in order to learn how best to support it. In a previous article, we reported the CCIS process that occurred when 14 pairs of users, one sighted and one VI, performed web-based collaborative information-seeking (CIS) tasks in two settings: co-located and distributed. In that study, participants used their tools of choice: web browsers, search engines, notetakers and communication tools. We discussed the difficulties encountered, including those imposed on VI users due to the current limitations of screen readers. In this article, we report a study using the same participants undertaking similar search tasks, but this time using a commercially available CIS system, which we enhanced to improve its accessibility. In this study, in order to examine the impact of the interface on the process, we looked at the CCIS process from two perspectives: the actions of individuals collaborating with one another and the interactions of each individual with each interface. The results showed that both sighted and VI users benefited from the use of an integrated, purpose-built tool, both in terms of task performance and levels of satisfaction. The analysis of these interactions is then used to formulate guidelines for the design of accessible CCIS systems.

There is a growing research interest in combining crossmodal research with tangible interaction design. However, most behavioural research on crossmodal perception and on multimodal tangible interaction evaluation are based on static and non-interactive signals. Grounded in the cognitive neuroscience studies and behavioural research on multisensory perception, we present two interactive, dynamic crossmodal studies based on unimodal and crossmodal physical dimensions through an interactive table-top. We tested the implementation in two user studies. Results indicate that first, dynamic crossmodal congruency was spontaneously invoked during the tangible interaction and elicited better user performance than uni-modal instantiation in the conditions involving vision and haptics, second, crossmodal instantiations using all three modalities may not produce the best user performance in the interaction, and third, participant's subconscious reaction towards perceived stimuli during interaction may not always consistent with their explicit verbalization.

Expression in musical practice is inextricably tied to the touch of the performer. In digital musical instruments (DMIs) the relationship of touch to sound is indirect: the nuances and fine detail of performer control can be flattened and limited during the translation of physical gesture to physical sound. The locus of this research is in the contact made between performer and DMI: focusing on this area can grant insight on fundamental issues of human computer interaction, particularly regarding intimate and expressive control of tangible interfaces. In this paper I present my research on this topic so far, which includes empirical studies that focus on specific parameters of performance where touch plays an integral role. The first study investigates how dynamic vibrations in an instrument's body can guide the hand of a performer and assist with intonation. The second study looks at asynchrony between action and sound and the influence this latency has on the perceived quality of an instrument.

There is growing interest in the application of crossmodal perception to interface design.However, most research has focused on task performance measures and often ignored user experience and engagement.We present an examination of crossmodal congruence in terms of performance and engagement in the context of a memory task of audio, visual, and audio-visual stimuli.Participants in a first study showed improved performance when using a visual congruent mapping that was cancelled by the addition of audio to the baseline conditions, and a subjective preference for the audio-visual stimulus that was not reflected in the objective data.Based on these findings, we designed an audio-visual memory game to examine the effects of crossmodal congruence on user experience and engagement.Results showed higher engagement levels with congruent displays with some reported preference for potential challenge and enjoyment that an incongruent display may support, particularly for increased task complexity.

We present a study investigating the impact of dynamic tactile feedback on performer navigation of a continuous pitch space on a digital musical instrument. Ten musicians performed a series of blind pitch selection and melodic tasks on a self-contained digital musical instrument with audio-frequency tactile feedback that was generated in response to their interaction. Results from the study show that tactile feedback can positively impact a performer's ability to play in tune when the instrument is hidden from sight, however with a temporal impact on performance. Furthermore, several playing techniques were observed that emerged from the performer's engagement with the tactile feedback conditions. We discuss the implications of our findings in the context of tangible interface design and non-visual interface navigation. We also discuss how our implementation suggests guidelines for future instruments and interfaces incorporating dynamic tactile feedback and present a novel tactile feedback technique that uses tactile 'beating'.

Understanding the information‐seeking behavior of visually impaired users is essential to designing search interfaces that support them during their search tasks. In a previous article, we reported the information‐seeking behavior of visually impaired users when performing complex search tasks on the web, and we examined the difficulties encountered when interacting with search interfaces via speech‐based screen readers. In this article, we use our previous findings to inform the design of a search interface to support visually impaired users for complex information seeking. We particularly focus on implementing TrailNote, a tool to support visually impaired searchers in managing the search process, and we also redesign the spelling‐support mechanism using nonspeech sounds to address previously observed difficulties in interacting with this feature. To enhance the user experience, we have designed interface features to be technically accessible as well as usable with speech‐based screen readers. We have evaluated the proposed interface with 12 visually impaired users and studied how they interacted with the interface components. Our findings show that the search interface was effective in supporting participants for complex information seeking and that the proposed interface features were accessible and usable with speech‐based screen readers.

We present the evaluation of an interactive audio map system that enables blind and partially sighted users to explore and navigate city maps from the safety of their home using 3D audio and synthetic speech alone.We begin with a review of existing literature in the areas of spatial knowledge and wayfinding, auditory displays, and auditory map systems, before describing how this research builds on and differentiates itself from this body of work.One key requirement was the ability to quantify the effectiveness of the audio map, so we describe the design and implementation of the evaluation, which took the form of a game downloaded by participants to their own computers.The results demonstrate that participants (blind, partially sighted and sighted) have acquired detailed spatial knowledge and also that the availability of 3D audio cues significantly improves wayfinding performance.

Multi‐session search tasks are complex and span more than one web session. Such tasks are challenging because searchers must keep track of their search progress and the information they encounter across sessions. Multi‐session tasks can be cognitively taxing for visually impaired users because the lack of persistence of screen readers causes the load on working memory to be high. In this article, we first discuss the habitual behavior of visually impaired participants for multi‐session tasks when using popular search interfaces. We then present the evaluation of a search interface developed to support complex information seeking for visually impaired users. The user evaluation was structured in two sessions to simulate a multi‐session task. Thus, we discuss the strategies observed among participants to resume the search, to review previously encountered information, and to satisfy their evolved information need. We also compare the information‐seeking behavior across the two sessions and examine how the proposed interface supports participants for multi‐session tasks. Findings from this evaluation contribute to our understanding of the information‐seeking behavior of visually impaired users and have implications for the design of tools to support searchers to manage and make sense of information during multi‐session search tasks.

This paper describes our Experience-centered Design (ECD) inquiry into the current and potential role of digital photography to support interpersonal communication and expression in a class at a mixed special education needs school. Presented as a case study, we describe five classroom-based Creative Photography workshops that engaged pupils with a broad range of complex special needs, along with classroom staff. We further describe how, from these workshops, we generated a set of qualitative considerations for the design of digital photographic tools to support interpersonal communication and expression in this setting. Additionally, we present the preliminary evaluation of a photo-sorting tool that we developed in response. Our case study demonstrates how an ECD approach can guide an interaction design process in a special education needs setting, supporting interaction designers in understanding and responding pragmatically to the complex and dynamic interactions at play between the stakeholders.

There is an increasing desire to remain connected when physically distant and computer-mediated communication (CMC) is one means of satisfying this desire. In particular, there is a growing trend for individuals to use commercially available technology to connect with friends and family in social and leisure settings. Drawing on this trend, performative arts and existing telecommunications research, we identify the social practice of sharing a meal together as ripe for reinterpretation within CMC. We explore the opportunities to design a technology platform that supports remote guests in experiencing togetherness and playfulness within the practices of a traditional dinner party. Through both visual and aural channels as well as remote agency, the dinner guests were able to share a holistic telematic dining experience comparable to a traditional co-presence dinner. Based on the findings, we propose that one must consider the social structure and cultural background of users to inform the design of a technological intervention.

Abstract Understanding search behavior is important and leads to more effective interfaces that support searchers throughout the search process. In this article, through an observational user study, we investigate the search behavior of 15 visually impaired and 15 sighted searchers while they complete complex search tasks online. We study complex search tasks because they are challenging, cognitively intensive and affect performance of searchers. We compare the behavior of the two groups of searchers at four stages of the information‐seeking process namely, Query Formulation, Search Results Exploration, Query Reformulation, and Search Results Management. For each stage, we identify research questions to investigate the impact of speech‐based screen readers on the information‐seeking behavior of visually impaired users. Significant differences were observed during query formulation and in the use of query‐level support features such as query suggestions and spelling suggestions. In addition, screen‐reader users submitted a lower number of queries and displayed comparatively limited exploratory behavior during search results exploration. We investigate how a lack of visual cues affected visually impaired searchers' approach towards query reformulation and observed different strategies to manage and use information encountered during the search process. We discuss the implications that our findings have for the design of search interfaces and propose a set of design guidelines to consider when designing interfaces that are usable and accessible with screen readers. This work also enhances our understanding of search behavior when using an auditory interface and could be useful when designing audio‐based information retrieval systems.

Although research on non-visual access to visually represented information is steadily growing, very little work has investigated how such forms of representation could be constructed through non-visual means. We discuss in this paper our approach for providing audio access to relational diagrams using multiple perspective hierarchies, and describe the design of two interaction strategies for constructing and manipulating such diagrams through this approach. A comparative study that we conducted with sighted users showed that a non-guided strategy allowed for significantly faster interaction times, and that both strategies supported similar levels of diagram comprehension. Overall, the reported study revealed that using multiple perspective hierarchies to structure the information encoded in a relational diagram enabled users construct and manipulate such information through an audio-only interface, and that combining aspects from the guided and the non-guided strategies could support greater usability.

This paper presents an extensible schema for capturing laboratory gene variance data with its meta-data properties in a semi-structured environment. This paper also focuses on the issues of creating a local and task specific component database which is a subset of global data resources. An XML based genetic disorder component database schema is developed with adequate flexibilities to facilitate searching of gene mutation data. A web based search engine is developed that allows researchers to query a set of gene parameters obtained from local XML schema and subsequently allow them to automatically establish a link with the public domain gene databases. The application applies AJAX (asynchronous Javascript and XML), a cutting-edge web technology, to carry out the gene data searching function.

There is a need to assess the applicability of conventional Usability Evaluation Methods to users with disabilities, given the growing importance of involving these users in the usability evaluation process. We found that conventional Think Aloud Protocol cannot be used as is, and will require modification to be useful, when evaluating websites with blind users.

This paper proposes an approach for cross-modal user interface design using interaction patterns. A meta-domain is introduced in which the user interface can be designed without the determination of its realisation in a particular interaction domain. When fully described in the meta-domain, the user interface can be realised in different domains (visual, auditory, tactile etc) exploiting the strengths of each different mode to its maximum. The paper proposes a set of interaction patterns along with visual and auditory realisations. To prove the concept, a prototype was designed for a real-world application, Microsoft Explorer. An auditory display prototype was developed making extensive use of virtual audio environments for non-visual visualisation of objects in the Explorer interface, taking advantage of a spatial layout. The prototype was evaluated with visually impaired, blind and sighted computer users.

This paper proposes a framework based on the context of the Web data for interactions with different biological data resources so that a consolidated view of data can be achieved. A formal description of context of resources and their relationships have been described here using context graph. The context increases the interoperability by providing the description of the resources and the navigation plan for accessing the Web based databases. A higher level construct is developed to implement the context in RDF for Web interactions. The interaction among the resources is achieved by using a context based integration domain. The integration domain allows to navigate and execute the query plan within the resource databases.

This paper presents a novel approach to integrate biological data from multiple resources into a single page using image object keying. In this interactive approach, a gel electrophoresis protein spot is selected by the user which initiates the retrieval of corresponding 3D structure of the protein. It provides a set of operators to access and to collect elements content of the biological data resources for integration. The approach utilises a number of tools, namely, meta data extractor, mapping linker, dispatcher and result integrator for unifying the data collected from multiple data sources.

This paper reviews 'database interoperability' problems and suggests a framework for integrating molecular biology databases. It suggests a component database for gene mutation data which is subject-oriented and dedicated to a particular research laboratory, and outlines how to develop a cooperative environment for molecular biology databases to share information based on a common view. The paper also establishes the concept of image object keying for multi-database querying and it proposes a matching algorithm using gel electrophoresis images. This image object keying method could replace the conventional SQL scripts for multi-database querying.

In the past, Cscw systems have been studied with little consideration of the social context in which they will be used (see Ref. [1]). A framework of social context has been proposed [1] that takes the social aspects of a collaborating community to be a vital consideration in the design of Cscw systems. This paper aims to extend Mantovani's framework to deal with the issues of human error. The social context plays a large part in the cause, detection, level of consequence and recovery of erroneous actions in Cscw. This paper considers how current classification of human errors might be adapted for application in Cscw. A framework has been proposed which can be used in the analysis of the social context of Cscw.