Most countries are ageing rapidly, creating significant challenges in providing adequate care to elderly population. Older adults’ care centers face several difficulties in ensuring support able to address their diverse needs, due to several factors including increasing caregiver shortages, high variability in cognitive and health conditions of elderly, and challenges in delivering personalized interventions to them. Additionally, maintaining elderly engagement during cognitive training is often problematic due to the repetitive and impersonal nature of involved tasks. To address these limitations, we carried out a study investigating the use of a humanoid robot to deliver interactive, personalised serious games based on older adults' personal memories, to enhance relevance and engagement for them. The approach has been evaluated in a trial conducted in a center for older adults, involving users with varying cognitive abilities. Results indicated that such personalised games were well received by them, with a positive impact on their experience.

The use of humanoid robots in older adult training has recently started to be considered. We investigated a solution that offers serious games personalised to each individual, to stimulate more interest and participation in cognitive training. In particular, we have studied how to consider personal memories in customising humanoid robot games for Mild Cognitive Impaired (MCI) older adults. For this goal, a prototype platform for collecting and exploiting personal memories in associated games is presented. The memories are exploited by six games designed and implemented in a Pepper robot considering current practices. We report on a mixed-method study consisting of a two-phase trial that involved 15 MCI older adults. The participants first furnished some memories from their past, and then used two game versions regularly for twelve weeks, one personalised and one with general content. We collected both quantitative (through questionnaires and interaction log analysis) and qualitative feedback. The results provide useful information about the robot games’ impact on users and, more generally, for understanding how to introduce robot games based on personal memories in cognitive training programmes.

Current projections indicate that many countries worldwide are experiencing an increase in the older adult population. Thus, it is important to develop methodologies and tools to improve the quality of life of aging people in terms of their cognitive, social, and physical well-being. An area that is currently showing considerable potential in coping with cognitive decline associated with the aging process is digital serious games. Recent years have witnessed a significant attention increase toward this topic with contributions from several research communities. Although some previous work aimed to synthesize the main findings in related areas, a focused and systematic review categorizing and discussing the literature on cognitive training for older adults is still lacking. To this aim, we selected 113 relevant articles from four international databases. We analyzed them on different relevant dimensions, such as the interactive technologies employed in the games, the activities supported, the user profiles participating in the studies, the factors influencing user engagement and motivation, and the effects of training on the addressed cognitive functions. The analysis of the above dimensions is useful to uncover the factors that distinguish successful cognitive interventions from less effective ones and to facilitate the creation of engaging training programs tailored to the needs of older adults. At the same time, by highlighting promising avenues for further research, the review provides useful indications to researchers and practitioners interested in this field.

Cognitive developmental disorders are common in children and can affect various abilities. Attention Deficit/Hyperactivity Disorder (ADHD) is the most prevalent childhood psychiatric condition. This work presents PlayToPickUp, a serious game that aims to stimulate children in relevant cognitive domains (attention and error monitoring). A multidisciplinary team of experts and caregivers from two different centers that support therapeutic activities with such children participated from the games’s inception to the design and the evaluation of the game. Depending on the characteristics and abilities of the player, therapists can customize the game to provide training that best fits the skills and the needs of the child while maintaining the player’s motivation. After its development, the game was used over 2 months “in the wild” by children recruited by the two centers. In one case the children played with it within the regular activities offered by the training center. In the other one, the parents of the children were instructed by caregivers to have the children play the game at home. In the paper, we describe the experience gathered from such two studies run in parallel, discussing the aspects that worked better, those that represented difficulties, and the lesson learnt for future studies.

Welcome to this issue of the Proceedings of the ACM on Human-Computer Interaction, bringing together contributions from the community on Engineering Interactive Computing Systems (EICS). The EICS track of the PACM-HCI is the primary venue for research contributions at the intersection of Human-Computer Interaction (HCI) and Software Engineering.

In the last few years, several end-user tools have been designed to help people who are not professional developers in programming their smart environments. However, such tools are often based on structured visual editors providing abstract representations of the available connected sensors and objects, which can be problematic for end users, and do not particularly encourage their participation. This work aims to make the end-user experience of creating everyday automations involving various types of connected sensors and objects more engaging by replacing extensive, static, structured and comprehensive abstract visual tools with more narrowed, relevant, context-sensitive, dynamic, augmented reality-based representations. We present a solution for this purpose that mobile users can exploit through their smartphone. End users can use the smartphone camera to frame the relevant sensor or object through the developed prototype, then get the current automations associated with it, edit their definition, create new ones as well as monitor the automations involving the whole current environment. We also report a first user test of the developed prototype deployed in a home equipped with connected sensors and objects, which yielded positive feedback.

Welcome to this issue of the Proceedings of the ACM on Human-Computer Interaction, bringing together contributions from the community on Engineering Interactive Computing Systems (EICS). The EICS track of the PACM-HCI is the primary venue for research contributions at the intersection of Human-Computer Interaction (HCI) and Software Engineering. This year, over the three rounds of submissions, for the issue of PACM-HCI we received 68 valid submissions (out of 90 submissions in total), of which we carefully selected 19 papers, bringing our acceptance rate to 27.9%. The result of this selection process is presented in this issue of the Proceedings of the ACM.

This work aims to explore the potentialities of an end-user personalisation platform in industrial settings. In such a context, stakeholders with different roles and competencies collaborate to manage and control an environment where legacy machines coexist and interact with newer ones. Our goal is to provide a rule-based tool that allows end-users to build personalised solutions to respond quickly to the dynamic needs of factories. We report on a case study in the paper factory domain, in which the industrial aspects identified with expert stakeholders through interviews have been simulated and addressed through an extension of a personalisation platform. A first user test of the resulting environment has been carried out with a representative set of users, and has provided useful and encouraging feedback in terms of the potentialities of the proposed approach in industrial contexts.

Abstract The recent European legislation emphasizes the importance of enabling people with disabilities to have access to online information and services of public sector bodies. To this regard, automatic evaluation and monitoring of Web accessibility can play a key role for various stakeholders involved in creating and maintaining over time accessible products. In this paper we present the results of elicitation activities that we carried out in a European project to collect experience and feedback from Web commissioners, developers and content authors of websites and web applications. The purpose was to understand their current practices in addressing accessibility issues, identify the barriers they encounter when exploiting automatic support in ensuring the accessibility of Web resources, and receive indications about what functionalities they would like to exploit in order to better manage accessibility evaluation and monitoring.

In the coming years humanoid robots will be increasingly used in a variety of contexts, thereby presenting many opportunities to exploit their capabilities in terms of what they can sense and do. One main challenge is to design technologies that enable those who are not programming experts to personalize robot behaviour. We propose an end user development solution based on trigger-action personalization rules. We describe how it supports editing such rules and its underlying software architecture, and report on a user test that involved end user developers. The test results show that users were able to perform the robot personalization tasks with limited effort, and found the trigger-action environment usable and suitable for the proposed tasks. Overall, we show the potential for using trigger-action programming to make robot behaviour personalization possible even to people who are not professional software developers.

The main goal of this work is to better understand how vibrotactile feedback obtained through wearable actuators can support indoor orientation in unfamiliar buildings. We designed different wearable vibrotactile prototypes (two wristbands, a flexible/rigid glove, one wristband, a cap and two-bands), and we analysed them in a preliminary test with 7 users to identify the design aspects that are most relevant for a solution guiding a person indoor. We describe the design and its evaluation with 36 users, discussing the results that can be useful for developers who want to use this technology within applications that need support for indoor orientation.

Remote monitoring services should be strongly personalised to the specific needs, preferences, abilities and motivations of elderly, a population segment whose characteristics can largely vary and even dynamically evolve over time for the same individual, depending on changing needs and usage contexts. We present a demo showing how a platform supporting End User Development (EUD) of context-dependent applications has been customized for remotely assisting elderly people at home. The user-editable personalisation features are specified by using trigger-action rules. The platform has been integrated with various sensors and appliances, and an application for remotely monitoring older adults at home. The resulting environment supports the possibility of creating trigger-action rules that can actually be executed when relevant sensors indicate that specific events or conditions occurred.

This study aims to understand the potential of using vibrotactile stimulation for indoor orientation in complex, unfamiliar buildings. Four vibrotactile prototypes have been analysed and tested in initial trials in order to investigate the benefits and the problems of each solution. The main goal of this study is to reach a better understanding of the design aspects that make a vibrotactile solution intuitive and effective.

User interface modeling tools can play a useful role for engineering interactive systems. However, little is known about how these tools are used, the strategies and workarounds employed, and whether usability problems are encountered. To start answering this question, we run a user study with software engineers carrying out task modeling activities. The analysis of the data generated by an instrumented CTTE and an eye-tracker uncovers five workflows that illustrate how the task model hierarchy is populated and edited, operators are added to tasks, and when model consistency is checked. These findings inform design implications for task modeling tools and formulate hypotheses for future work.

Our life is characterized by the presence of a multitude of interactive devices and smart objects exploited for disparate goals in different contexts of use. Thus, it is impossible for application developers to predict at design time the devices and objects users will exploit, how they will be arranged, and in which situations and for which objectives they will be used. For such reasons, it is important to make end users able to easily and autonomously personalize the behaviour of their Internet of Things applications, so that they can better comply with their specific expectations. In this paper, we present a method and a set of tools that allow end users without programming experience to customize the context-dependent behaviour of their Web applications through the specification of trigger-action rules. The environment is able to support end-user specification of more flexible behaviour than what can be done with existing commercial tools, and it also includes an underlying infrastructure able to detect the possible contextual changes in order to achieve the desired behaviour. The resulting set of tools is able to support the dynamic creation and execution of personalized application versions more suitable for users’ needs in specific contexts of use. Thus, it represents a contribution to obtaining low threshold/high ceiling environments. We also report on an example application in the home automation domain, and a user study that has provided useful positive feedback.

In this work we present an environment able to support users in seamless access to Web applications in multi-device contexts. The environment supports dynamic push and pull of interactive Web applications, or parts of them, across desktop and mobile devices while preserving their state.

This article discusses how human–computer interaction (HCI) models can support the development of interactive applications based on Web services. It also introduces a specific method exploiting such models for this purpose and the associated tool support. An example application of the method for an educational scenario is presented. The results of an early test of the development environment are reported as well. Lastly, some conclusions are drawn along with indications for future work.

We discuss our solution for partial Web migration from large screens to mobile devices. It is based on multiple UI abstraction levels and some transformations that allow the migration of selected UI components to another device.

In this paper, we present a method and the associated tool support able to exploit Web services in model-based user interface development, starting with the results of a task analysis phase, and using the content of Web service annotations. The resulting environment is a powerful support for developing multi-device interactive applications based on Web Services, since it is able to generate usable service front ends specified in a variety of implementation languages. This is achieved through connecting pre-existing Web services with the task model of the interactive application that has to be built. Then, the task model is used as a starting point for the generation of corresponding user interfaces descriptions at different abstraction levels, through a number of transformations that aim to preserve the usability of the corresponding models or implementations. The environment also allows designers to specify and customize such transformations among various levels of detail of the user interface description.

Ubiquitous environments call for innovative uses of existing applications. In this paper we present our solution for partial Web migration: it allows users to interactively select parts of existing interfaces and have them migrate to a target device. The underlying supporting platform exploits logical user interface descriptions and a set of transformations. This environment is particularly useful for supporting mobile users accessing complex Web applications, such as various emerging mash-ups. We also show an example of use of our solution in a widespread Web application, and report on a user test.

Nowadays users are surrounded by environments characterized by an abundance of devices and appliances that they use for carrying out their everyday activities. In order to improve user experience, the surrounding environments should be intelligent enough to allow users to freely move around and be able to perform their tasks in a continuous manner, without forcing them to start their interactive session from scratch at each device change. In this paper, we present an agent-based solution able to support migration of interactive applications among various devices, including digital TVs and mobile devices, and therefore useful for users freely moving about in the home and outdoor. The aim is to provide users with a seamless and supportive environment for ubiquitous access in multi-device contexts of use. The proposed open architecture for migratory user interfaces (UIs) is composed of several agents. It exploits their functionalities and is able to automatically build logical descriptions of existing interactive Web applications and then dynamically generate UIs that are adapted to various types of target devices and implementation languages, including non-Web languages, with the state updated to the point at which it was left off in the previous device.

In this paper, we propose UbiCicero, a multi-device, location-aware museum guide able to opportunistically exploit large screens when users are nearby. Various types of games are included in addition to the museum and artwork descriptions. The mobile guide is equipped with an RFID reader, which detects nearby tagged artworks. By taking into account context-dependent information, including the current user position and behaviour history, as well as the type of device available, more personalised and relevant information is provided to the user, enabling a richer overall experience. We also present example applications of this solution and then discuss the results of first empirical tests performed to evaluate the usefulness and usability of the enhanced multi-device guide.

One important evolution in software applications is the spread of service-oriented architectures in ubiquitous environments. Such environments are characterized by a wide set of interactive devices, with interactive applications that exploit a number of functionalities developed beforehand and encapsulated in Web services. In this article, we discuss how a novel model-based UIDL can provide useful support both at design and runtime for these types of applications. Web service annotations can also be exploited for providing hints for user interface development at design time. At runtime the language is exploited to support dynamic generation of user interfaces adapted to the different devices at hand during the user interface migration process, which is particularly important in ubiquitous environments.

While several solutions for desktop user interface adaptation for mobile access have been proposed, there is still a lack of solutions able to automatically generate mobile versions taking semantic aspects into account. In this paper, we propose a general solution able to dynamically build logical descriptions of existing desktop Web site implementations, adapt the design to the target mobile device, and generate an implementation that preserves the original communications goals while taking into account the actual resources available in the target device. We describe the novel transformations supported by our new solution, show example applications and report on first user tests.

The availability of mobile and stationary devices opens up new challenges to support users in several contexts. Here we present a multi-device environment to support cooperation among museum visitors through games. In particular, we present a design and the associated implementation for using a combination of PDAs and public displays to enhance the learning experience in a museum setting by using game playing interactions. The basic assumption is to use the mobile devices for individual game play, and the situated displays for synchronized public views of shared game play; the individual game play contributes to the shared game.

This paper presents a new interaction technique - scan and tilt - aiming to enable a more natural interaction with mobile museum guides. Our work combines multiple modalities - gestures, physical selection, location, graphical and voice. In particular, physical selection is obtained by scanning RFID tags associated with the artworks, and tilt gestures are used to control and navigate the user interface and multimedia information. We report on how it has been applied to a mobile museum guide in order to enhance the user experience, providing details on a first user test carried out on our prototype.

The ever-increasing availability of new types of devices raises a number of issues for user interface designers and interactive software developers. We have designed and developed a tool (TERESA), which can be helpful when designing applications accessible through various device types.

The increasing availability of new types of interaction platforms raises a number of issues for designers and developers. There is a need for new methods and tools to support development of nomadic applications, which can be accessed through a variety of devices. We present a solution, based on the use of three levels of abstractions, that allows designers to focus on the relevant logical aspects and avoid dealing with a plethora of low-level details. We have defined a number of transformations able to obtain user interfaces from such abstractions, taking into account the available platforms and their interaction modalities while preserving usability. The transformations are supported by an authoring tool, TERESA, which provides designers and developers with various levels of automatic support and several possibilities for tailoring such transformations to their needs.

Model-based approaches can be useful when designing nomadic applications, which can be accessed through multiple interaction platforms. Various models and levels of abstraction can be considered in such approaches. The lack of automatic tool support has been the main limitation to their use. We present a tool, TERESA, supporting top-down transformations from task models to abstract user interfaces and then to user interfaces for different types of interaction platforms (such as mobile phones or desktop systems). It allows designers to keep a unitary view of the design of a given nomadic application. Moreover, the tool provides support for obtaining effective interfaces for each type of platform available, taking into account the consequent differences in terms of tasks and their performance

In this paper we present and discuss the integration of tools for the development and analysis of human–computer interaction models with formal verification techniques. We explain the method that we have developed and the tools that we have integrated for this purpose, and discuss how the resulting environment is more effective for designers of interactive applications than using current formal verification techniques alone. The main result is that designers can take advantage of the functionality of model-checking tools while still working with representations of the relevant models that they are familiar with in their practice. Thus, we show how tools can support such an approach and what design choices have been made to improve the usability of such an environment, allowing even people with little background in formal methods to use it.

The wide variety of devices currently available, which is bound to increase in the coming years, poses a number of issues for the design cycle of interactive software applications. Model-based approaches can provide useful support in addressing this new challenge. In this paper we present and discuss a method for the design of nomadic applications showing how the use of models can support their design. The aim is to enable each interaction device to support the appropriate tasks users expect to perform and designers to develop the various device-specific application modules in a consistent manner.

While task modeling and task-based design are entering into current practice in the design of interactive software applications, there is still a lack of tools supporting the development and analysis of task models. Such tools should provide developers with ways to represent tasks, including their attributes and objects and their temporal and semantic relationships, to easily create, analyze, and modify such representations and to simulate their dynamic behavior. In this paper, we present a tool, CTTE, that provides thorough support for developing and analyzing task models of cooperative applications, which can then be used to improve the design and evaluation of interactive software applications. We discuss how we have designed this environment and report on trials of its use.

The use of models has entered into current practice when developing various types of software product. However, there is a lack of methods able to use the information contained in relevant models concerning human-computer interaction for supporting the design and development of user interfaces. In this paper, we propose a method for using information contained in formally represented task models in order to support the design of interactive applications, with particular attention to those applications where both usability and safety are the main concern. Examples taken from our experience in a case study from the domain of Air Traffic Control are introduced and further discussed to explain how the method can be applied.

In this article we present a method for evaluating and comparing design options for allocating communication media. The method pays particular attention to how such options support cooperation in an interactive safety-critical system. The comparison is performed using three sets of criteria based on task performance, analysis of user deviations and consequent hazards, and coordination. The explicit emphasis on hazards and communication issues, using actual tasks to guide the evaluation, ensures that designers attention is focused on the interactions where problems are likely to occur. We describe an application of the method to the design of access to new communication technology in an air traffic control environment.

This paper presents and discusses the use of Semantic Multimedia Presentation Templates which capture presentation structures that are suitable for communicating semantic data relationships occurring across many applications. The identification of the space of the possible presentation templates along with criteria to evaluate them that depend on the current task, data cardinality and other aspects, is very useful for supporting the automatic generation of effective query result multimedia presentations.