Generative AI makes creative work faster, but its fluent outputs can encourage premature acceptance, shallow evaluation, and loss of orientation across extended chats. We present ReasonScape, a redesign of the familiar chat user-interface that supports creative judgement during GenAI co-creation. ReasonScape replaces answer-first interaction with a guided workflow that (1) introduces brief reflection checkpoints to surface goals and constraints, (2) triggers sensemaking interventions for recurring evaluation gaps when reasoning shows signs of one-sidedness, inconsistency, or unexamined assumptions, and (3) externalises users’ evolving rationale through ReflectRail, a persistent rationale trail with direct navigation. A lightweight status view (ReflectMeter) shows which reflective checks are open without implying correctness. We report findings from two rounds of expert inquiry (n=16) indicating that the approach can keep evaluation lightweight and supportive, while highlighting calibration risks around frequency, tone, and stability. We conclude with design implications for creativity-support tools that balance reflective scaffolding with creative flow.

This study investigates how structured interventions—specifically pausing at natural breakpoints and guided note-taking—affect cognitive performance, memory retention, and task continuity in digital reading. We introduce SmartPause , a context-aware bookmarking system that nudges users to pause at meaningful points and externalise insights through lightweight notes. In a controlled experiment (N = 51), participants were assigned to one of three conditions: (1) interruption at an arbitrary point, (2) guided pause at a natural breakpoint, or (3) guided pause with note-taking. Results reveal that guided pauses, particularly when combined with note-taking, significantly enhance long-term memory retention while having no measurable impact on perceived cognitive load or selective attention. These findings highlight the potential of digital tools to support cognitive load management and task continuity by structuring interruptions in alignment with natural cognitive rhythms. The high usability rating of SmartPause underscores its practical applicability across e-reading platforms. This study contributes to human-computer interaction (HCI) by integrating principles from cognitive science into design solutions that enhance comprehension and information retention. Future research should explore personalised interventions, extended retention intervals, and real-world deployment to further optimise cognitive load in digital reading contexts.

Current sketch modeling methods face challenges in terms of efficiency and quality due to frequent view changes. To empower users to create models seamlessly and accurately from a single reference drawing, we present WidgetSketcher, a single-view, sketch-based modeling method that incorporates widget manipulations. To ensure seamlessness, we implement a single-view workflow in sketch-based modeling with designed widget manipulations and other interactions. Each user stroke is equipped with a transient axis widget, allowing 3D pose specification and part creation from a single view. To improve accuracy, we develop a two-stage shape generation algorithm, ensuring the precise generation of shapes with detailed features and asymmetry. Our method enables the quick and accurate creation of 3D models consistent with reference drawings, while eliminating frequent view changes. To demonstrate the efficiency of our method, we evaluate the system usability by conducting a user study and compare the results to state-of-the-art techniques.

We study user's valuations of smartphone sensing resources and the factors mediating them through a systematic auction study with 108 bids from$N=18$participants, two resource use conditions [fixed battery (FB) and variable battery (VB)] and three sensors (camera, microphone, and GPS) with differing energy and privacy costs. We use a second-price sealed-bid reverse auction as this allows us to elicit the participants’ truthful perceived value for sharing resources. We show that most users would be willing to share even highly-privacy intrusive sensors if they are sufficiently compensated. At the FB level, participants placed much lower value for sharing GPS (€13) than camera (€30) or microphone (€32.5). The values people place on sharing access to resources generally reflect four considerations: 1) the perceived value of the sensor type; 2) the value of the data captured by the sensor; 3) the impact of sharing on the device; and 4) personal variations related to sharing motives, personal tendencies, and the broader sharing context. We address the practical impact of our results by presenting two case studies (collaborative sensing and collaborative AI). Finally, we derive design implications for sharing sensing resources on personal devices.

The impact of digital technology on human cognition has become a topic of significant interest in recent years, with various studies highlighting the adverse effects on cognition, particularly attention. While the negative impact of digital applications on our attentional processes is well-documented, practical solutions to mitigate these detrimental effects are rare. In this paper, we propose Attention Mode as a design solution that aims to minimise the negative impacts of digital technology on attention by creating easy-to-understand and navigate user interfaces. This approach can help users focus on tasks, reduce cognitive load, and minimise distractions, ultimately improving their overall experience. We developed interaction mock-ups incorporating the Attention Mode and conducted a preliminary one-to-one sharing with 5 participants to analyse to get early feedback. It resulted in valuable feedback on how such a design focus could help users to focus on the content without distractive elements. By integrating the issues from the start of the design process instead of handling it as an afterthought, this work offers new insights into crafting user interfaces in a way that the negative impact of digital technology on attention is mitigated.

Abstract Lifelogging is a form of personal data collection which seeks to capture the totality of one’s experience through intelligent technology and sensors. Yet despite notable advancement in such technologies, there remain persistent challenges to developing interactive systems to analyse the types of large-scale personal collections often generated by lifelogging. In response to this, we present the Lifelog Application Design (LAD) model which is intended to address these challenges and support the design of more novel interactive systems that may target a broader range of application use cases. The model is deliberately structured to remain impartial to the specific personal data, technology platform, or application criterion, to provide maximum utility across the domain. We demonstrate this utility by exploring two case studies and a retrospective analysis of VRLE, a real-world application prototype developed to examine the potential of large-scale personal data retrieval in virtual reality. This work is based on the accumulation of insights garnered from involvement in a number of collaborative lifelogging projects over the past decade. It is our goal to encourage future researchers to utilise the LAD model to support the design and development of their own application prototypes and further solidify the model’s contribution to the domain as a whole.

The ever-increasing ubiquity of smart devices is creating new opportunities for people to interact and engage with digital information using multiple devices. In the simplest case this can refer to choosing which device to use for a particular task (e.g., phone, laptop or smartwatch), whereas a more complex example is simultaneously taking advantage of the capabilities of different devices (e.g., laptop and smart TV). Despite these types of opportunities becoming increasing available, currently the full potential of multi-device interactions is not being realized as people struggle to take advantage of them. As our first contribution, we study people’s willingness to engage with multi-device interactions and rank the factors that mediate this response through an online survey (N = 60). Our results show that users are strongly in favour of using multiple devices, but lack the awareness or information to engage with them, or feel that establishing the interactions is too laborious and would disrupt the fluidity of the interactions. Motivated by this result, as our second contribution we design and evaluate intelligent shifting cues, visualizations that offer information about available interaction opportunities and how to establish them, and study how they influence users willingness to engage in multi-device interactions. Results of our study show that the cues can be effective in helping people to engage with multiple devices, but that the suitability of the proposed device and fit with task are important mediating factors. We end the paper by deriving design implications for intelligent systems that can support people in engaging with multi-device interactions.

Touch-based devices, despite their mainstream availability, do not support a unified and efficient command selection mechanism, available on every platform and application. We advocate that hotkeys, conventionally used as a shortcut mechanism on desktop computers, could be generalized as a command selection mechanism for touch-based devices, even for keyboard-less applications. In this paper, we investigate the performance and usage of soft keyboard shortcuts or hotkeys (abbreviated SoftCuts) through two studies comparing different input methods across sitting, standing and walking conditions. Our results suggest that SoftCuts not only are appreciated by participants but also support rapid command selection with different devices and hand configurations. We also did not find evidence that walking deters their performance when using the Once input method.

Construction and sensing within malleable interfaces is usually limited by a number of constraints. Building the interface from diverse combinations of conductive and nonconductive soft materials, such as fabrics or foams combined with various sensors, complicates the manufacturing process and offers limited options in shaping. In this paper we propose "Unique Topologies for Acoustic Propagation" (UTAP), a novel approach for algorithmic design of malleable tangible interfaces. A fundamental feature of our approach is the implementation of algorithmically generated topologically distinct lattices that, attached to piezoelectric (PZT) transducers, allow us to sense and recognize changes in a modulated acoustic signal on deformation and classify it into different interaction states. Our systematic approach to manufacturing malleable interfaces opens possibilities to design shapes that allow implementation in a wide range of potential use cases. We demonstrate the UTAP approach on multiple interfaces assembled using laser cut and 3D printed lattices in conjunction with silicon compound moulding. Finally, we present a technical evaluation of our method based on studies of four distinct interface designs, assessing performance in sensing and localising simple deformations such as pressing on single and multiple spots, as well as different force levels and actions, including bending and twisting.

The vehicles of education have seen significant broadening with the proliferation of new technologies such as social media, microblogs, online references, multimedia, and interactive teaching tools. This paper summarizes research on the effect of using active learning methods to facilitate student learning and describes our experiences implementing group activities for a calculus course for first year university students at Singapore University of Technology and Design, a new design-centric university established in collaboration with Massachusetts Institute of Technology (MIT). We describe the educational impact of different pedagogical techniques, such as real-time response tools, hands on activities, mathematical modeling, visualization activities and motivational competitions on students with differing learning preferences in a unique cohort classroom setting. Based on faculty reflection and survey data, we provide guidelines on how to adopt the right set of active and group learning techniques to handle the changing learning preferences in the current and future generation of students.

This paper describes a fully-operational content-indexing and management system, designed for monitoring and profiling freight-based vehicular traffic in a seaport environment. The 'InSPeCT' system captures video footage of passing vehicles and uses tailored OCR to index the footage according to vehicle license plates and freight codes. In addition to real-time functionality such as alerting, the system provides advanced search techniques for the efficient retrieval of records, where each vehicle is profiled according to multi-angled video, context information, and links to external information sources. Currently being piloted at a busy national seaport, the feedback from port officials indicates the system to be extremely useful in supplementing their existing transportation-security structures.

Abstract This paper reports on an investigation into the scholarly impact of the TRECVid (Text Retrieval and Evaluation Conference, Video Retrieval Evaluation) benchmarking conferences between 2003 and 2009. The contribution of TRECVid to research in video retrieval is assessed by analyzing publication content to show the development of techniques and approaches over time and by analyzing publication impact through publication numbers and citation analysis. Popular conference and journal venues for TRECVid publications are identified in terms of number of citations received. For a selection of participants at different career stages, the relative importance of TRECVid publications in terms of citations vis à vis their other publications is investigated. TRECVid, as an evaluation conference, provides data on which research teams ‘scored’ highly against the evaluation criteria and the relationship between ‘top scoring’ teams at TRECVid and the ‘top scoring’ papers in terms of citations is analyzed. A strong relationship was found between ‘success’ at TRECVid and ‘success’ at citations both for high scoring and low scoring teams. The implications of the study in terms of the value of TRECVid as a research activity, and the value of bibliometric analysis as a research evaluation tool, are discussed.

Much effort has focused in recent years on developing more life-like robots. In this paper we propose a model of memory for robots, based on human digital memories, though our model incorporates an element of forgetting to ensure that the robotic memory appears more human and therefore can address some of the challenges for human-robot interaction.

In this work we discuss a new, but highly relevant, topic to the multimedia community; systems to inform individuals of their carbon footprint, which could ultimately effect change in community carbon footprint-related activities. The reduction of carbon emissions is now an important policy driver of many governments, and one of the major areas of focus is in reducing the energy demand from the consumers i.e. all of us individually.

In this paper, we present prototype interactive TV software that incorporates visual content analysis tools and social networking in the home TV. We present the challenges of working with the living room TV environment and outline how we have utilized visual processing and search technologies to address these challenges and create a novel prototype interactive TV system.

In this paper we describe how content-based analysis techniques can be used to provide much greater functionality to the users of an interactive TV (iTV) device. We describe several content-based multimedia analysis techniques and how some of these can be exploited in the iTV domain, resulting in the provision of a set of powerful functions for iTV users. To validate our ideas, we introduce an iTV application we developed which incorporates some of these techniques into a simple set of user features, in order to demonstrate the usefulness of content-based techniques for iTV. The contribution of this paper is not to provide an in-depth discussion on each of the individual content-based techniques, but rather to show how many of these powerful technologies can be incorporated into an interactive TV system.

Collaboration has been identified as an important aspect in information seeking. People meet to discuss and share ideas and through this interaction an information need is quite often identified. However the process of resolving this information need, through interacting with a search engine and performing a search task, is still an individual activity. We propose an environment which allows users to collaborate to satisfy a shared information need. We discuss ways to divide the search task amongst collaborators and propose the use of relevance feedback, a common information retrieval process, to enable the transfer of knowledge across collaborators during a search session. We describe the process by which co-searchers can collaborate effectively with little redundancy and how we can combine relevance judgements from multiple searchers into a coherent model for synchronous collaborative information retrieval

The Fischlar-TRECVid-2004 system was developed for Dublin City University's participation in the 2004 TRECVid video information retrieval benchmarking activity. The system allows search and retrieval of video shots from over 60 hours of content. The shot retrieval engine employed is based on a combination of query text matched against spoken dialogue combined with image-image matching where a still image (sourced externally), or a keyframe (from within the video archive itself), is matched against all keyframes in the video archive. Three separate text retrieval engines are employed for closed caption text, automatic speech recognition and video OCR. Visual shot matching is primarily based on MPEG-7 low-level descriptors. The system supports relevance feedback at the shot level enabling augmentation and refinement using relevant shots located by the user. Two variants of the system were developed, one that supports both text- and image-based searching and one that supports image only search. A user evaluation experiment compared the use of the two systems. Results show that while the system combining text- and image-based searching achieves greater retrieval effectiveness, users make more varied and extensive queries with the image only based searching version.

In this paper we present a technique for supporting mobile access to digital video archives without requiring explicit user queries. The idea is to infer the interests and needs of users from their WWW browsing history and represent those needs as persistent queries to the archive. An experiment, which we present here, suggests that this technique is effective for recommending video content to users on mobile devices. We also describe how to apply these findings to a mobile interface for a digital video archive.

Technological developments in content-based analysis of digital video information are undergoing much progress, with ideas for fully automatic systems now being proposed and demonstrated. Yet because we do not yet have robust operational video retrieval systems that can be deployed and used, the usual HCI practise of conducting a usage study and an informed iterative system design is thus not possible. Físchlár-News is one of the first automatic, content-based broadcast news analysis and archival systems that process broadcast news video so that users can search, browse, and play it in an easy-to-use manner with a conventional web browser. The system incorporates a number of state-of-the-art research components, some of which are not yet considered mature technology, yet it has been built to be robust enough to be deployed to users who are interested in access to daily news throughout a university campus. In this article we report and discuss a user-evaluation study conducted with 16 users, each of whom utilized the system freely for a one month period. Results from a detailed qualitative analysis are presented, looking at collected questionnaires, incident diaries, and interaction-log data. The findings suggest that our users employed the system in conjunction with their other news update methods, such as watching TV news at home and browsing online news websites at their workplace, their major concerns being up-to-dateness and coverage of the news content. They tried to accommodate the system to fit their established web browsing habits, and they found local news content and the ability to play self-contained news stories on their desktop as major values of the system. Our study also resulted in a detailed wishlist of new features which will help in the further development of both our and others' systems.

Handheld computing devices are becoming highly connected devices with high capacity storage. This has resulted in their being able to support storage of, and access to, personal photo archives. However the only means for mobile device users to browse such archives is typically a simple one-by-one scroll through image thumbnails in the order that they were taken, or by manually organising them based on folders. In this paper we describe a system for context-based browsing of personal digital photo archives. Photos are labeled with the GPS location and time they are taken and this is used to derive other context-based metadata such as weather conditions and daylight conditions. We present our prototype system for mobile digital photo retrieval, and an experimental evaluation illustrating the utility of location information for effective personal photo retrieval.

In recent years digital cameras have seen an enormous rise in popularity, leading to a huge increase in the quantity of digital photos being taken. This brings with it the challenge of organising these large collections. We preset work which organises personal digital photo collections based on date/time and GPS location, which we believe will become a key organisational methodology over the next few years as consumer digital cameras evolve to incorporate GPS and as cameras in mobile phones spread further. The accompanying video illustrates the results of our research into digital photo management tools which contains a series of screen and user interactions highlighting how a user utilises the tools we are developing to manage a personal archive of digital photos.

In this paper we give an outline of the Fischlar system developed to enable participation in the interactive search task within TRECVID 2003. TRECVID is an annual benchmarking exercise which measures the effectiveness of various video information retrieval tasks, including interactive retrieval. The accompanying video provides a usage scenario for our TRECVID2003 system which highlights how a user uses the system in order to perform retrieval of video shots.

This paper describes a demonstration system which automatically indexes broadcast television content for subsequent non-linear browsing. User-specified television programmes are captured in MPEG-1 format and analysed using a number of video indexing tools such as shot boundary detection, keyframe extraction, shot clustering and news story segmentation. A number of different interfaces have been developed which allow a user to browse the visual index created by these analysis tools. These interfaces are designed to facilitate users locating video content of particular interest. Once such content is located, the MPEG-1 bitstream can be streamed to the user in real-time. This paper describes both the high-level functionality of the system and the low-level indexing tools employed, as well as giving an overview of the different browsing mechanisms employed.