Human-computer cooperation is emerging as a key trend in human-computer interaction. Humans and AI communicate through interface layouts structured by semantic dialogue logic. This study investigates the cognitive characteristics of humans when interacting with different interface layouts (Copilot and OS agent) and AI roles under varying modes of human-computer cooperation. By integrating behavioral and eye-tracking data, this research examines how Copilot and OS agents and interfaces are influenced by semantic logic (generative and task-oriented) respectively. The leading role of either humans + AI or AI in cooperation determines the appropriate semantic logic, which subsequently shapes the corresponding interface layout. This study further clarifies how different modes of human-computer cooperation, interface layouts, and dialogue logics are interrelated, and how these factors collectively influence cooperative behavior. Additionally, it explores the underlying cognitive mechanisms of interface design through the lens of semantic dialogue logic and the cooperative distribution between humans and AI.

Multiple-view visualisation leads to additional switching cost on attention management between viewports. In this study, we compare the cueing effect of chromatic and achromatic colours on mitigating viewport switching cost in multiple-view visualisations through the dual-task paradigm. There is a concurrent need for managing attention within and between viewports, and performing a three single-digit mental addition task, which poses challenge for the capacity-limited working memory (WM). Response time and total fixation count support the benefit of chromatic colours in within-viewport attention management. First-pass progressive fixation time reveals that chromatic colours lead to better coherence within the viewport than achromatic colours, and there exist a correction process for attention misguidance in invalid cueing conditions. We employed re-visitation count and duration as direct measures of WM reinstatement. Fewer re-visitation count and shorter duration in the valid chromatic cueing condition indicate that more WM resources were freed up for the primary task, and reduced resources were depleted on overcoming the viewport switching cost. The positive role of valid chromatic colour cues become increasingly evident when more viewports presented simultaneously. The study provides eye movement evidence that chromatic cues can effectively lessen the switching cost on attention management in multiple-view visualisations.

Abstract In the present study, we focus on the priming effect of colour on mitigating the attentional reorientation cost, which is led by re-constructing the frame of reference for attention shift and visual search in sequential presentations of temporal data visualization. The study involves two experiments using complementary recordings of behavioural performance and eye-tracking events. Two aspects of colour primes are highlighted: the prime validity and the colour perceptual accessibility. A task paradigm integrating the feature search and keeping-track task was adopted in our experiments. In Experiment 1 (with a group of 16 participants), we confirmed the colour priming effect by comparing the priming condition to the neutral baseline. Furthermore, global colours that are with high perceptual accessibility generated more evident priming effects than local colours. However, more interferences in misguiding the attention to task-irrelevant regions were found when the global primes were invalid. In Experiment 2 (with another group of 15 participants), we verify the finding in Experiment 1 that global colours produced more pronounced priming effects in alleviating the attentional reorientation cost by comparing two groups of real-world visualizations with either global or local colours as the prime. Large saccades were initiated much earlier, and the search efficiency got improved when provided with global colours. We conjecture that the facilitatory effect from global colours may stem from its benefit on the pre-attentive processing of the search field. The research findings provide evidence for utilizing colours as the primes in mitigating the attentional reorientation cost and accelerating visual search in sequential presentations.

This research presents a new approach to explore the relationship between perception of product's color and their image. Event-related potentials (ERP) are used to reveal the brain responds to variation of image words within the same color category. Sofa was used as an example in this study. Firstly, all of the sample sofa pictures were made in the warm color tone according to the HSB color space; Next, through a questionnaire survey, we deduced that the three adjective words to match the color in three degree are: (i) passionate, (ii)mild, (iii) refreshing. The evaluation result showed that the reaction time were shorter for Related (passionate) and Conflict words (mild) than for the Vague word (refreshing). P200 and N400 components were identified in the -100 to 600 ms interval by the repeated analysis. The P200 component was larger for the related condition than for the unrelated condition, in addition, a right anterior P200 effect was observed. Meanwhile, the N400 component can be elicited by both Vague word and Conflict word, which suggested that these two kinds of word were not match the image of the target color. These findings reveal that the ERP can identify the relationship between semantic and perception of color sensitively, therefore, can help designers in achieving a desirable image of product's color effectively.