Augmented Reality (AR) technology has been widely investigated to support various navigation tasks, including initial approaches that suggest its potential use on ships. For maritime navigation, skippers use a variety of information displayed on a ship’s bridge. However, the constant shift of focus between this information and the outside view of the ship might pose cognitive as well as safety challenges. Here, AR could facilitate the navigation of ships by overlaying the real-world view with spatially anchored visual navigation aids. Despite this potential, previous work mainly presents conceptual approaches, technical tests, or user studies performed in ship simulators only.In this paper, we evaluate an AR-based assistance system in the actual real-world water environment, where technical issues and varying physical conditions could influence the system’s usability. In collaboration with hydrographic experts following a user-centered design approach, a functional AR system was developed that virtually displays navigation aids on the water surface. In a field study, ten skippers used the system to navigate a ship along a path through a port area. We assessed the accuracy, perceived workload, and user experience of participants. In addition, qualitative feedback was thematically analyzed to retrieve insights about the skippers’ attitude regarding using AR on actual ships. We report lessons learned about aspects such as ergonomics, perceived safety challenges, as well as envisioned further use cases and extended data integration.

Medical virtual agents (VAs) hold great potential to support patients in achieving their health goals, especially at times or in regions where the demand for physiological and psychological therapy exceeds the capacity of medical services. To create an accepted complement to on-site diagnosis, treatment, and counseling, it is critical to understand the impact of factors such as the agent’s visual representation, behavior, and responsibilities on creating a trustworthy human-agent relationship. To gain insights into these factors, we conducted a systematic literature review including 59 papers on embodied VAs in the medical domain. Our review focused on the application fields and the role of VAs in medicine, as well as the technology used to display them. Using thematic analysis, we discuss our findings in terms of user preferences, as well as potentials and barriers faced in the interaction with medical VAs. Concerning the visual representation, the users’ wish for customization in terms of appearance and communication modalities was pointed out. It was also important that the agent’s information builds up on trustworthy sources, that they are motivating and adapted to the users’ knowledge. Finally, our results identify research gaps, in particular regarding the technological implementation and the use of artificial intelligence.

Developers of interactive systems have a variety of interaction techniques to choose from, each with individual strengths and limitations in terms of the considered task, context, and users. While there are taxonomies for desktop, mobile, and virtual reality applications, augmented reality (AR) taxonomies have not been established yet. However, recent advances in immersive AR technology (i.e., head-worn or projection-based AR), such as the emergence of untethered headsets with integrated gesture and speech sensors, have enabled the inclusion of additional input modalities and, therefore, novel multimodal interaction methods have been introduced. To provide an overview of interaction techniques for current immersive AR systems, we conducted a literature review of publications between 2016 and 2021. Based on 44 relevant papers, we developed a comprehensive taxonomy focusing on two identified dimensions – task and modality. We further present an adaptation of an iterative taxonomy development method to the field of human-computer interaction. Finally, we discuss observed trends and implications for future work.

Augmented reality (AR) provides enormous potential to improve navigation assistance interfaces by displaying information directly into the user's field of view. In maritime contexts, such AR interfaces could supplement conventional solutions that require users to interpret spatial positions visualized on two-dimensional maps. In order to design useful navigation assistance, it is crucial to understand how egocentric distances of displayed objects are perceived and how different design attributes influence depth estimation. While previous research mainly focused on depth perception in indoor environments and rather short distances, this paper presents an investigation of the perceived egocentric distance of virtual objects in distances up to 75 meters in an open outdoor environment. In a perceptual matching task experiment using the Microsoft HoloLens 2, participants had to move objects with different (i) shape, (ii) coloration, and (iii) relation to floor to various target distances. Our results suggest that participants overestimated the distance to virtual objects across all tested distances since they significantly underproduced target distances for all investigated design factors. Based on these results, we explored potential design implications for a maritime AR navigation assistance on a ship in the local port area.