Abstract Reconstructing outdoor environments from “inside-out” captures, where a camera moves within a restricted area but looks outward, remains challenging due to the presence of both well-textured nearby regions and low-detail distant backgrounds. We introduce a two-stage Gaussian Splatting framework that explicitly separates and optimizes these regions, yielding higher-fidelity novel view synthesis and allowing the replacement of the distant part with a high-quality, inpainted environment map to speedup the rendering process. In stage one, background primitives are initialized within a spherical shell and optimized using a loss that combines a background-only photometric term with two geometric regularizers: one constraining Gaussians to remain inside the shell, and another one aligning them with local tangential planes. In stage two, foreground Gaussians are initialized from a Structure-from-Motion reconstruction, added and refined using the standard rendering loss, while the background set remains fixed but contributes to the final image formation. Background Gaussians can be rendered to an object-free environment map that is inpainted to fill missing parts and can replace the Gaussian-based background for faster rendering. Experiments on diverse outdoor datasets show that our method reduces background artifacts and improves perceptual quality of novel view renderings compared to state-of-the-art baselines, including the removal of floaters in the navigation region.

In recent years, Augmented Reality (AR) technology has permeated various domains. This paper focuses on the critical aspect of enhancing customer interaction within AR e-commerce environments by investigating the impact of virtual product size manipulation on usability, user experience, and shopping satisfaction. We tested two manipulation modalities: an unconstrained scaling modality, enabling users to manually adjust product dimensions, and an assisted modality providing automatic 1:1 scaling. Using the Microsoft HoloLens 2 AR headset, we engaged 40 participants with small and large virtual products in shopping scenarios using these two manipulation modalities. Results show that users found the automatic manipulation modality to provide a superior user experience, being more effective, easy, useful, and pleasant when interacting with large virtual products. For small virtual products, they expressed a preference for free manipulation. Customer satisfaction with the shopping experience is positive, however, product size and manipulation modality affect the repatronage intention. The findings offer insights into designing AR e-commerce interfaces, highlighting that providing different manipulation modalities depending on the size of the products allows for enriching the shopping experience and improving the AR market potential.

In this demo we present an application featuring the integration of Virtual Reality (VR) technologies with the demonstration laboratory (ICELab) built around Industry 4.0/5.0 concepts. In particular, we showcase a digital twin of the real laboratory that allows the user to explore its environment in VR and interact with the different machinery to obtain several data and information.

In this paper, we present an example of complete integration of eXtended Reality technologies within a demonstration laboratory showcasing Industry 4.0/5.0 compliant machinery in realistic scenarios of use. We describe the design choices and the implementation of the augmented and virtual reality applications developed and potentially usable to support different real-world tasks, featuring advanced gesture-based interaction modes. We also describe the optimized communication architecture used to synchronize data between the cyber-physical factory environment with all its components, its industrial digital twin, and the augmented and virtual replica of the factory. Example tasks supported with the tools in public demonstrations allow users wearing Microsoft HoloLens 2 or Meta Quest 2 headsets to monitor the status of the prototype production line and operate on it, locally or remotely. An example video showing the applications is available in the supplementary material.

One of the most challenging aspects of the implementation of Virtual/Mixed reality training systems is the effective simulation of real-world manipulation of the physical devices included in control interfaces like buttons, sliders, levers, knobs, etc. In this paper we describe a mockup airplane cockpit (XR-Cockpit), featuring interactive components of this kind that demonstrate the feasibility of effective simulations of device manipulation using low cost hand tracking technology and gesture recognition. Based on this system, we performed a user study to compare the effectiveness of the interaction with virtual tools using different visualization solutions: immersive VR, optical and video see-through based MR. In our study, we also checked how well it is possible to perform manipulation of real objects wearing the two video see-through solutions. The analysis of the experimental results provides useful guidelines for the design of Virtual and Mixed Reality training systems involving virtual and physical actions on manipulation devices.