We present GradualReality, a novel interface enabling a Cross Reality experience that includes gradual interaction with physical objects in a virtual environment and supports both presence and usability. Daily Cross Reality interaction is challenging as the user’s physical object interaction state is continuously changing over time, causing their attention to frequently shift between the virtual and physical worlds. As such, presence in the virtual environment and seamless usability for interacting with physical objects should be maintained at a high level. To address this issue, we present an Interaction State-Aware Blending approach that (i) balances immersion and interaction capability and (ii) provides a fine-grained, gradual transition between virtual and physical worlds. The key idea includes categorizing the flow of physical object interaction into multiple states and designing novel blending methods that offer optimal presence and sufficient physical awareness at each state. We performed extensive user studies and interviews with a working prototype and demonstrated that GradualReality provides better Cross Reality experiences compared to baselines.

We present LIVE, a system enabling a life-immersive Mixed Reality experience. Daily MR usage is challenging in that the user's interaction state with the physical objects continuously change over time, while the immersion and the utility should be supported simultaneously in the process. As many works of blending the virtual and physical world are designed for a single interaction state, they are not enough to support life-immersive MR. We propose the initial design of LIVE that (i) selects the current user's context among the three states of interaction with physical object and (ii) applies the most suitable blending method to balance immersion and the utility.

Dissemination of sensors and advances in techniques (e.g., network) has led to the opportunity for smart home. However, sensor malfunctions and difficult-to-diagnose characteristics hinder robust sensor system operation. Sensor anomaly detection systems for smart home have been proposed, but they target only a few specific types of sensor anomalies of a single sensor. In this work, we propose a sensor anomaly detection method based on Deep Neural Network (DNN), which automatically extracts critical features to detect the anomalies, even for simultaneous sporadic anomalies with complex data patterns. We leverage Hypersphere Classification (HSC) [14], the state-of-the-art DNN-based supervised outlier exposure method. We evaluate our proposed method on a public smart home sensor dataset. Our results show that the performances of the baselines drop up to 54.4% while ours drops up to 1.1%.