This paper proposes a new conceptual framework for modeling human action. There are too many aspects for describing human behavior, however, the paper proposes only seven dimensions that describe human experience. The first four dimensions describe physical characteristics consisting of 3D position and time. The remaining three dimensions describe physiological, psychological, and Social characteristics respectively. This model can be applied to the full range of human experiences. The methods for measuring each parameter of the seven dimensions are discussed. The process is exemplified in the Data Sensorium setup.

This paper proposes a new system architecture that includes human action. The system is composed of three parts; sensing, processing, and actuation. Based on the concept, a virtual museum with a spatial immersive display and a locomotion interface was developed. It provides a physical walking experience in the virtual exhibition space. We developed a digital twin of the Artizon Museum as the system’s content. The locomotion interface records the walking trajectory of the participant, which represents their action in the virtual exhibition space. The system was implemented and operated in public for four weeks.

This paper introduces Art Sensorium Project that is founded in Asia AI Institute of Musashino University. A main target of the project is to design and implement a system architecture of unified art collections for virtual art experiences. To provide art experiences, a projection-based VR system, called Data Sensorium, is used to stage art materials in a form of real-sized virtual reality. Furthermore, a system architecture of a multidatabase system for heterogeneous art collection archives is presented, so a set of integrated art data is applied to Data Sensorium for newly generated art experiences.

BigRobot Mk.2, which creates the body motion of a giant, is described. The robot has 10 actuated joints so that it can emulate the body motion of human. A pilot rides on the top of the robot and it moves according with walking action of the pilot. This function provides the pilot to the body sensation that is extended to an 8-m giant. The basic design, implementation, and performance evaluation of BigRobot Mk.2 are presented.

This paper describes about project “Data Sensorium” launched at the Asia AI Institute of Musashino University. Data Sensoriumis a conceptual framework of systems providing physical experience of content stored in database. Spatial immersive display is a key technology of Data Sensorium. This paper introduces prototype implementation of the concept and its application to environmental and architectural dataset.