|
|
|
-- Kitajima, M., Toyota, M., Dinet, J., Bystrzycki, A., Eby, A-M., and Gérard, M. (2024)Kitajima, M., Toyota, M., Dinet, J., Bystrzycki, A., Eby, A-M., and Gérard, M. (2024). Basic Senses and Their Implications for Immersive Virtual Reality Design. AIVR 2024 : The First International Conference on Artificial Intelligence and Immersive Virtual Reality, 31-38.
Basic Senses and Their Implications for Immersive Virtual Reality DesignExperiencing immersion in daily life, interacting with other agents, holds significant value. The object of the interaction may be an agent in the real world or one in the virtual world. Such experiences occur when sensory stimuli input from the five senses are integrated in the brain, and cognitive processing based on the results of that integration leads to the expression of selected behaviors, which are then accompanied by changes in the environment. A sense of immersion is created by the seamless integration of changes in the environment and in one's own state. In this study, we leverage the Model Human Processor with Realtime Constraints (MHP/RT), a cognitive architecture that can simulate human action selection and encompasses perceptual, cognitive, motor, and memory processes, and we argue that within the integration of multimodal sensory stimuli, P-Resonance -- a resonance occurring between environmental information and perceptual memory, and C-Resonance -- a subsequent resonance involving cognitive processes characterized by Two Minds and memory -- are pivotal components contributing to the sense of immersion. The state of the external world is perceived as M-dimensional information by the five senses. This is passed to cognitive processing via P- and C-Resonances, converted into N-dimensional motor information in memory. Further, it is physically executed in the external world. We argue that the basic senses of rhythm, space, and number exist as mechanisms for these resonances to occur. It is shown that the spatial sense involving vision, not functioning before human birth, is integrated after birth with the rhythmic sense, which had been developing before birth. Furthermore, the number sense involving higher-order object recognition is further integrated with growth, which suggests that these basic senses are involved in the basis for the expression of human behavior. We contend that a virtual environment that does not deviate from the basic sensory-based mechanisms, which manifest interactions in the real world, is essential for the generation of immersive experiences. Download
|