Nagaoka University of Technology
   
 

--

Kitajima, M., Toyota, M., and Nakahira, K.T. (2025)

Kitajima, M., Toyota, M., and Nakahira, K.T. (2025). Addressing the Symbol Grounding Problem in VR. AIVR 2025 : The Second International Conference on Artificial Intelligence and Immersive Virtual Reality, 56-62.

 

Addressing the Symbol Grounding Problem in VR

A Virtual Reality (VR) environment presents objects that the user perceives and interacts with. It then transitions to the next state, reflecting the content of the interaction that has occurred as a result of the user's perception of the objects. For the interaction between the VR environment and the user to continue seamlessly, the meanings assigned to the objects in the VR environment by the creator of VR applications and the meanings held by the user experiencing them must be consistent. In this study, we propose a method to realize seamless interaction between VR environments and users by considering the objects presented by VR environments as symbols and capturing the relationship between the meanings they contain and the meanings held by the users who experience them through the symbol grounding problem, which is regarded as a challenging issue in the field of artificial intelligence. Based on the Mode Human Processor with Realtime Constraints (MHP/RT), which is a cognitive architecture that can deal with action selections in everyday environments, we focus on the fact that the content of human action selections is based on memes that are handed down from generation to generation and should provide a basis for his/her understanding of the situation of the surrounding world, and suggest that the symbol grounding problem can be solved by observing and identifying memes.

Download