Nagaoka University of Technology English | Japanese
   

 

               

 

photo of Muneo Kitajima

Muneo Kitajima, Ph. D.

 

Affiliation

Emeritus Professor
Nagaoka University of Technology

 

Address

1603-1, Kamitomioka, Nagaoka, Niigata 940-2188, Japan

TEL: +81-258-47-9361

E-mail: mkitajima@kjs.nagaokaut.ac.jp

 

Publications

 

  

 


Biosketch

 

Muneo Kitajima is a cognitive scientist that covers cognitive modeling, information science and artificial intelligence. He is a professor at the Nagaoka University of Technology, Japan. His current research interests include cognitive architecture that is capable of simulating human beings' daily decision-making and action selection, ecology of networked society, and understanding synchronization between conscious and unconscious behavior under real time constraints. His work is summarized in the lecture note entitled O-PDP System: Structure and Process O-PDP System: Structure and Process - In Quest of a Unified Theory of Mind - presented at the Psychology and Neuroscience Lab, Lorraine University, France in March, 2018.

Dr. Kitajima has been a researcher with the National Institute of Advanced Industrial Science and Technology since 1980. He was a research associate at the University of Colorado in Boulder in 1991. He received his Doctorate in Engineering from the University of Waseda in 1986, and a BS and MS in Physics from the Tokyo Institute of Technology in 1978 and 1980, respectively. He moved to Nagaoka University of Technology in 2011 as a professor.

He started his research career at AIST (it was then called Industrial Products Research Institute) with the goal of developing a reading machine for the blind (1980 - 1985). He developed a novel method for recognizing printed Japanese characters. He then implemented the method with a prototype micro-computer-based reading machine that was capable of converting printed characters, captured by scanning a hand-held CCD camera, into synthesized voices at a speed of up to four phonemes per second. He earned his doctorate in 1986 from the University of Waseda as a result of this project.

His research interests then shifted to cognitive processes in human-computer interaction (HCI). He developed a formal representation system for human-computer interaction processes, that is used to make quantitative predictions about human performance, such as working memory load, ease of knowledge transfer, and so on. He published his first journal article in English from International Journal of Man-Machine Systems in 1989*.

In 1991, he visited the Institute of Cognitive Science, University of Colorado, Boulder, USA, as a research associate, to extend his research on cognitive modeling in HCI. He worked with a psychology professor Peter Polson, known as a developer of Cognitive Complexity Theory, and a psychology professor Walter Kintsch, who was the world's leading authority on text comprehension.

The meeting with Prof. Polson and Prof. Kintsch was the decisive event for Dr. Kitajima to shape his research career in the future. Especially, Kintsch's construction-integration theory of text comprehension has remained to be one of the theoretical foundations of his modeling work thereafter.

In collaboration with Prof. Polson, he has developed a computational model of skilled use of an application with a graphical user interface that explains errors made by experienced users in 1995*. The model is based on Hutchins, Holland, and Norman's (1986) analysis of direct manipulation and is implemented using Kintsch's construction-integration theory of action planning.

The action planning model has been expanded to include processes for comprehending instructions in 1997*. The expanded model is called the LICAI Model. LICAI is an acronym for the LInked model of Comprehension-based Action planning and Instruction taking. When LICAI is pronounced [li kai], the pronunciation is the same as the Japanese two-kanji word,

which means comprehension.

His research focus has shifted from passive target search, which the LICAI model was for, to active target search such as navigation in the Web or way-finding in the real environment. Collaboration with Prof. Polson, a model that simulates users' navigation through the Web, CoLiDeS - Comprehension-based Linked model of Deliberate Search - was developed in 2000. An important extension to the LICAI model was the inclusion of attention mechanism that enables the model to focus on a part of information abundant display for successful navigation (demo of the CoLiDeS model). The model provided a theoretical basis for the web usability evaluation method, Cognitive Walkthrough for the Web, or CWW in short, which was proposed in 2002*, 2003* and 2005* at the CHI conferences and has been constantly cited as one of the standard Web usability methods.

The outcome of his research has been published at several CHI conferences. At the CHI2001 conference in Seattle, he made another decisive encounter with Makoto Toyota, who is a system architect and has made a significant contribution in deploying mainframe computers in Japan in 1970's by adapting Operating Systems to Japan's environment. Toyota was interested in constructing a unified theory of mind, stimulated by the work by the geniuses Allen Newell and Herbert Simon, with the basis of the concept of autopoiesis, i.e., a theory of a human being's behavior that never halts as long as one is alive in the particular circumstances of the Gaia.

Toyota and Kitajima started their productive collaboration since then, and published its outcome of component theories, including Maximum Satisfaction Architecture (MSA), Structured Meme Theory (SMT), and Brain Information Hydrodynamics (BIH) at the Cognitive Science annual conferences, and then moved the place of their main activity to Biologically Inspired Cognitive Architectures, where they published Model-Human Processor with Realtime Constraints (MHP/RT) in 2011* and 2013* as a model that can simulate human beings' action selection in the everyday environments, consisting of the conscious and unconscious processes of Two Minds coined by Daniel Kahneman and the autonomous memory system. Along with the theoretical development, a theoretically motivated user study methodology, called Cognitive Chrono-Ethnography (CCE), was developed, which has been successfully applied to gain understanding of a variety of aspects of human behavior*. The outcome of collaboration is publicized at the site Organic Self-Consistent-Field Theory.

In 2016, the entire work was published as a book entitled "Memory and Action Selection in Human-Machine Interaction" from Wiley*. Recently, Toyota and Kitajima's work has been integrated as an "O-PDP System: Structure and Process O-PDP System: Structure and Process - In Quest of a Unified Theory of Mind -"*.

The theory has significant implications for considering human beings' behavior: it provides a basis for considering how the perception-cognition-motor processes and the memory process interact each other to shape coherent behaviors and develop from one's birth. This perspective has contributed to define the aspects to survey in the second cycle of PIAAC (Programme of International Assessment of Adults Competencies) of OECD, where Kitajima was invited as a leading researcher in the field of cognitive modeling of human-computer interaction for discussing the core concept of the 2nd cycle of PIAAC in the working group*.

Recently, he started a project of understanding immersive-ness in VR with Prof. Jérôme Dinet at the Psychology and Neuroscience Lab, Lorraine University, France, based on the theory, especially focusing on unconscious and conscious processes before and after the events of immersive-ness experience. They published a preliminary paper at Laval Virtual 2018 - VRIC, an ACM SIGGRAPH sponsored conferences.

 

  

 


Recent Publication

 

Muneo Kitajima. (2016) Memory and Action Selection in Human-Machine Interaction (Human-Machine Interaction Set: Information Systems, Web and Pervasive Computing). Wiley-ISTE.

-- go to bookstore

 


Recent Activities

 

  • 2024.4 - Paper(4.14) - AIVR 2024 : The First International Conference on Artificial Intelligence and Immersive Virtual Reality (2024.4, Venice, Italy), Kitajima, M., Toyota, M., Dinet, J., Bystrzycki, A., Eby, A-M., and Gérard, M: Basic Senses and Their Implications for Immersive Virtual Reality Design.
    -- html
  • 2024.4 - Paper(4.14) - AIVR 2024 : The First International Conference on Artificial Intelligence and Immersive Virtual Reality (2024.4, Venice, Italy), Nakagawa, T., Kitajima, M., and Nakahira, K.T.: Model-Based Analysis of the Differences in Sensory Perception between Real and Virtual Space : Toward "Adaptive Virtual Reality".
    -- html
  • 2024.4 - Paper(4.14) - COGNITIVE 2024 : The Sixteenth International Conference on Advanced Cognitive Technologies and Applications (2024.4, Venice, Italy), Nakahira, K.T., Kitajima, M., and Toyota, M.: Practice Stages for a Proficient Piano Player to Complete a Piece: Understanding the Process based on Two Minds.
    -- html
  • 2024.4 - Paper(4.14) - COGNITIVE 2024 : The Sixteenth International Conference on Advanced Cognitive Technologies and Applications (2024.4, Venice, Italy), Solt, J., Mailloux, A., Dinet, J., Da Silva, S.F., Kitajima, M., Nicolas, G.: Development of Children's Crossing Skills in Urban Area: Impact of Age and Traffic Density on Visual Exploration.
    -- html
  • 2023.6 - Paper(6.26) - COGNITIVE 2023 : The Fifteenth International Conference on Advanced Cognitive Technologies and Applications (2023.6, Nice, France), Kitajima, M., Toyota, M., and Dinet, J.: Art and Brain with Kazuo Takiguchi - Revealing the Meme Structure from the Process of Creating Traditional Crafts -.
    -- html
  • 2023.6 - Paper(6.26) - COGNITIVE 2023 : The Fifteenth International Conference on Advanced Cognitive Technologies and Applications (2023.6, Nice, France), Hanssen, M., Kitajima, M., and Lee, SH.: Cognitive Chrono-Ethnography (CCE) to Reveal Personal Walking Motivations and Nudging Habit Formation in Reaction.
    -- html
  • 2023.6 - Paper(6.26) - COGNITIVE 2023 : The Fifteenth International Conference on Advanced Cognitive Technologies and Applications (2023.6, Nice, France), Dinet, J., Kitajima, M., Fichet, L., Paquet, C., and Coursac, V.: A Gamified Sorting Test to Assess Cognitive Flexibility in Personnel Selection: A Pilot Study.
    -- html
  • 2023.6 - Paper(6.26) - COGNITIVE 2023 : The Fifteenth International Conference on Advanced Cognitive Technologies and Applications (2023.6, Nice, France), Nakahira, K.T., Harada, M., and Kitajima, M: Local-Global Reaction Map: Classification of Listeners by Pupil Response Characteristics when Listening to Sentences Including Emotion Induction Words - Toward Adaptive Design of Auditory Information -.
    -- html
  • 2022.12 - Journal Article(12.31) - International Journal on Advances in Intelligent Systems, 15, 188-200, Kitajima, M., Toyota, M., and Dinet, J.: "Guidelines for Designing Interactions Between Autonomous Artificial Systems and Human Beings to Achieve Sustainable Development Goals"
    -- html
  • 2022.4 - Paper(4.28) - COGNITIVE 2022 : The Fourteenth International Conference on Advanced Cognitive Technologies and Applications (2022.4, Barcelona, Spain), Kitajima, M., Toyota, M., Dinet, J., Amiot, C., Bauchet, C., and Verdel, H.: Language and Image in Behavioral Ecology.
    -- html
  • 2022.4 - Paper(4.28) - COGNITIVE 2022 : The Fourteenth International Conference on Advanced Cognitive Technologies and Applications (2022.4, Barcelona, Spain), Kitajima, M., Toyota, M., and Dinet, J.: Guidelines for Designing Interactions Between Autonomous Artificial Systems and Human Beings.
    -- html
  • 2021.12 - Journal Article(12.31) - International Journal on Advances in Systems and Measurements, 14, 148-161, Kitajima, M., Toyota, M., and Dinet, J.: "How Resonance Works for Development and Propagation of Memes"
    -- html
  • 2021.4 - Paper(4.23) - COGNITIVE 2021 : The Thirteenth International Conference on Advanced Cognitive Technologies and Applications (2021.4, Porto, Portugal), Kitajima, Toyota, and Dinet: The Role of Resonance in the Development and Propagation of Memes.
    -- html
  • 2021.2 - Full Paper - 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) (2021.2, Vienna, Austria), Murakami, Shino, Nakahira, and Kitajima: Effects of Emotion-induction Words on Memory of Viewing Visual Stimuli with Audio Guide.
    -- html
  • 2020.10 - Paper(10.25) - COGNITIVE 2020 : The Twelfth International Conference on Advanced Cognitive Technologies and Applications (2020.10, Nice, France), Kitajima: Cognitive Science Approach to Achieve SDGs.
    -- html
  • 2020.10 - Paper(10.25) - COGNITIVE 2020 : The Twelfth International Conference on Advanced Cognitive Technologies and Applications (2020.10, Nice, France), Dinet and Kitajima: The Concept of Resonance: From Physics to Cognitive Psychology.
    -- html
  • 2020.2 - Poster - 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) (2020.2, Valletta, Malta), Hirabayashi, Shino, Nakahira, and Kitajima: How Auditory Information Presentation Timings Affect Memory When Watching Omnidirectional Movie with Audio Guide.
    -- html
  • 2019.7 - Paper (7.25) - Cognitive Science 2019 (2019.7, Montreal), Kitajima: "Cognitive Chrono-Ethnography (CCE): A Behavioral Study Methodology Underpinned by the Cognitive Architecture, MHP/RT"
    -- html
  • 2019.5 - Paper(5.7) - COGNITIVE 2019 : The Eleventh International Conference on Advanced Cognitive Technologies and Applications (2019.5, Venice, Italy), Kitajima, Dinet and Toyota: Multimodal Interactions Viewed as Dual Process on Multi-Dimensional Memory Frames under Weak Synchronization.
    -- html
  • 2019.1 - Book Chapter (1.23) - Computer Vision, Imaging and Computer Graphics - Theory and Applications: 12th International Joint Conference, VISIGRAPP 2017, Porto, Portugal, February 27 - March 1, 2017, Revised Selected Papers (Communications in Computer and Information Science) (Ana Paula Cláudio and Dominique Bechmann, Paul Richard, Takehiko Yamaguchi, Lars Linsen, Alexandru Telea, Francisco Imai, and Alain Tremeau, Eds.), pp. 47-65. Springer (January 23, 2019). The Effect of Audio Guide on the Levels of Contentment of Museum Novices: Relationships between Visitors' Eye Movements, Audio Guide.
    -- html
  • 2018.4 - Paper(4.5) - VRIC '18: Virtual Reality International Conference - Laval Virtual VRIC '18, April 4 - 6, 2018, LAVAL, France (2018.4, Laval, France), Dinet and Kitajima: Immersive Interfaces for Engagement and Learning: Cognitive Implications.
    -- html
  • 2018.3 - invited talk(3.20) - Psychology and neuroscience lab, University of Larraine, Kitajima, M: "O-PDP: Structure and Process ~ In Quest of a Unified Theory of Mind ~"
    -- pdf
  • 2018.1 - Paper - VISIGRAPP 2018 : The 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (2018.1, Funchal, Maderia, Portugal), Kitajima: Nourishing Problem Solving Skills by Performing HCI Tasks -- Relationships between the Methods of Problem Solving (Retrieval, Discovery, or Search) and the Kinds of Acquired Problem Solving Skills
    -- html
  • 2017.6 - Paper(6.22) - 2017 3rd IEEE International Conference on Cybernetics (CYBCONF), Kitajima: Creating Memorable Experiences in Virtual Reality: Theory of Its Processes and Preliminary Eye-Tracking Study using Omnidirectional Movies with Audio-Guide
    -- html
  • 2017.6 - Paper - "Adaptive problem solving. Moving towards a new assessment domain in the second cycle of PIAAC", Greiff, S., Scheiter, K., Scherer, R., Borgonovi, F., Britt, A., Graesser, A., Kitajima, M., and Rouet, J. F., OECD
  • 2017.3 - Paper - VISIGRAPP 2017 : The 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (2017.3, Porto, Portugal), Nakahira, and Kitajima: Understanding Relationships between Reading Behavior and Difficulty Level of Musical Score based on Cognitive-behavioral Science - Competency Level Evaluation via Musical Score
    -- html
  • 2017.3 - Paper - VISIGRAPP 2017 : The 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (2017.3, Porto, Portugal), Egawa, and Kitajima: Utilization of Audio Guide for Enhancing Museum Experience - Relationships between Visitors' Eye Movements, Audio Guide Contents, and the Levels of Contentment
    -- html
  • 2016.2 - Book (2.8) - Memory and Action Selection in Human-Machine Interaction (Human-Machine Interaction Set: Information Systems, Web and Pervasive Computing), Kitajima, Wiley-ISTE
    -- go to publisher
  • 2016.2 - Paper(2.6) - IPSJ-CLE, Kitajima: Relationships between the methods of problem solving (retrieval, discovery, or search) and the kinds of acquired problem solving skills
    -- html
  • 2015.3 - Paper(3.26) - COGNITIVE 2015 : The Seventh International Conference on Advanced Cognitive Technologies and Applications (2015.3, Nice, France), Nakahira, Yamaguchi and Kitajima: Ecology of Spam Server Under Resilience Force in the e-Network Framework.
    -- html
  • 2015.3 - Paper(3.23) - COGNITIVE 2015 : The Seventh International Conference on Advanced Cognitive Technologies and Applications (2015.3, Nice, France), Kitajima and Toyota: Two Minds and Emotion.
    -- html
  • 2014.12 - Paper(12.5) - 22nd International Conference on Computers in Education (2014.12, Nara, Japan), Nakahira, Watanabe, and Kitajima: Assessment of Developmental Stages of Generic Skills: A Case Study.
    -- html
  • 2014.12 - Paper(12.3) - 22nd International Conference on Computers in Education (2014.12, Nara, Japan), Nakahira, and Kitajima: Understanding differences of eye movements patterns while reading musical scores between instructors and learners to design learner-centered teaching strategies.
    -- htnl
  • 2014.11 - Paper(11.9) - 5th International Conference of Biologically Inspired Cognitive Architectures 2014 (2014.11, MIT, Boston, USA), Kitajima, and Toyota: "The role of consciousness in memorization: Asymmetric functioning of consciousness in memory encoding and decoding."
    -- html
  • 2014.11 - Paper(11.9) - 5th International Conference of Biologically Inspired Cognitive Architectures 2014 (2014.11, MIT, Boston, USA), Kitajima, and Toyota: "Topological Considerations of Memory Structure."
    -- html
  • 2014.11 - Paper(11.9) - 5th International Conference of Biologically Inspired Cognitive Architectures 2014 (2014.11, MIT, Boston, USA), Kitajima, and Toyota: "Hierarchical structure of human action selection - An update of Newell's time scale of human action."
    -- html
  • 2014.7 - Poster(7.24) - Cognitive Science 2014 (2014.7, Quebec City), Kitajima: "Cognitive Chrono-Ethnography as a Methodology for Defining People's Future Needs and Its Application"
    -- html
  • 2013.8 - Poster(8.1) - Cognitive Science 2013 (2013.8, Berlin), Kitajima, and Toyota: "Distributed Memory System Architecture based on the Analyses of Human Brain Memory"
    -- html
  • 2013.7 - Workshop(7.5) - 2nd International Workshop on Interaction Design in Educational Environments (Angers, France), Nakahira, and Kitajima: "Development of a Student Centered Educational Design for Piano Playing and Singing Skills"
    -- html
  • 2013.6 - Journal Article - Biologically Inspired Cognitive Architectures, Kitajima, and Toyota: "Decision-making and action selection in Two Minds: An analysis based on Model Human Processor with Realtime Constraints (MHP/RT)"
    -- html
  • 2013.5 - Workshop(4.28) - CHI2013 workshop on "Avec le Temps! Time, Tempo, and Turns in Human-Computer Interaction" (Paris, France), Kitajima, and Toyota: "Designing Interactions for Two Minds with the Real Brain Model 'MHP/RT'"
    -- html
  • 2012.11 - Paper(11.1) - 3rd International Conference of Biologically Inspired Cognitive Architectures 2012 (2012.11, Palermo, Italy), Kitajima, and Toyota: Cognitive Chrono-Ethnography: A Methodology for Understanding Users for Designing Interactions Based on User Simulation with Cognitive Architectures
    -- html
  • 2012.11 - Paper(11.1) - 3rd International Conference of Biologically Inspired Cognitive Architectures 2012 (2012.11, Palermo, Italy), Kitajima, and Toyota: Decision-Making and Action Selection in Two Minds
    -- html
  • 2012.10 - Journal Article - Journal of Quality Assurance in Hospitality & Tourism, Kitajima, Tahira, Takahashi and Midorikawa: "Understanding Tourists' In Situ Behavior: A Cognitive Chrono-Ethnography Study of Visitors to a Hot Spring Resort"
    -- html
  • 2012.4 - Poster(4.14) - 11th International Conference on Cognitive Modeling (2012.4, Berlin, Germany), Kitajima, and Toyota: "The Role of Memory in MHP/RT: Organization, Function and Operation"
    -- html
  • 2012.2 - Paper(2.16) - IEA 2012: 18th World congress on Ergonomics - Designing a sustainable future (2012.2, Recife, Brazil), Kitajima: "Cognitive Chrono-Ethnography (CCE): a methodology for anticipating future user needs"
    -- html
  • 2012.2 - Paper(2.14) - IEA 2012: 18th World congress on Ergonomics - Designing a sustainable future (2012.2, Recife, Brazil), Nakajima, Yamada, and Kitajima: "Cognitive Chrono-Ethnography Lite"
    -- html
  • 2011.11 - Paper(11.6) - 2nd International Conference of Biologically Inspired Cognitive Architectures 2011 (2011.11, Arlington, Virginia, USA), Kitajima, and Toyota: "Four Processing Modes of in situ Human Behavior"
    -- html
  • 2011.10 - Journal Article - Behaviour & Information Technology, Kitajima and Toyota: "Simulating navigation behaviour based on the architecture model Model Human Processor with Real-Time Constraints (MHP/RT)"
    -- html
  • 2011.10 - Paper(10.25) - IHM 2011 (2011.10, Nice, France), Dinet, & Kitajima: ""Draw me the Web". Impact of mental model of the Web on information search performance of young users"
    -- html
  • 2011.7 - Poster(7.22) - Cognitive Science 2011 (2011.7, Boston), Kitajima, Toyota, Yoshino, Matsumoto, Tahira, and Miyaji: "Relationship Between Episodic Memory Formation and Two Minds"
    -- html
  • 2011.7 - Poster(7.21) - Cognitive Science 2011 (2011.7, Boston), Toyota, and Kitajima: "MultiDimensional (MD) Frame: The Basic Elements of Memory Structure"
    -- html
  • 2011.4 - Invited Talk (4.28) - Invited Talk at the Hyderabad ACM Chapter and Progress Software: "Navigation Processes: A Cognitive Scientific Account"
    -- html