Masao Yokota, Rojanee Khummongkol



Logical Model of Human Mental Image Processing in Spatiotemporal Language Understanding

pdf PDF


Natural language is the most convenient means that people use to communicate with each other conventionally. This is also the case for casual and intuitive interaction between ordinary non-expert people and artifacts such as robots. Therefore, it is doubtless that the technology of Natural Language Understanding (NLU) should play a key role at such scenes of humans and machines. In this paper, focusing on spatiotemporal (or 4D) language, NLU by human based on mental image is attempted to simulate so that robots can understand texts in the same way as people. The proposed methodology is quite distinguished from conventional ones and shows a good potential for providing robots with an NLU mechanism guided by humanlike awareness control based on mental image.


Natural language understanding, Mental image, Temporal logic, Knowledge representation


[1] A.M. Turing, Computing Machinery and Intelligence, Mind 49, pp. 433 – 460, 1950.

[2] T. Winograd, Shifting Viewpoints: Artificial Intelligence and Human-Computer Interaction, Artificial Intelligence, 2006.

[3] J. Weizenbaum, ELIZA – A Computer Program for the Study of Natural Language Communication Between Man and Machine, Communication of the ACM, 1966.

[4] I. Dagan, O. Glickman, and B. Magnini, The PASCAL recognizing textual entailment challenge, in Machine Learning Challenges, Springer Verlag, LNAI 3944, 2006.

[5] H.J. Levesque, The Winograd Schema Challenge, American Association for Artifical Intelligence, 2011.

[6] D. Ferrucci, et al, Building Watson: An Overview of the DeepQA Project, AAAI AI Magazine, Fall 2010.

[7] C. Thompson, What Is I.B.M.’s Watson?, The New York Times Magazine, June 16, 2010.

[8] D. Ferrucci and A. Lally, UIMA: An Architectural Approach to Unstructured Information Processing in the Corporate Research Environment, Journal of Natural Language Engineering, 2004.

[9] T. Götz and O. Suhre, Design and Implementation of the UIMA Common Analysis System, IBM System Journals, 2004.

[10] M. Yokota, An Approach to Natural Language Understanding Based on Mental Image Model, In Sharp,B. (ed.), Natural Language Understanding and Cognitive Science, pp. 22 – 31, INSTICC PRESS, 2005.

[11] M. Yokota, Aware Computing in Spatial Language Understanding Guided by Cognitively Inspired Knowledge Representation, Applied Computational Intelligence and Soft Computing, 2012.

[12] M. Yokota and R. Khummongkol, Representation and Computation of Human Intuitive Spatiotemporal Concepts as Mental Imagery, Awareness Science and Technology (iCAST), 2014.

[13] R. Khummongkol and M. Yokota, Simulation of Human Awareness Control in Spatiotemporal Language Understanding as Mental Image Processing, Independent Computing (ISIC), 2014.

[14] M. Yokota, A General Theory of Tempological Connectives and Its Applocation to Spatiotemporal Reasoning, Soft Computing and Intelligent Systems and Advanced Intelligent Systems, 2008.

[15] R. Navigli, Word Sense Disambiguation: A Survey, ACM Computing Surveys, 41-2, pp.1– 69, 2009.

[16] C.D. Manning and H. Schütze, Foundations of Statistical Natural Language Processing, MIT Press, 1999.

Cite this paper

Masao Yokota, Rojanee Khummongkol. (2016) Logical Model of Human Mental Image Processing in Spatiotemporal Language Understanding. International Journal of Computers, 1, 211-218


Copyright © 2017 Author(s) retain the copyright of this article.
This article is published under the terms of the Creative Commons Attribution License 4.0