We introduce a model that accounts for cognitive mechanisms of learning and generating multiple goal-directed actions. The model employs the novel idea of the so-called “sensory forward model,” which is assumed to function in inferior parietal cortex for the generation of skilled behaviors in humans and monkeys. A set of different goal-directed actions can be generated by the sensory forward model by utilizing the initial sensitivity characteristics of its acquired forward dynamics. The analyses on our robotics experiments show qualitatively how generalization in learning can be achieved for situational variances, and how the top-down intention toward a specific goal state can reconcile with the bottom-up sensation from reality.
Arbib, M. (1981). Perceptual structures and distributed motor control . In Handbook of physiology: The nervous system, II. Motor control (pp. 1448—1480). Cambridge, MA: MIT Press.
2.
Beer, R. (1995). A dynamical systems perspective on agent— environment interaction. Artificial Intelligence, 72(1), 173—215.
3.
Bianco, R., & Nolfi, S. (2004). Evolving the neural controller for a robotic arm able to grasp objects on the basis of tactile sensors. Adaptive Behavior, 12(1), 37—45.
4.
Demiris, J., & Hayes, G. (2002). Imitation as a dual-route process featuring predictive and learning components: a biologically plausible computational model. In K. Dautenhahn & C. Nehaniv (Eds.), Imitation in animals and artifacts (pp. 321—361). Cambridge, MA: MIT Press.
5.
Doya, K., & Yoshizawa, S. (1989). Memorizing oscillatory patterns in the analog neuron network. In Proceedings of the 1989 International Joint Conference on Neural Networks (Vol. I, pp. 27—32). IEEE Press.
6.
Elman, J. (1990). Finding structure in time. Cognitive Science, 14, 179—211.
7.
Fogassi, L., Ferrari, P., Gesierich, B., Rozzi, S., Chersi, F., & Rizzolatti, G. (2005). Parietal lobe: From action organization to intention understanding. Science, 308, 662—667.
8.
Heilman, K. (1973). Ideational apraxia — a redefinition. Brain, 96, 861—864.
9.
Ito, M., & Tani, J. (2004). On-line imitative interaction with a humanoid robot using a dynamic neural network model of a mirror system. Adaptive Behavior, 12(2), 93—114.
10.
Jordan, M. (1986). Attractor dynamics and parallelism in a connectionist sequential machine. In Proceedings of the 8th Annual Conference of Cognitive Science Society (pp. 531— 546). Hillsdale, NJ: Erlbaum.
11.
Kawato, M., Furukawa, K., & Suzuki, R. (1987). A hierarchical neural network model for the control and learning of voluntary movement. Biological Cybernetics , 57, 169—185.
12.
Khatib, O. (1986). Real-time obstacle avoidance for manipulators and mobile robots. International Journal of Robotics Research , 5(1), 90—98.
13.
Liepmann, H. (1920). Apraxie. Erg ges Med, 1, 516—543.
14.
Luria, A. (1973). The working brain. New York : Basic Books.
15.
Nishimoto, R., & Tani, J. (2004). Learning to generate combinatorial action sequences utilizing the initial sensitivity of deterministic dynamical systems. Neural Networks, 17, 925—933.
16.
Oztop, E., & Arbib, M.A. (2002). Schema design and implementation of the grasp-related mirror neuron system. Biological Cybernetics, 87, 116—140.
17.
Oztop, E., Wolpert, D., & Kawato, M. (2005). Mental state inference using visual control parameters . Cognitive Brain Research, 22, 129—151.
18.
Paine, R., & Tani, J. (2005). How hierarchical control self-organizes in artificial adaptive systems. Adaptive Behavior, 13(3), 211—225.
19.
Rizzolatti, G., Fadiga, L., Galless, V., & Fogassi, L. (1996). Premotor cortex and the recognition of motor actions . Cognitive Brain Research, 3, 131—141.
20.
Rumelhart, D., Hinton, G., & Williams, R. (1986). Learning internal representations by error propagation . In D. Rumelhart & J. McClelland (Eds.), Parallel distributed processing (pp. 318—362). Cambridge, MA: MIT Press.
21.
Tani, J. (1996). Model-based learning for mobile robot navigation from the dynamical systems perspective. IEEE Transactions on Systems, Man, and Cybernetics B, 26(3), 421— 436.
22.
Tani, J. (2003). Learning to generate articulated behavior through the bottom-up and the top-down interaction process. Neural Networks, 16, 11—23.
23.
Tani, J., & Fukumura, N. (1994). Learning goal-directed sensory-based navigation of a mobile robot. Neural Networks, 7(3), 553—563.
24.
Tani, J., & Ito, M. (2003). Self-organization of behavioral primitives as multiple attractor dynamics: a robot experiment. IEEE Transactions on Systems, Man, and Cybernetics A, 33(4), 481—488.
25.
Tani, J., Ito, M., & Sugita, Y. (2004). Self-organization of distributedly represented multiple behavior schemata in a mirror system: Reviews of robot experiments using RNNPB. Neural Networks, 17, 1273—1289.
26.
Tani, J., & Nolfi, S. (1999). Learning to perceive the world as articulated: An approach for hierarchical learning in sensory-motor systems. Neural Networks, 12, 1131—1141.
27.
Wiggins, S. (1990). Introduction to applied nonlinear dynamical systems and chaos. New York: Springer-Verlag .
28.
Williams, R.J., & Zipser, D. (1989). A learning algorithm for continually running fully recurrent neural networks. Neural Computation, 1, 270—280.
29.
Wolpert, D., & Kawato, M. (1998). Multiple paired forward and inverse models for motor control. Neural Networks, 11, 1317—1329.
30.
Yamamoto, T., & Kuniyoshi, Y. (2002). Stability and controllability in a rising motion: A global dynamics approach. In Proceedings of IEEE International Conference on Intelligent Robots and System 2002 (pp. 2467—2472). IEEE Press.
