An Evolutionary Ecological Approach to the Study of Learning Behavior Using a Robot-Based Model

We are interested in the construction of ecological models of the evolution of learning behavior using methodological tools developed in the field of evolutionary robotics. In this article, we explore the applicability of integrated (i.e., nonmodular) neural networks with fixed connection weights and simple 'leaky-integrator' neurons as controllers for autonomous learning robots. In contrast to Yamauchi and Beer (1994a), we show that such a control system is capable of integrating reactive and learned behaviour without explicitly needing hand-designed modules, dedicated to a particular behavior, or an externally introduced reinforcement signal. In our model, evolutionary and ecological contingencies structure the controller and the behavioral responses of the robot. This allows us to concentrate on examining the conditions under which learning behavior evolves.