학술논문

Emergence of delayed reward learning from sensorimotor coordination
Document Type
Conference
Source
2005 IEEE/RSJ International Conference on Intelligent Robots and Systems Intelligent robots and systems Intelligent Robots and Systems, 2005. (IROS 2005). 2005 IEEE/RSJ International Conference on. :2272-2277 2005
Subject
Robotics and Control Systems
Computing and Processing
Delay
Robot sensing systems
Robot kinematics
Control systems
Autonomous agents
Intelligent robots
Data mining
Couplings
Learning
Artificial intelligence
sensorimotor coordination
autonomous agents
emergent behaviors
Language
ISSN
2153-0858
2153-0866
Abstract
When building autonomous robotic agents, designers almost always make assumptions about how the control system relates sensory information to motor actions, in order to provide the agent with a set of basic behaviors. This raises the question of how arbitrary these assumptions are, and to what extent the introduced biases reduce the potential for the generation of new behaviors arising from interaction with the environment. In this paper, we propose a new model of robot control architecture, consisting merely of homogeneous, non-hierarchical sensorimotor coupling. We show that a robot using this model can display coherent complex behaviors which emerge from the agent-environment interaction, such as tracking an object, or solving a task based on the temporal relationship between an early clue and a delayed reward.