Header logo is

Autonomous Identification and Goal-Directed Invocation of Event-Predictive Behavioral Primitives

2019

Article

al


Voluntary behavior of humans appears to be composed of small, elementary building blocks or behavioral primitives. While this modular organization seems crucial for the learning of complex motor skills and the flexible adaption of behavior to new circumstances, the problem of learning meaningful, compositional abstractions from sensorimotor experiences remains an open challenge. Here, we introduce a computational learning architecture, termed surprise-based behavioral modularization into event-predictive structures (SUBMODES), that explores behavior and identifies the underlying behavioral units completely from scratch. The SUBMODES architecture bootstraps sensorimotor exploration using a self-organizing neural controller. While exploring the behavioral capabilities of its own body, the system learns modular structures that predict the sensorimotor dynamics and generate the associated behavior. In line with recent theories of event perception, the system uses unexpected prediction error signals, i.e., surprise, to detect transitions between successive behavioral primitives. We show that, when applied to two robotic systems with completely different body kinematics, the system manages to learn a variety of complex behavioral primitives. Moreover, after initial self-exploration the system can use its learned predictive models progressively more effectively for invoking model predictive planning and goal-directed control in different tasks and environments.

Author(s): Christian Gumbsch and Martin V. Butz and Georg Martius
Journal: IEEE Transactions on Cognitive and Developmental Systems
Volume: 13
Number (issue): 2
Pages: 298--311
Year: 2019
Month: June

Department(s): Autonomous Learning
Research Project(s): Self-exploration of Behavior
Bibtex Type: Article (article)
Paper Type: Journal

DOI: 10.1109/TCDS.2019.2925890
State: Published
URL: https://ieeexplore.ieee.org/document/8753716

Links: arXiv
PDF
video
Video:

BibTex

@article{gumbsch2019autonomous,
  title = {Autonomous Identification and Goal-Directed Invocation of Event-Predictive Behavioral Primitives},
  author = {Gumbsch, Christian and Butz, Martin V. and Martius, Georg},
  journal = {IEEE Transactions on Cognitive and Developmental Systems},
  volume = {13},
  number = {2},
  pages = {298--311},
  month = jun,
  year = {2019},
  doi = {10.1109/TCDS.2019.2925890},
  url = {https://ieeexplore.ieee.org/document/8753716},
  month_numeric = {6}
}