A Fast Hierarchical Learning Approach for Autonomous Robots

A. Jungmann, B. Kleinjohann, W. Richert, in: Organic Computing — A Paradigm Shift for Complex Systems, Autonomic Systems, Springer Basel, 2011, pp. 545–558.

Download
No fulltext has been uploaded.
Book Chapter | English
Author
; ;
Abstract
In this article we present an approach that enables robots to learn how to act and react robustly in continuous and noisy environments while not loosing track of the overall feasibility, i.e. minimising the execution time in order to keep up continuous learning. We do so by combining reinforcement learning mechanisms with techniques belonging to the field of multivariate statistics on three different levels of abstraction: the motivation layer and the two simultaneously learning strategy and skill layers. The motivation layer allows for modelling occasionally contradicting goals in terms of drives in a very intuitive fashion. A drive represents one single goal, that a robot wants to be satisfied, like charging its battery, when it is nearly exhausted, or transporting an object to a target position. The strategy layer encapsulates the main reinforcement learning algorithm based on an abstracted and dynamically adjusted Markovian state space. By means of state abstraction, we minimise the overall state space size in order to ensure feasibility of the learning process in a dynamically changing environment. The skill layer finally realises a generalised learning method for learning reactive low-level behaviours, that enable a robot to interact with the environment.
Publishing Year
Book Title
Organic Computing — A Paradigm Shift for Complex Systems, Autonomic Systems
Page
545-558
LibreCat-ID

Cite this

Jungmann A, Kleinjohann B, Richert W. A Fast Hierarchical Learning Approach for Autonomous Robots. In: Organic Computing — A Paradigm Shift for Complex Systems, Autonomic Systems. Springer Basel; 2011:545-558. doi:10.1007/978-3-0348-0130-0_36
Jungmann, A., Kleinjohann, B., & Richert, W. (2011). A Fast Hierarchical Learning Approach for Autonomous Robots. In Organic Computing — A Paradigm Shift for Complex Systems, Autonomic Systems (pp. 545–558). Springer Basel. https://doi.org/10.1007/978-3-0348-0130-0_36
@inbook{Jungmann_Kleinjohann_Richert_2011, title={A Fast Hierarchical Learning Approach for Autonomous Robots}, DOI={10.1007/978-3-0348-0130-0_36}, booktitle={Organic Computing — A Paradigm Shift for Complex Systems, Autonomic Systems}, publisher={Springer Basel}, author={Jungmann, Alexander and Kleinjohann, Bernd and Richert, Willi}, year={2011}, pages={545–558} }
Jungmann, Alexander, Bernd Kleinjohann, and Willi Richert. “A Fast Hierarchical Learning Approach for Autonomous Robots.” In Organic Computing — A Paradigm Shift for Complex Systems, Autonomic Systems, 545–58. Springer Basel, 2011. https://doi.org/10.1007/978-3-0348-0130-0_36.
A. Jungmann, B. Kleinjohann, and W. Richert, “A Fast Hierarchical Learning Approach for Autonomous Robots,” in Organic Computing — A Paradigm Shift for Complex Systems, Autonomic Systems, Springer Basel, 2011, pp. 545–558.
Jungmann, Alexander, et al. “A Fast Hierarchical Learning Approach for Autonomous Robots.” Organic Computing — A Paradigm Shift for Complex Systems, Autonomic Systems, Springer Basel, 2011, pp. 545–58, doi:10.1007/978-3-0348-0130-0_36.

Export

Marked Publications

Open Data LibreCat

Search this title in

Google Scholar