|
|
|
|
RI | Publications | Learning and Shaping in Emergent Hierarchical Control Systems
|
|
Text only version of this site
Learning and Shaping in Emergent Hierarchical Control Systems
B. Digney
Space '96 and Robots for Challenging Environments II, June, 1996.
Jump to: Download | Abstract | Text Reference | BibTeX Reference
| Download [Help] |
Adobe portable document format (pdf) [222 KB] Compressed postscript (ps.gz) [92 KB]
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.
| Abstract |
The use of externally imposed hierarchical structures to reduce the complexity of learning control is common. However it is clear that the learning of the hierarchical structure by the machine itself is an important step towards more general and less bounded learning. Presented in this paper is a nested Q-learning technique that generates a hierarchical control structure as the robot interacts with its world. Furthermore, given the frailties of real machines and the long learning times required, it is becoming clear that fully unassisted learning for robots is unrealistic and when one considers the tremendous amount of information that novice humans/animals receive it is also unreasonable. Also, presented in this paper are methods for pre-training and supplying initial guidance to prepare robots for future situations.
| Text Reference |
B. Digney, "Learning and Shaping in Emergent Hierarchical Control Systems," Space '96 and Robots for Challenging Environments II, June, 1996.
| BibTeX Reference |
@inproceedings{Digney_1996_3152,
author = "Bruce Digney",
title = "Learning and Shaping in Emergent Hierarchical Control Systems",
booktitle = "Space '96 and Robots for Challenging Environments II",
month = "June",
year = "1996"
}