Graphics enhanced version of this site

Gesture-Based Programming, Part 2: Primordial Learning
R. Voyles, J. Morrow, and P. Khosla
Intelligent Engineering through Artificial Neural Networks-Volume 6: Fuzzy Logic and Evolutionary Programming, Proceedings of ANNIE '96: Conference on Artificial Neural Networks in Engineering, November, 1996.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Adobe portable document format (pdf) [36 KB]
Compressed postscript (ps.gz) [31 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

In part one of this two-part series, we described our Gesture-Based Programming paradigm for programming by human demonstration. This paradigm depends on a pre-existing knowledge base of capabilities, collectively called "encapsulated expertise," that comprise the real-time sensorimotor primitives from which the run-time executable is constructed as well as providing the basis for interpreting the teacher's actions during programming. In this paper we present a technique based on principal components analysis, augmentable with model-based information, for learning and recognizing sensorimotor primitives. We describes simple applications of the technique to a mobile robot and a PUMA manipulator. The mobile robot learned to escape from jams while the manipulator learned guarded moves and accommodations that are composable to allow flat plate mating operations. While these initial applications are simple, they demonstrate the ability to extract primitives from demonstration, recognize the learned primitives in subsequent demonstrations, and combine and transform primitives to create different capabilities.

Associated center: VASC

R. Voyles, J. Morrow, and P. Khosla, "Gesture-Based Programming, Part 2: Primordial Learning," Intelligent Engineering through Artificial Neural Networks-Volume 6: Fuzzy Logic and Evolutionary Programming, Proceedings of ANNIE '96: Conference on Artificial Neural Networks in Engineering, November, 1996.

@inproceedings{Voyles_1996_1712,
   author = "Richard Voyles and James Morrow and Pradeep Khosla",
   title = "Gesture-Based Programming, Part 2: Primordial Learning",
   booktitle = "Intelligent Engineering through Artificial Neural Networks-Volume 6: Fuzzy Logic and Evolutionary Programming, Proceedings of ANNIE '96: Conference on Artificial Neural Networks in Engineering",
   month = "November",
   year = "1996"
}