Graphics enhanced version of this site

Breaking Out of the Black Box: A New Approach to Robot Perception
M.C. Martin
doctoral dissertation, Robotics Institute, Carnegie Mellon University, January, 1998.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Adobe portable document format (pdf) [518 KB]
Compressed postscript (ps.gz) [2195 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Surprisingly, the state of the art in avoiding obstacles using only vision--not sonar or laser rangefinders--is roughly half an hour between collisions (at 30 cm/s, in an office environment). After review ing the design and failure modes of several current systems, I compare psychology's understanding of perception to current computer/robot perception. There are fundamental differences--which lead to fundamental limitations with current computer perception.

The key difference is that robot software is built out of "black boxes", which have very restricted interactions with each other. In contrast, the human perceptual system is much more integrated. The claim is that a robot that performs any significant task, and does it as well as a person, can not be created out of "black boxes." In fact, it would probably be too interconnected to be designed by hand--instead, tools will be needed to create such designs.

To illustrate this idea, I propose to create a visual obstacle avoidence system on the Uranus mobile robot. The system uses a number of visual depth cues at each pixel, as well as depth cues from neighbouring pixels and previous depth estimates. Genetic Programming is used to combine these into a new depth estimate. The system learns by predicting both sonar readings and the next image. The design of the system is described, and design decisions are rationalized.

Associated lab/group: Mobile Robot Lab
Associated project: Uranus

M.C. Martin, Breaking Out of the Black Box: A New Approach to Robot Perception, doctoral dissertation, Robotics Institute, Carnegie Mellon University, January, 1998.

@phdthesis{Martin_1998_3062,
   author = "Martin C. Martin",
   title = "Breaking Out of the Black Box: A New Approach to Robot Perception",
   school = "Robotics Institute, Carnegie Mellon University",
   month = "January",
   year = "1998",
   address = "Pittsburgh, PA"
}