Carnegie Mellon University
Breaking Out of the Black Box: A New Approach to Robot Perception

Martin C. Martin
Mobile Robots XIII, November, 1998, pp. 126 - 137.

  • Adobe portable document format (pdf) (902KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

The state of the art in avoiding obstacles using only vision ?not sonar or laser rangefinders ?is roughly half an hour between collisions (at 30 cm/s, in an office environment). After reviewing the design and failure modes of several current systems, I compare psychology? understanding of perception to current computer/robot perception. There are fundamental differences ?which lead to fundamental limitations with current computer perception.

The key difference is that robot software is built out of ?lack boxes? which have very restricted interactions with each other. In contrast, the human perceptual system is much more integrated. The claim is that a robot that performs any significant task, and does it as well as a person, can not be created out of ?lack boxes.?In fact, it would probably be too interconnected to be designed by hand ?instead, tools will be needed to create such designs.

To illustrate this idea, I propose to create a visual obstacle avoidance system on the Uranus mobile robot. The system uses a number of visual depth cues at each pixel, as well as depth cues from neighbouring pixels and previous depth estimates. Genetic Programming is used to combine these into a new depth estimate. The system learns by predicting both sonar readings and the next image. The design of the system is described, and design decisions are rationalized.

Associated Lab(s) / Group(s): Mobile Robot Lab
Number of pages: 12

Text Reference
Martin C. Martin, "Breaking Out of the Black Box: A New Approach to Robot Perception," Mobile Robots XIII, November, 1998, pp. 126 - 137.

BibTeX Reference
   author = "Martin C. Martin",
   title = "Breaking Out of the Black Box: A New Approach to Robot Perception",
   booktitle = "Mobile Robots XIII",
   pages = "126 - 137",
   month = "November",
   year = "1998",