A High-Performance Stereo Vision System for Obstacle Detection

Todd Williamson
doctoral dissertation, tech. report CMU-RI-TR-98-24, Robotics Institute, Carnegie Mellon University, September, 1998


Download
  • Adobe portable document format (pdf) (6MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Intelligent vehicle research to date has made great progress toward true autonomy. Integrated systems for on-road vehicles, which include road following, headway maintenance, tactical-level planning, avoidance of large obstacles, and inter-vehicle coordi-nation have been demonstrated. One of the weakest points of current automated cars, however, is the lack of a reliable system to detect small obstacles on the road surface. In order to be useful at highway speeds, such a system must be able to detect small (~15cm) obstacles at long ranges (~100m), with a cycle rate of at least 2 Hz.

This dissertation presents an obstacle detection system that uses trinocular stereo to detect very small obstacles at long range on highways. The system makes use of the apparent orientation of surfaces in the image in order to determine whether pixels belong to vertical or horizontal surfaces. A simple confidence measure is applied to reject false positives introduced by image noise. The system is capable of detecting objects as small as 14cm high at ranges well in excess of 100m.

The obstacle detection system described here relies on several factors. First, the camera system is configured in such a way that even small obstacles generate detect-able range measurements. This is done by using a very long baseline, telephoto lenses, and rigid camera mounts. Second, extremely accurate calibration procedures allow accurate determination of these range differences. Multibaseline stereo is used to reduce the number of false matches and to improve range accuracy. Special image filtering techniques are used to enhance the very weak image textures present on the road surface, reducing the number of false range measurements. Finally, a technique for determining the surface orientation directly from stereo data is used to detect the presence of obstacles.

A system to detect obstacles is not useful if it does not run in near real-time. In order to improve performance, this dissertation includes a detailed analysis of each stage of the stereo algorithm. An efficient method for rectifying images for trinocular stereo is presented. An analysis of memory usage and cache performance of the stereo matching loop has been performed to allow efficient implementation on systems using general-purpose CPUs. Finally, a method for efficiently determining surface orientation directly from stereo data is described.


Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center

Text Reference
Todd Williamson, "A High-Performance Stereo Vision System for Obstacle Detection," doctoral dissertation, tech. report CMU-RI-TR-98-24, Robotics Institute, Carnegie Mellon University, September, 1998

BibTeX Reference
@phdthesis{Williamson_1998_566,
   author = "Todd Williamson",
   title = "A High-Performance Stereo Vision System for Obstacle Detection",
   booktitle = "",
   school = "Robotics Institute, Carnegie Mellon University",
   month = "September",
   year = "1998",
   number= "CMU-RI-TR-98-24",
   address= "Pittsburgh, PA",
}