Graphics enhanced version of this site

Putting Objects in Perspective
D. Hoiem, A.A. Efros, and M. Hebert
Proc. IEEE Computer Vision and Pattern Recognition (CVPR), Vol. 2, June, 2006, pp. 2137 - 2144.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Adobe portable document format (pdf) [4346 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Image understanding requires not only individually esti- mating elements of the visual world but also capturing the interplay among them. In this paper, we provide a frame- work for placing local object detection in the context of the overall 3D scene by modeling the interdependence of ob- jects, surface orientations, and camera viewpoint. Most object detection methods consider all scales and locations in the image as equally likely. We show that with probabilistic estimates of 3D geometry, both in terms of surfaces and world coordinates, we can put objects into perspective and model the scale and location variance in the image. Our approach reflects the cyclical nature of the problem by allowing probabilistic object hypotheses to re- fine geometry and vice-versa. Our framework allows pain- less substitution of almost any object detector and is easily extended to include other aspects of image understanding. Our results confirm the benefits of our integrated approach.

Associated center: VASC
Associated project: Geometrically Coherent Image Interpretation

Number of pages: 8

D. Hoiem, A.A. Efros, and M. Hebert, "Putting Objects in Perspective," Proc. IEEE Computer Vision and Pattern Recognition (CVPR), Vol. 2, June, 2006, pp. 2137 - 2144.

@inproceedings{Hoiem_2006_5467,
   author = "Derek Hoiem and Alexei A. Efros and Martial Hebert",
   title = "Putting Objects in Perspective",
   booktitle = "Proc. IEEE Computer Vision and Pattern Recognition (CVPR)",
   month = "June",
   year = "2006",
   volume = "2",
   pages = "2137 - 2144"
}