The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

In this paper, we present an approach to color image understanding that accounts for color variations due to highlights and shading. We demonstrate that the reflected light from every point on a dielectric object. such as plastic, can be described as a linear combination of the object color and the highlight color. The colors of all light rays reflected from one object then form a planar cluster in the color space. The shape of this cluster is determined by the object and highlight colors and by the object shape and illumination geometry. We present a method that exploits the difference between object color and highlight color to separate the color of every pixel into a matte component and a highlight component. This generates two intrinsic images, one showing the scene without highlights, and the other one showing only the highlights. The intrinsic images may be a useful tool for a variety of algorithms in computer vision. such as stereo vision, motion analysis, shape from shading, and shape from highlights. Our method combines the analysis of matte and highlight reflection with a sensor model that accounts for camera limitations. This enables us to successfully run our algorithm on real images taken in a laboratory setting. We show and discuss the results.

Notes

Associated Center(s) / Consortia: Vision and Autonomous Systems Center

Text Reference

G. Klinker, Steven Shafer, and Takeo Kanade, "The Measurement of Highlights in Color Images," International Journal of Computer Vision, Vol. 2, No. 1, June, 1988, pp. 7-32.

BibTeX Reference

@article{Shafer_1988_2504,
   author = "G. Klinker and Steven Shafer and Takeo Kanade",
   title = "The Measurement of Highlights in Color Images",
   journal = "International Journal of Computer Vision",
   pages = "7-32",
   month = "June",
   year = "1988",
   volume = "2",
   number = "1",
}

The Robotics Institute

Menu