Carnegie Mellon University
A Physical Approach to Color Image Understanding

G. Klinker, Steven Shafer, and Takeo Kanade
International Journal of Computer Vision, Vol. 4, No. 1, pp. 7-38, January, 1991.

  • Adobe portable document format (pdf) (2MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

In this paper, we present an approach to color image understanding that can be used to segment and analyze surfaces with color variations due to highlights and shading. The work is based on a theory-the Dichromatic Reflection Model-which describes the color of the reflected light as a mixture of light from surface reflection (highlights) and body reflection (object color). In the past, we have shown how the dichromatic theory can be used to separate a color image into two intrinsic reflection images: an image of just the highlights, and the original image with the highlights removed. At that time, the algorithm could only be applied to hand-segmented images. This paper shows how the same reflection model can be used to include color image segmentation into the image analysis. The result is a color image understanding system, capable of generating physical descriptions of the reflection processes occurring in the scene. Such descriptions include the intrinsic reflection images, an image segmentation, and symbolic information about the object and highlight colors. This line of research can lead to physics-based image understanding methods that are both more reliable and more useful than traditional methods.

Associated Center(s) / Consortia: Vision and Autonomous Systems Center

Text Reference
G. Klinker, Steven Shafer, and Takeo Kanade, "A Physical Approach to Color Image Understanding," International Journal of Computer Vision, Vol. 4, No. 1, pp. 7-38, January, 1991.

BibTeX Reference
   author = "G. Klinker and Steven Shafer and Takeo Kanade",
   title = "A Physical Approach to Color Image Understanding",
   journal = "International Journal of Computer Vision",
   pages = "7-38",
   month = "January",
   year = "1991",
   volume = "4",
   number = "1",