Image Segmentation and Reflection Analysis Through Color

Gudrun J. Klinker, Steven Shafer, and Takeo Kanade
SPlE Vol. 937 Applications of Artificial Intelligence VI, 1988.


Download
  • Adobe portable document format (pdf) (1MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
In this paper, we present an approach to color image understanding that can be used to segment and analyze surfaces with color variations due to highlights and shading. We begin with a theory that relates the reflected light from dielectric materials, such as plastic, to fundamental physical reflection processes, and describes the color of the reflected light as a linear Combination of the color of the light due to surface reflection (highlights) and body reflection (object color). This theory is used in an algorithm that separates a color image into two parts: an image of just the highlights, and the original image with the highlights removed. In the past, we have applied this method to hand-segmented images. The current paper shows how to perform automatic segmentation method by applying this theory in stages to identify the object and highlight colors. The result is a combination of segmentation and reflection analysis that is better than traditional heuristic segmentation methods (such as histogram thresholding), and provides important physical information about the surface geometry and material properties at the same time. We also show the importance of modeling the camera properties for this kind of quantitative analysis of color. This line of research can lead to physics-based image segmentation methods that are both more reliable and more useful than traditional segmentation methods.

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center

Text Reference
Gudrun J. Klinker, Steven Shafer, and Takeo Kanade, "Image Segmentation and Reflection Analysis Through Color," SPlE Vol. 937 Applications of Artificial Intelligence VI, 1988.

BibTeX Reference
@inproceedings{Shafer_1988_4237,
   author = "Gudrun J. Klinker and Steven Shafer and Takeo Kanade",
   title = "Image Segmentation and Reflection Analysis Through Color",
   booktitle = "SPlE Vol. 937 Applications of Artificial Intelligence VI",
   year = "1988",
}