Shape from Periodic Texture Using the Spectrogram

John Krumm and Steven Shafer
tech. report CMU-RI-TR-91-29, Robotics Institute, Carnegie Mellon University, December, 1991


Download
  • Adobe portable document format (pdf) (1MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Texture has long been recognized in computer vision as an important monocular shape cue, with texture gradients yielding information on surface orientation. AS more recent trend is the analysis of images in terms of local spatial frequencies, where each pixel has associated with it its own spatial frequency distribution. This has proven to be a successful method of reasoning about and exploiting many imaging phenomena. Thinking about both shape-from-texture and local spatial frequency, it seems that texture gradients would cause systematic changes i local frequency, and that these changes could be analyzed to extract shape information. However, there does not yet exist a theory that connects texture, shape, and the detailed behavior of local spatial frequency. We show in this paper how local spatial frequency is related to the surface normal of a textured surface. We find that the Fourier power spectra of any two similarly textured patches on a plane are approximately related to each other by an affine transformation. The transformation parameters are a function of the plane's surface normal. We use this relationship as the basis of a new algorithm for finding surface normals of textured shapes using the spectrogram, which is one type of local spatial frequency representation. We validate the relationship by testing the algorithm on real textures. By analyzing shape and texture in terms of the local spatial frequency representation, we can exploit the advantages of the representation for the shape-from-texture problem. Specifically, our algorithm requires no feature detection and can give correct results even when the texture is aliased.

Notes
Sponsor: Wright R & D (AFSC), US Air Force, NASA
Grant ID: F33615-90-C-1465, NGT-50423
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Calibrated Imaging Lab
Associated Project(s): Spatial Frequency
Number of pages: 22
Note: We do not have a hard copy of this document - please see the CVPR '92 paper with the same title

Text Reference
John Krumm and Steven Shafer, "Shape from Periodic Texture Using the Spectrogram," tech. report CMU-RI-TR-91-29, Robotics Institute, Carnegie Mellon University, December, 1991

BibTeX Reference
@techreport{Krumm_1991_273,
   author = "John Krumm and Steven Shafer",
   title = "Shape from Periodic Texture Using the Spectrogram",
   booktitle = "",
   institution = "Robotics Institute",
   month = "December",
   year = "1991",
   number= "CMU-RI-TR-91-29",
   address= "Pittsburgh, PA",
   Notes = "We do not have a hard copy of this document - please see the CVPR '92 paper with the same title"
}