Segmenting Textured 3D Surfaces Using the Space/Frequency Representation

John Krumm and Steven Shafer
tech. report CMU-RI-TR-93-14, Robotics Institute, Carnegie Mellon University, May, 1993


Download
  • Adobe portable document format (pdf) (1MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Segmenting 3D textured surfaces is critical for general image understanding. Unfortunately, current efforts at automatically understanding image texture are based on assumptions that make this goal impossible. Texture segmentation research assumes that the textures are flat and viewed from the front, while shape-from-texture work assumes that the textures have already been segmented. This deadlock means that none of these algorithms can be successfully applied to images of 3D textured surfaces.

We have developed an algorithm that can segment an image containing nonfrontally viewed, planar, periodic textures. We use the spectrogram to compute local surface normals from many different regions of the image. This algorithm does not require unreliable image feature detection. Based on these surface normals, we compute a "frontalized" version of the local power spectrum which shows what the region's power spectrum would look like if viewed from the front. If neighboring regions have similar frontalized power spectra, they are merged. To our knowledge, this is the first program that can segment 3D textured surfaces by explicitly accounting for shape effects.


Notes
Sponsor: USAF
Grant ID: F33615-90-C-1465
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Calibrated Imaging Lab
Number of pages: 28

Text Reference
John Krumm and Steven Shafer, "Segmenting Textured 3D Surfaces Using the Space/Frequency Representation," tech. report CMU-RI-TR-93-14, Robotics Institute, Carnegie Mellon University, May, 1993

BibTeX Reference
@techreport{Krumm_1993_305,
   author = "John Krumm and Steven Shafer",
   title = "Segmenting Textured 3D Surfaces Using the Space/Frequency Representation",
   booktitle = "",
   institution = "Robotics Institute",
   month = "May",
   year = "1993",
   number= "CMU-RI-TR-93-14",
   address= "Pittsburgh, PA",
}