Synthesis of a High Resolution 3D-Stereoscopic Image from a High Resolution Monoscopic Image and a Low Resolution Depth Map

Shin Hwan Kim, Mel Siegel, and J-Y Son
Proceedings of the 1998 SPIE/IS&T Conference, January, 1998, pp. 76 - 86.


Download
  • Adobe portable document format (pdf) (704KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
We describe a new low-level scheme to achieve high definition 3D-stereoscopy within the bandwidth of the monoscopic HDTV infrastructure. Our method uses a studio quality monoscopic high resolution color camera to generate a transmitted "main stream" view, and a flanking 3D-stereoscopic pair of low cost, low resolution monochrome camera "outriggers" to generate a depth map of the scene. The depth map is deeply compressed and transmitted as a low bandwidth "auxiliary stream". The two streams are recombined at the receiver to generate a 3D-stereoscopic pair of high resolution color views from the perspectives of the original outriggers. Alternatively, views from two arbitrary perspectives between (and, to a limited extent, beyond) the low resolution monoscopic camera positions can be synthesized to accommodate individual viewer preferences. We describe our algorithms, and the design and outcome of initial experiments. The experiments begin with three NTSC color images, degrade the outer pair to low resolution monochrome, and compare the results of coding and reconstruction to the originals.

Keywords
stereoscopy, stereo cameras, 3D-TV, disparity, occlusion, view interpolation

Notes
Associated Center(s) / Consortia: Center for Integrated Manfacturing Decision Systems
Associated Lab(s) / Group(s): Intelligent Sensor, Measurement, and Control Lab
Associated Project(s): Three Camera Video & Synthesis

Text Reference
Shin Hwan Kim, Mel Siegel, and J-Y Son, "Synthesis of a High Resolution 3D-Stereoscopic Image from a High Resolution Monoscopic Image and a Low Resolution Depth Map," Proceedings of the 1998 SPIE/IS&T Conference, January, 1998, pp. 76 - 86.

BibTeX Reference
@inproceedings{Kim_1998_824,
   author = "Shin Hwan Kim and Mel Siegel and J-Y Son",
   title = "Synthesis of a High Resolution 3D-Stereoscopic Image from a High Resolution Monoscopic Image and a Low Resolution Depth Map",
   booktitle = "Proceedings of the 1998 SPIE/IS&T Conference",
   pages = "76 - 86",
   month = "January",
   year = "1998",
   volume = "3295A",
}