Appearance compression and synthesis based on 3D model for mixed reality

K. Nishino, Yoichi Sato, and Katsushi Ikeuchi
Proceedings of IEEE ICCV'99, September, 1999, pp. 38 - 45.


Download
  • Adobe portable document format (pdf) (256KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Rendering photorealistic virtual objects from their real images is one of the main research issues in mixed reality systems. We previously proposed the Eigen-Texture method (K. Nishino et al., 1999), a new rendering method for generating virtual images of objects from their real images to deal with the problems posed by past work in image based methods and model based methods. Eigen-Texture method samples appearances of a real object under various illumination and viewing conditions, and compresses them in the 2D coordinate system defined on the 3D model surface. However, we had a serious limitation in our system, due to the alignment problem of the 3D model and color images. We deal with this limitation by solving the alignment problem; we do this by using the method originally designed by P. Viola (1995). The paper describes the method and reports on how we implement it.

Notes

Text Reference
K. Nishino, Yoichi Sato, and Katsushi Ikeuchi, "Appearance compression and synthesis based on 3D model for mixed reality," Proceedings of IEEE ICCV'99, September, 1999, pp. 38 - 45.

BibTeX Reference
@inproceedings{Sato_1999_3144,
   author = "K. Nishino and Yoichi Sato and Katsushi Ikeuchi",
   title = "Appearance compression and synthesis based on 3D model for mixed reality",
   booktitle = "Proceedings of IEEE ICCV'99",
   pages = "38 - 45",
   month = "September",
   year = "1999",
   volume = "1",
}