What does the sky tell us about the camera?

Jean-Francois Lalonde, Srinivasa G. Narasimhan, and Alexei A. Efros
European Conference on Computer Vision, 2008.

  • Adobe portable document format (pdf) (3MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

As the main observed illuminant outdoors, the sky is a rich source of information about the scene. However, it is yet to be fully explored in computer vision because its appearance depends on the sun position, weather conditions, photometric and geometric parameters of the camera, and the location of capture. In this paper, we propose the use of a physically-based sky model to analyze the information available within the visible portion of the sky, observed over time. By fitting this model to an image sequence, we show how to extract camera parameters such as the focal length, and the zenith and azimuth angles. In short, the sky serves as a geometric calibration target. Once the camera parameters are recovered, we show how to use the same model in two applications: 1) segmentation of the sky and cloud layers, and 2) data-driven sky matching across different image sequences based on a novel similarity measure defined on sky parameters. This measure, combined with a rich appearance database, allows us to model a wide range of sky conditions.

Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Illumination and Imaging Lab
Note: See the project webpage at http://graphics.cs.cmu.edu/projects/sky

Text Reference
Jean-Francois Lalonde, Srinivasa G. Narasimhan, and Alexei A. Efros, "What does the sky tell us about the camera?," European Conference on Computer Vision, 2008.

BibTeX Reference
   author = "Jean-Francois Lalonde and Srinivasa G Narasimhan and Alexei A. Efros",
   title = "What does the sky tell us about the camera?",
   booktitle = "European Conference on Computer Vision",
   year = "2008",
   Notes = "See the project webpage at http://graphics.cs.cmu.edu/projects/sky"