The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Capturing good videos outdoors can be challenging due to harsh lighting, unpredictable scene changes, and most relevant to this work, dynamic weather. Particulate weather, such as rain and snow, creates complex flickering effects that are irritating to people and confusing to vision algorithms. Although each raindrop or snowflake only affects a small number of pixels, collections of them have predictable global spatio-temporal properties. In this paper, we formulate a model of these global dynamic weather frequencies. To begin, we derive a physical model of raindrops and snowflakes that is used to determine the general shape and brightness of a single streak. This streak model is combined with the statistical properties of rain and snow, to determine how they effect the spatio-temporal frequencies of an image sequence. Once detected, these frequencies can then be suppressed. At a small scale, many things appear the same as rain and snow, but by treating them as global phenomena, we achieve better performance an with just a local analysis. We show the effectiveness of removal on a variety of complex video sequences.

Notes

Associated Center(s) / Consortia: Vision and Autonomous Systems Center

Associated Lab(s) / Group(s): Illumination and Imaging Lab

Number of pages: 8

Text Reference

Peter Barnum, Takeo Kanade, and Srinivasa G. Narasimhan, "Spatio-Temporal Frequency Analysis for Removing Rain and Snow from Videos," Workshop on Photometric Analysis For Computer Vision (PACV), in conjunction with ICCV, October, 2007.

BibTeX Reference

@inproceedings{Barnum_2007_6242,
   author = "Peter Barnum and Takeo Kanade and Srinivasa G Narasimhan",
   title = "Spatio-Temporal Frequency Analysis for Removing Rain and Snow from Videos",
   booktitle = "Workshop on Photometric Analysis For Computer Vision (PACV), in conjunction with ICCV",
   month = "October",
   year = "2007",
}

The Robotics Institute

Menu