Carnegie Mellon University
Finding (Un)Usual Events in Video

Hua Zhong and Jianbo Shi
tech. report CMU-RI-TR-03-05, Robotics Institute, Carnegie Mellon University, May, 2003

  • Adobe portable document format (pdf) (4MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

We propose an algorithm for detecting and categorizing (un)usual human activity in a video which might be a few days long. The proposed approach is unsupervised, and uses the co-occurrence among large number of simple visual image features to define the activity categories, and to identify what are unusual events automatically. A video is divided into short segments(clips), and motion/color histogram is extract for the foreground object for each image frame. The image features are Vector Quantized into a smaller set of prototype features. A weighted graph is constructed by taking clips and prototype features as nodes, and the co-occurrence relationship between them as the graph edges. We compute an optimal graph embedding that maps the clips and prototype features in a common low dimensional space. This unified embedding ensures that all pair of co-occurring clip and feature are as close as possible. We define event categories by identify cluster of clips in this embedding space, and those isolated clusters are detected as unusual events. We can also classify a new video clips based on the embedding of its co-ocurring features. We demonstrated this algorithm on several long surveillance video recorded at a nursing home.


Text Reference
Hua Zhong and Jianbo Shi, "Finding (Un)Usual Events in Video," tech. report CMU-RI-TR-03-05, Robotics Institute, Carnegie Mellon University, May, 2003

BibTeX Reference
   author = "Hua Zhong and Jianbo Shi",
   title = "Finding (Un)Usual Events in Video",
   booktitle = "",
   institution = "Robotics Institute",
   month = "May",
   year = "2003",
   number= "CMU-RI-TR-03-05",
   address= "Pittsburgh, PA",