Carnegie Mellon University
Predicting Object Dynamics in Scenes

David Fouhey and Charles Zitnick
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), March, 2014.

  • Adobe portable document format (pdf) (5MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Given a static scene, a human can trivially enumerate the myriad of things that can happen next and characterize the relative likelihood of each. In the process, we make use of enormous amounts of commonsense knowledge about how the world works. In this paper, we investigate learning this commonsense knowledge from data. To overcome a lack of densely annotated spatiotemporal data, we learn from sequences of abstract images gathered using crowdsourcing. The abstract scenes provide both object location and attribute information. We demonstrate qualitatively and quantitatively that our models produce plausible scene predictions on both the abstract images, as well as natural images taken from the Internet.


Text Reference
David Fouhey and Charles Zitnick, "Predicting Object Dynamics in Scenes," IEEE Conference on Computer Vision and Pattern Recognition (CVPR), March, 2014.

BibTeX Reference
   author = "David Fouhey and Charles Zitnick",
   title = "Predicting Object Dynamics in Scenes",
   booktitle = "IEEE Conference on Computer Vision and Pattern Recognition (CVPR)",
   month = "March",
   year = "2014",