The Robotics Institute
Search the site
RI | Publications | Photo Clip Art

Text only version of this site

Photo Clip Art
J. Lalonde, D. Hoiem, A.A. Efros, C. Rother, J. Winn, and A. Criminisi
ACM Transactions on Graphics (SIGGRAPH 2007), Vol. 26, No. 3, August, 2007.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Download [Help]

Adobe portable document format (pdf) [15963 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

We present a system for inserting new objects into existing photographs by querying a vast image-based object library, precomputed using a publicly available Internet object database. The central goal is to shield the user from all of the arduous tasks typically involved in image compositing. The user is only asked to do two simple things: 1) pick a 3D location in the scene to place a new object; 2) select an object to insert using a hierarchical menu. We pose the problem of object insertion as a data-driven, 3D-based, context-sensitive object retrieval task. Instead of trying to manipulate the object to change its orientation, color distribution, etc. to fit the new image, we simply retrieve an object of a specified class that has all the required properties (camera pose, lighting, resolution, etc) from our large object library. We present new automatic algorithms for improving object segmentation and blending, estimating true 3D object size and orientation, and estimating scene lighting conditions. We also present an intuitive user interface that makes object insertion fast and simple even for the artistically challenged.

Notes

Sponsor: NSF
Grant ID: CCF-0541230, CAREER IIS-0546547

Number of pages: 10

Note: See the project webpage at http://graphics.cs.cmu.edu/projects/photoclipart

Text Reference

J. Lalonde, D. Hoiem, A.A. Efros, C. Rother, J. Winn, and A. Criminisi, "Photo Clip Art," ACM Transactions on Graphics (SIGGRAPH 2007), Vol. 26, No. 3, August, 2007.

BibTeX Reference

@article{Lalonde_2007_5761,
   author = "Jean-Francois Lalonde and Derek Hoiem and Alexei A. Efros and Carsten Rother and John Winn and Antonio Criminisi",
   title = "Photo Clip Art",
   journal = "ACM Transactions on Graphics (SIGGRAPH 2007)",
   month = "August",
   year = "2007",
   volume = "26",
   number = "3",
   note = "See the project webpage at http://graphics.cs.cmu.edu/projects/photoclipart"
}


The Robotics Institute is part of the School of Computer Science, Carnegie Mellon University.
For updates and comments, please see these instructions.
This page maintained by robotwebmaster@ri.cmu.edu