Scene Completion Using Millions of Photographs

James H. Hays and Alexei A. Efros
ACM Transactions on Graphics (SIGGRAPH 2007), Vol. 26, No. 3, August, 2007


Download
  • Adobe portable document format (pdf) (12MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
What can you do with a million images? In this paper we present a new image completion algorithm powered by a huge database of photographs gathered from the Web. The algorithm patches up holes in images by finding similar image regions in the database that are not only seamless but also semantically valid. Our chief insight is that while the space of images is effectively infinite, the space of semantically differentiable scenes is actually not that large. For many image completion tasks we are able to find similar scenes which contain image fragments that will convincingly complete the image. Our algorithm is entirely data-driven, requiring no annotations or labelling by the user. Unlike existing image completion methods, our algorithm can generate a diverse set of image completions and we allow users to select among them. We demonstrate the superiority of our algorithm over existing image completion approaches.

Notes
Sponsor: NSF
Number of pages: 7

Text Reference
James H. Hays and Alexei A. Efros, "Scene Completion Using Millions of Photographs," ACM Transactions on Graphics (SIGGRAPH 2007), Vol. 26, No. 3, August, 2007

BibTeX Reference
@article{Hays_2007_5817,
   author = "James H. Hays and Alexei A. Efros",
   title = "Scene Completion Using Millions of Photographs",
   journal = "ACM Transactions on Graphics (SIGGRAPH 2007)",
   month = "August",
   year = "2007",
   volume = "26",
   number = "3",
}