Hallucinating Faces

Simon Baker and Takeo Kanade
tech. report CMU-RI-TR-99-32, Robotics Institute, Carnegie Mellon University, September, 1999

  • Adobe portable document format (pdf) (2MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

In most surveillance scenarios there is a large distance between the camera and the objects of interest in the scene. Surveillance cameras are also usually set up with wide fields of view in order to image as much of the scene as possible. The end result is that the objects in the scene normally appear very small in surveillance imagery. It is generally possible to detect and track the objects in the scene, however, for tasks such as automatic face recognition and license plate reading, resolution enhancement techniques are often needed.

Although numerous resolution enhancement algorithms have been proposed in the literature, most of them are limited by the fact that they make weak, if any, assumptions about the scene. We propose an algorithm that can be used to learn a prior on the spatial distribution of the image gradient for frontal images of faces. We proceed to show how such a prior can be incorporated into a super-resolution algorithm to yield 4-8 fold improvements in resolution (16-64 times as many pixels) using as few as 2-3 images. The additional pixels are, in effect, hallucinated. We also apply our algorithms to text data.

Resolution enhancement, interpolation, super-resolution, learning, faces, text

Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Face Group
Associated Project(s): Image Enhancement for Faces and Hallucinating Faces

Text Reference
Simon Baker and Takeo Kanade, "Hallucinating Faces," tech. report CMU-RI-TR-99-32, Robotics Institute, Carnegie Mellon University, September, 1999

BibTeX Reference
   author = "Simon Baker and Takeo Kanade",
   title = "Hallucinating Faces",
   booktitle = "",
   institution = "Robotics Institute",
   month = "September",
   year = "1999",
   number= "CMU-RI-TR-99-32",
   address= "Pittsburgh, PA",