Enhancing Resolution Along Multiple Imaging Dimensions Using Assorted Pixels

Srinivasa G. Narasimhan and Shree K Nayar
IEEE PAMI, Vol. 27, No. 4, May, 2005, pp. 518 - 530.


Download
  • Adobe portable document format (pdf) (5MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Multisampled imaging is a general framework for using pixels on an image detector to simultaneously sample multiple dimensions of imaging (space, time, spectrum, brightness, polarization, etc.). The mosaic of red, green, and blue spectral filters found in most solid-state color cameras is one example of multisampled imaging. We briefly describe how multisampling can be used to explore other dimensions of imaging. Once such an image is captured, smooth reconstructions along the individual dimensions can be obtained using standard interpolation algorithms. Typically, this results in a substantial reduction of resolution (and, hence, image quality). One can extract significantly greater resolution in each dimension by noting that the light fields associated with real scenes have enormous redundancies within them, causing different dimensions to be highly correlated. Hence, multisampled images can be better interpolated using local structural models that are learned offline from a diverse set of training images. The specific type of structural models we use are based on polynomial functions of measured image intensities. They are very effective as well as computationally efficient. We demonstrate the benefits of structural interpolation using three specific applications. These are 1) traditional color imaging with a mosaic of color filters, 2) high dynamic range monochrome imaging using a mosaic of exposure filters, and 3) high dynamic range color imaging using a mosaic of overlapping color and exposure filters.

Keywords
Terms-Image formation, multisampling, dynamic range, color, resolution, interpolation, structural models, learning, Bayer pattern

Notes
Number of pages: 13

Text Reference
Srinivasa G. Narasimhan and Shree K Nayar, "Enhancing Resolution Along Multiple Imaging Dimensions Using Assorted Pixels," IEEE PAMI, Vol. 27, No. 4, May, 2005, pp. 518 - 530.

BibTeX Reference
@article{Narasimhan_2005_4976,
   author = "Srinivasa G Narasimhan and Shree K Nayar",
   title = "Enhancing Resolution Along Multiple Imaging Dimensions Using Assorted Pixels",
   journal = "IEEE PAMI",
   pages = "518 - 530",
   month = "May",
   year = "2005",
   volume = "27",
   number = "4",
}