User-Powered "Content-Free" Approach to Image Retrieval

Takeo Kanade and Shingo Uchihashi
Proceedings of International Symposium on Digital Libraries and Knowledge Communities in Networked Information Society 2004 (DLKC04), March, 2004, pp. 24 - 32.


Download
  • Adobe portable document format (pdf) (1MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Consider a stereotypical image-retrieval problem; a user submits a set of query images to a system and through repeated interactions during which the system presents its current choices and the user gives his/her preferences to them, the choices are narrowed to the image(s) that satisfies the user. The problem obviously must deal with image content, i.e., interpretation and preference. For this purpose, conventional so-called content- based image retrieval (CBIR) approach uses image-processing and computer-vision techniques, and tries to understand the image content. Such attempts have produced good but limited success, mainly because image interpretation is a highly complicated perceptive process.

We propose a new approach to this problem from a totally different angle. It attempts to exploit the human's perceptual capabilities and certain common, if not identical, tendencies that must exist among people's interpretation and preference of images. Instead of processing images, the system simply accumulates records of user feedback and recycles them in the form of collaborative filtering, just like a purchase recommendation system such as Amazo.com. To emphasize the point that it does not deal with image pixel information, we dub the approach by a term "content-free" image retrieval (CFIR).

We discuss various issues of image retrieval, argue for the idea of CFIR, and present results of preliminary experiment. The results indicate that the performance of CFIR improves with the number of accumulated feedbacks, outperforming a basic but typical conventional CBIR system.


Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Number of pages: 9

Text Reference
Takeo Kanade and Shingo Uchihashi, "User-Powered "Content-Free" Approach to Image Retrieval," Proceedings of International Symposium on Digital Libraries and Knowledge Communities in Networked Information Society 2004 (DLKC04), March, 2004, pp. 24 - 32.

BibTeX Reference
@inproceedings{Kanade_2004_5111,
   author = "Takeo Kanade and Shingo Uchihashi",
   title = "User-Powered "Content-Free" Approach to Image Retrieval",
   booktitle = "Proceedings of International Symposium on Digital Libraries and Knowledge Communities in Networked Information Society 2004 (DLKC04)",
   pages = "24 - 32",
   month = "March",
   year = "2004",
}