The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

We consider the problem of semi-supervised bootstrap learning for scene categorization (e.g classifying images into categories such as coast and desert). Existing semi-supervised approaches are typically unreliable and face semantic drift because the learning task is under-constrained. This is primarily because they ignore the strong interactions that often exist between scene categories, such as the common attributes shared across categories, as well as the attributes which make one scene different from another. The goal of this paper is to exploit these relationships and constrain the semi-supervised learning problem. For example, the knowledge of an image instance being an auditorium can improve labelling of amphitheaters by enforcing constraints that an amphitheater image should have more circular structures than an auditorium image. We propose constraints based on mutual exclusion, binary attributes and comparative attributes and show that they help us to constrain the learning problem and avoid semantic drift. We demonstrate the effectiveness of our approach through extensive experiments including results on a very large dataset of one million images.

Keywords

SSL, attributes, relative attributes, comparative attributes, semi-supervised learning, bootstrapping, constrained bootstrapping, constrained semi-supervised learning, image classification, scene categorization

Notes

Text Reference

Abhinav Shrivastava, Saurabh Singh, and Abhinav Gupta, "Constrained Semi-Supervised Learning Using Attributes and Comparative Attributes," European Conference on Computer Vision (ECCV), October, 2012, pp. 369-383.

BibTeX Reference

@inproceedings{Shrivastava_2012_7328,
   author = "Abhinav Shrivastava and Saurabh Singh and Abhinav Gupta",
   title = "Constrained Semi-Supervised Learning Using Attributes and Comparative Attributes",
   booktitle = "European Conference on Computer Vision (ECCV)",
   pages = "369-383",
   publisher = "Springer Berlin / Heidelberg",
   month = "October",
   year = "2012",
   volume = "7574",
}

The Robotics Institute

Menu