Nearest Neighbor Classifier Generalization through Spatially Constrained Filters - Robotics Institute Carnegie Mellon University

Nearest Neighbor Classifier Generalization through Spatially Constrained Filters

Simon Lucey and Ahmed Bilal Ashraf
Journal Article, Pattern Recognition, Vol. 46, No. 1, pp. 325 - 331, 2013

Abstract

It is widely understood that the performance of the nearest neighbor (NN) rule is dependent on: (i) the way distances are computed between different examples, and (ii) the type of feature representation used. Linear filters are often used in computer vision as a pre-processing step, to extract useful feature representations. In this paper we demonstrate an equivalence between (i) and (ii) for NN tasks involving weighted Euclidean distances. Specifically, we demonstrate how the application of a bank of linear filters can be re-interpreted, in the form of a symmetric weighting matrix, as a manipulation of how distances are computed between di↵erent examples for NN classification. Further, we argue that filters fulfill the role of encoding local spatial constraints into this weighting matrix. We then demonstrate how these constraints can dramatically increase the generalization capability of canonical distance metric learning techniques in the presence of unseen illumination and viewpoint change.

BibTeX

@article{Lucey-2013-17106,
author = {Simon Lucey and Ahmed Bilal Ashraf},
title = {Nearest Neighbor Classifier Generalization through Spatially Constrained Filters},
journal = {Pattern Recognition},
year = {2013},
month = {January},
volume = {46},
number = {1},
pages = {325 - 331},
keywords = {nearest neighbor classification, distance metric learning, filter learning},
}