The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Linear discriminant analysis (LDA) has been an active topic of research during the last century. However, the existing algorithms have several limitations when applied to visual data. LDA is only optimal for gaussian distributed classes with equal covariance matrices and just classes-1 features can be extracted. On the other hand, LDA does not scale well to high dimensional data (over-fitting) and it does not necessarily minimize the classification error. In this paper, we introduce Oriented Discriminant Analysis (ODA), a LDA extension which can overcome these drawbacks. Three main novelties are proposed:

An optimal dimensionality reduction which maximizes the Kullback-Liebler divergence between classes is proposed. This allows us to model class covariances and to extract more than classes-1 features.
Several covariance approximations are introduced to improve classification in the small sample case.
A linear time iterative majorization method is introduced in order to find a local optimal solution.

Several synthetic and real experiments on face recognition are reported.

Notes

Associated Center(s) / Consortia: Vision and Autonomous Systems Center

Number of pages: 10

Text Reference

Fernando De la Torre Frade and Takeo Kanade, "Oriented Discriminant Analysis (ODA)," Proceedings of the British Machine Vision Conference 2004, 2004, pp. 132 - 141.

BibTeX Reference

@inproceedings{De_la_Torre_Frade_2004_4806,
   author = "Fernando {De la Torre Frade} and Takeo Kanade",
   title = "Oriented Discriminant Analysis (ODA)",
   booktitle = "Proceedings of the British Machine Vision Conference 2004",
   pages = "132 - 141",
   year = "2004",
}

The Robotics Institute

Menu