SVM Decision Boundary Based Discriminative Subspace Induction

Jiayong Zhang and Yanxi Liu
Pattern Recognition, Vol. 38, No. 10, October, 2005, pp. 1746 - 1758.

  • Adobe portable document format (pdf) (646KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

We study the problem of linear dimension reduction for classification, with a focus on sufficient dimension reduction, i.e., finding subspaces without loss of discrimination power. First, we formulate the concept of sufficient subspace for classification in parallel terms as for regression. Then we present a new method to estimate the smallest sufficient subspace based on an improvement of Decision Boundary Analysis (DBA). The main idea is to combine DBA with Support Vector Machines (SVM) to overcome the inherent difficulty of DBA in small sample size situations while keeping DBA's estimation simplicity. The compact representation of SVM boundary results in a significant gain in both speed and accuracy over previous DBA implementations. Alternatively, this technique can be viewed as a way to reduce the run-time complexity of SVM itself. Comparative experiments on one simulated and four real-world benchmark datasets highlight the superior performance of the proposed approach.

Associated Center(s) / Consortia: Vision and Autonomous Systems Center and Medical Robotics Technology Center
Associated Lab(s) / Group(s): Medical Robotics and Computer Assisted Surgery and Biomedical Image Analysis
Associated Project(s): Non-Invasive Optical Imaging in vivo for Early Detection and Advanced Diagnosis of Cancer
Number of pages: 13

Text Reference
Jiayong Zhang and Yanxi Liu, "SVM Decision Boundary Based Discriminative Subspace Induction," Pattern Recognition, Vol. 38, No. 10, October, 2005, pp. 1746 - 1758.

BibTeX Reference
   author = "Jiayong Zhang and Yanxi Liu",
   title = "SVM Decision Boundary Based Discriminative Subspace Induction",
   journal = "Pattern Recognition",
   pages = "1746 - 1758",
   publisher = "Elsevier",
   month = "October",
   year = "2005",
   volume = "38",
   number = "10",