The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

We study the problem of linear dimension reduction for classification, with a focus on sufficient dimension reduction, i.e., finding subspaces without loss of discrimination power. First, we formulate the concept of sufficient subspace for classification in parallel terms as for regression. Then we present a new method to estimate the smallest sufficient subspace based on an improvement of Decision Boundary Analysis (DBA). The main idea is to combine DBA with Support Vector Machines (SVM) to overcome the inherent difficulty of DBA in small sample size situations while keeping DBA's estimation simplicity. The compact representation of SVM boundary results in a significant gain in both speed and accuracy over previous DBA implementations. Alternatively, this technique can be viewed as a way to reduce the run-time complexity of SVM itself. Comparative experiments on one simulated and four real-world benchmark datasets highlight the superior performance of the proposed approach.

Notes

Associated Center(s) / Consortia: Vision and Autonomous Systems Center and Medical Robotics Technology Center

Associated Lab(s) / Group(s): Medical Robotics and Computer Assisted Surgery and Biomedical Image Analysis

Associated Project(s): Non-Invasive Optical Imaging in vivo for Early Detection and Advanced Diagnosis of Cancer

Number of pages: 13

Text Reference

Jiayong Zhang and Yanxi Liu, "SVM Decision Boundary Based Discriminative Subspace Induction," Pattern Recognition, Vol. 38, No. 10, October, 2005, pp. 1746 - 1758.

BibTeX Reference

@article{Zhang_2005_4928,
   author = "Jiayong Zhang and Yanxi Liu",
   title = "SVM Decision Boundary Based Discriminative Subspace Induction",
   journal = "Pattern Recognition",
   pages = "1746 - 1758",
   publisher = "Elsevier",
   month = "October",
   year = "2005",
   volume = "38",
   number = "10",
}

The Robotics Institute

Menu