On the Greediness of Feature Selection Algorithms - Robotics Institute Carnegie Mellon University

On the Greediness of Feature Selection Algorithms

Kan Deng and Andrew Moore
Conference Paper, Proceedings of (ICML) International Conference on Machine Learning, June, 1998

Abstract

Based on our analysis and experiments using real-world datasets, we find that the greediness of forward feature selection algorithms does not severely corrupt the accuracy of function approximation using the selected input features, but improves the efficiency significantly. Hence, we propose three greedier algorithms in order to further enhance the efficiency of the feature selection processing. We provide empirical results for linear regression, locally weighted regression and k-nearest-neighbor models. We also propose to use these algorithms to develop an offline Chinese and Japanese handwriting recognition system with auto matically configured, local models.

BibTeX

@conference{Deng-1998-14691,
author = {Kan Deng and Andrew Moore},
title = {On the Greediness of Feature Selection Algorithms},
booktitle = {Proceedings of (ICML) International Conference on Machine Learning},
year = {1998},
month = {June},
}