On Greediness of Feature Selection Algorithms

Abstract

Based on our analysis and experiments using real-world datasets, we find that the greediness of forward feature selection algorithms doesn't severely corrupt the accuracy of the function approximation using the selected input features, but improves the efficiency significantly. Hence, we propose three greedier algorithms in order to further enhance the efficiency of the feature selection processing. We also propose to use these algorithms to develop an off-line Chinese and Japanese handwriting recognition system with automatically configured, local models.