Conference paper

Somol P., Grim J., Pudil P.

Multiple Classifier Systems, LNCS 5519

Springer

Berlin Heidelberg

2009

3-642-02325-8

0302-9743

RNDr. Petr Somol, Ph.D. (ÚTIA - Oddělení rozpoznávání obrazů)

feature selection, criterion, ensemble, combining criteria

In feature selection the effect of over-fitting may lead to serious degradation of generalization ability. We introduce the concept of combining multiple feature selection criteria in feature selection methods with the aim to obtain feature subsets that generalize better. The concept is applicable with many existing feature selection methods. Here we discuss in more detail the family of sequential search methods. The concept does not specify which criteria to combine – to illustrate its feasibility we give a simple example of combining the estimated accuracy of k-nearest neighbor classifiers for various k.We perform the experiments on a number of datasets. The potential to improve is clearly seen on improved classifier performance on independent test data as well as on improved feature selection stability.