Conference paper

Grim J., Hora J.

Artificial Neural Networks – ICANN 2010

Part III

Springer Verlag

Berlin Heidelberg

2010

ISBN-10 3-642-15824-2

Ing. Jiří Grim, CSc. (ÚTIA - Oddělení rozpoznávání obrazů)

Probabilistic neural networks, Statistical pattern recogniti

We discuss the problem of overfitting of probabilistic neural networks in the framework of statistical pattern recognition. The probabilistic approach to neural networks provides a statistically justified subspace method of classification. The underlying structural mixture model includes binary structural parameters and can be optimized by EM algorithm in full generality. Formally, the structural model reduces the number of parameters included and therefore the structural mixtures become less complex and less prone to overfitting. We illustrate how recognition accuracy and the effect of overfitting is influenced by mixture complexity and by the size of training data set.