학술논문

Empirically Estimable Classification Bounds Based on a Nonparametric Divergence Measure
Document Type
Periodical
Source
IEEE Transactions on Signal Processing IEEE Trans. Signal Process. Signal Processing, IEEE Transactions on. 64(3):580-591 Feb, 2016
Subject
Signal Processing and Analysis
Communication, Networking and Broadcast Technologies
Computing and Processing
Measurement uncertainty
Bit error rate
Density measurement
Training
Signal processing algorithms
Estimation
Bayes error rate
classification
divergence measures
domain adaptation
nonparametric divergence estimator
Language
ISSN
1053-587X
1941-0476
Abstract
Information divergence functions play a critical role in statistics and information theory. In this paper we show that a nonparametric $f$-divergence measure can be used to provide improved bounds on the minimum binary classification probability of error for the case when the training and test data are drawn from the same distribution and for the case where there exists some mismatch between training and test distributions. We confirm these theoretical results by designing feature selection algorithms using the criteria from these bounds and by evaluating the algorithms on a series of pathological speech classification tasks.