학술논문

Training deep neural networks on imbalanced data sets
Document Type
Conference
Source
2016 International Joint Conference on Neural Networks (IJCNN) Neural Networks (IJCNN), 2016 International Joint Conference on. :4368-4374 Jul, 2016
Subject
Computing and Processing
Neural networks
Classification algorithms
Machine learning
Training
Standards
Sampling methods
Australia
deep neural network
loss function
data imbalance
Language
ISSN
2161-4407
Abstract
Deep learning has become increasingly popular in both academic and industrial areas in the past years. Various domains including pattern recognition, computer vision, and natural language processing have witnessed the great power of deep networks. However, current studies on deep learning mainly focus on data sets with balanced class labels, while its performance on imbalanced data is not well examined. Imbalanced data sets exist widely in real world and they have been providing great challenges for classification tasks. In this paper, we focus on the problem of classification using deep network on imbalanced data sets. Specifically, a novel loss function called mean false error together with its improved version mean squared false error are proposed for the training of deep networks on imbalanced data sets. The proposed method can effectively capture classification errors from both majority class and minority class equally. Experiments and comparisons demonstrate the superiority of the proposed approach compared with conventional methods in classifying imbalanced data sets on deep neural networks.