학술논문

Anomaly Detection Using an Ensemble of Feature Models
Document Type
Conference
Source
2010 IEEE International Conference on Data Mining Data Mining (ICDM), 2010 IEEE 10th International Conference on. :953-958 Dec, 2010
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Training
Feature extraction
Support vector machines
Predictive models
Prediction algorithms
Kernel
Entropy
anomaly detection
machine learning
feature selection
Language
ISSN
1550-4786
2374-8486
Abstract
We present a new approach to semi-supervised anomaly detection. Given a set of training examples believed to come from the same distribution or class, the task is to learn a model that will be able to distinguish examples in the future that do not belong to the same class. Traditional approaches typically compare the position of a new data point to the set of ``normal'' training data points in a chosen representation of the feature space. For some data sets, the normal data may not have discernible positions in feature space, but do have consistent relationships among some features that fail to appear in the anomalous examples. Our approach learns to predict the values of training set features from the values of other features. After we have formed an ensemble of predictors, we apply this ensemble to new data points. To combine the contribution of each predictor in our ensemble, we have developed a novel, information-theoretic anomaly measure that our experimental results show selects against noisy and irrelevant features. Our results on 47 data sets show that for most data sets, this approach significantly improves performance over current state-of-the-art feature space distance and density-based approaches.