학술논문

BELM: Bayesian Extreme Learning Machine
Document Type
Periodical
Source
IEEE Transactions on Neural Networks IEEE Trans. Neural Netw. Neural Networks, IEEE Transactions on. 22(3):505-509 Mar, 2011
Subject
Computing and Processing
Communication, Networking and Broadcast Technologies
Bayesian methods
Machine learning
Training
Mathematical model
Computational modeling
Optimization
Artificial neural networks
Bayesian
extreme learning machine
multilayer perceptron
radial basis function
Language
ISSN
1045-9227
1941-0093
Abstract
The theory of extreme learning machine (ELM) has become very popular on the last few years. ELM is a new approach for learning the parameters of the hidden layers of a multilayer neural network (as the multilayer perceptron or the radial basis function neural network). Its main advantage is the lower computational cost, which is especially relevant when dealing with many patterns defined in a high-dimensional space. This brief proposes a Bayesian approach to ELM, which presents some advantages over other approaches: it allows the introduction of a priori knowledge; obtains the confidence intervals (CIs) without the need of applying methods that are computationally intensive, e.g., bootstrap; and presents high generalization capabilities. Bayesian ELM is benchmarked against classical ELM in several artificial and real datasets that are widely used for the evaluation of machine learning algorithms. Achieved results show that the proposed approach produces a competitive accuracy with some additional advantages, namely, automatic production of CIs, reduction of probability of model overfitting, and use of a priori knowledge.