학술논문

A Modified Levenberg Marquardt Algorithm for Simultaneous Learning of Multiple Datasets
Document Type
Periodical
Source
IEEE Transactions on Circuits and Systems II: Express Briefs IEEE Trans. Circuits Syst. II Circuits and Systems II: Express Briefs, IEEE Transactions on. 71(4):2379-2383 Apr, 2024
Subject
Components, Circuits, Devices and Systems
Artificial neural networks
Jacobian matrices
Biological neural networks
Optimization
Tuning
Training
Neurons
Levenberg-Marquardt algorithm
multiple dataset learning
masked neural networks
Language
ISSN
1549-7747
1558-3791
Abstract
Levenberg-Marquardt (LM) algorithm is a powerful approach to optimize the parameters of a neural network (NN). Given a training dataset, the algorithm synthesizes the best path toward the optimum. This brief demonstrates the use of LM optimization algorithm when there are more than one dataset and on/off type switching of NN parameters is allowed. For each dataset a pre-selected set of parameters are allowed for modification and the proposed scheme reformulates the Jacobian under the switching mechanism. The results show that a NN can store information available in different datasets by a simple modification to the original LM algorithm, which is the novelty introduced in this brief. The results are verified on a regression problem.