학술논문

Generalization Ability of Dynamic Systems by Using Second Order Derivatives of Universal Learning Network
Document Type
Journal Article
Source
IEEJ Transactions on Electronics, Information and Systems. 1999, 119(5):567
Subject
Generalization Ability
Regularization Technique
Second Order Derivatives
Universal Learning Network
Language
English
ISSN
0385-4221
1348-8155
Abstract
This paper studies how the generalization ability of modeling of the dynamic systems can be improved by taking advantages of second order derivatives of the criterion function with respect to the external inputs that can be considered as a direct implementation of the well-known regularization technique. Computation of second order derivatives of Universal Learning Network for a dynamic network are discussed. Simulation studies of a nonlinear dynamic system and a real robot system are carried out to demonstrate the effectiveness of the proposed method. Simulation results show that the proposed method can improve the generalization ability of neural networks sufficiently by selecting an appropriate regularization parameter.

Online Access