학술논문

Feature-Embedding Triplet Networks with a Separately Constrained Loss Function
Document Type
Conference
Source
2023 IEEE International Symposium on Circuits and Systems (ISCAS) Circuits and Systems (ISCAS), 2023 IEEE International Symposium on. :1-5 May, 2023
Subject
Components, Circuits, Devices and Systems
Power, Energy and Industry Applications
Signal Processing and Analysis
Training
Circuits and systems
Hardware
triplet networks
classification
loss function
multi-layer perceptron
machine learning
Language
ISSN
2158-1525
Abstract
Feature-embedding triplet networks (TNs) with three symmetric subchannels are very promising for similarity-measuring applications. This paper proposes a novel separately constrained triple loss (SCTL) function that applies to TNs for classification. Through minimizing the intra-class distance and maximizing the inter-class distance, SCTL eliminates possible false solutions and provides insight into the dependency of training based on these two terms. Based on this dependency, the strategy of selecting hyperparameters in SCTL is also analyzed to further improve performance. The effectiveness of the proposed SCTL is evaluated based on TNs with multi-layer perceptrons; the results show that compared to all existing loss functions, the use of SCTL offers the best classification accuracy for the TNs, while incurring in negligible hardware overhead (e.g., only a 0.0002% area overhead of the subnetworks).