학술논문
Multi-label Classification of Steel Surface Defects Using Transfer Learning and Vision Transformer
Document Type
Conference
Source
2022 13th International Conference on Information and Knowledge Technology (IKT) Information and Knowledge Technology (IKT), 2022 13th International Conference on. :1-5 Dec, 2022
Subject
Language
Abstract
Steel is the most widely used metal in various industries, for instance, automotive, buildings, packaging, etc. Defect detection on steel surfaces is crucial for steel production companies. This paper proposes a multi-label classification algorithm based on deep learning methods. Several models were trained based on the Severstal dataset, namely MobileNet-V2, Xception, DenseNet121, ViT, and ResNet-50 with transfer learning. In addition, a base model is trained from scratch based on convolutional layers such as ResNet. Moreover, a ViT model is constructed according to the attention and transformer layers concept. At first, 91% for the weighted F1 score is obtained. By exploiting the weighted loss method, the weighted F1 score increased to 92%.