학술논문

SWYNT: Swin Y-Net Transformers for Deepfake Detection
Document Type
Conference
Source
2023 International Conference on Robotics and Automation in Industry (ICRAI) Robotics and Automation in Industry (ICRAI), 2023 International Conference on. :1-6 Mar, 2023
Subject
Power, Energy and Industry Applications
Robotics and Control Systems
Performance evaluation
Industries
Deepfakes
Social networking (online)
Transformers
Decoding
Reliability
Celeb-DF
Deepfake
Deepfake Detection
FaceForensics++
Swin Transformer
Swim Y-Net
U-Net
Language
ISSN
2831-3313
Abstract
Nowadays, less technical individuals can create false videos by only source and target images, using deepfakes generation tools and methodologies. Distributing false information on social media and other concerns related to the deepfakes have thus significantly increased. To deal with the challenges posed by incorrect details, efficient Deepfakes detection algorithms must be developed considering the tremendous advancement in deepfakes generating techniques. Existing techniques are not reliable enough to find deepfakes, especially when the videos are made with various deepfakes generation methods. The Swin Y-Net Transformers (SWYNT) architecture we created in this paper can visually discriminate between natural and artificial faces. The architecture uses a Swin transformer, encoder, and decoder in a U -Net architecture with a classification branch to build a model that can classify and segment deepfakes. The segmentation process creates segmentation masks and helps train the classifier. We have evaluated our suggested method using the extensive, standard, and diverse FaceForensics++ (FF++) and the Celeb-DF dataset. The generalizability evaluation of our process, which is part of the performance evaluation, reveals the model's promising performance in identifying deepfakes videos generated using various methodologies on both large-scale datasets.