학술논문

DFGC-VRA: DeepFake Game Competition on Visual Realism Assessment
Document Type
Conference
Source
2023 IEEE International Joint Conference on Biometrics (IJCB) Biometrics (IJCB), 2023 IEEE International Joint Conference on. :1-9 Sep, 2023
Subject
Computing and Processing
Signal Processing and Analysis
Deepfakes
Visualization
Games
Detectors
Transformers
Quality assessment
Task analysis
Language
ISSN
2474-9699
Abstract
This paper presents the summary report on the DeepFake Game Competition on Visual Realism Assessment (DFGC-VRA). Deep-learning based face-swap videos, also known as deepfakes, are becoming more and more realistic and deceiving. The malicious usage of these face-swap videos has caused wide concerns. There is a ongoing deepfake game between its creators and detectors, with the human in the loop. The research community has been focusing on the automatic detection of these fake videos, but the assessment of their visual realism, as perceived by human eyes, is still an unexplored dimension. Visual realism assessment, or VRA, is essential for assessing the potential impact that may be brought by a specific face-swap video, and it is also useful as a quality metric to compare different face-swap methods. This is the third edition of DFGC competitions, which focuses on the new visual realism assessment topic, different from previous ones that compete creators versus detectors. With this competition, we conduct a comprehensive study of the SOTA performance on the new task. We also release our MindSpore codes to further facilitate research in this field (https://github.com/bomb2peng/DFGC-VRA-benckmark).