학술논문

Semi-Supervised Eye Makeup Transfer by Swapping Learned Representation
Document Type
Conference
Source
2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) ICCVW Computer Vision Workshop (ICCVW), 2019 IEEE/CVF International Conference on. :3858-3867 Oct, 2019
Subject
Computing and Processing
Training
Generators
Image reconstruction
Face
Decoding
Tuning
Eyelashes
Makeup Transfer
Disentangled Representation
Autoencoder
Language
ISSN
2473-9944
Abstract
This paper introduces an autoencoder structure to transfer the eye makeup from an arbitrary reference image to a source image realistically and faithfully using both synthetic paired data and unpaired data in a semi-supervised way. Different from the image domain transfer problem, our framework only needs one domain entity and follows an "encoding-swap-decoding" process. Makeup transfer is achieved by decoding the base representation from a source image and makeup representation from a reference image. Moreover, our method allows users to control the makeup degree by tuning makeup weight. To the best of our knowledge, there is no public large makeup dataset to evaluate data-driven approaches. We have collected a dataset of non-makeup images and with-makeup images of various eye makeup styles. Experiments demonstrate the effectiveness of our method with the state-of-the-art methods both qualitatively and quantitatively.