학술논문
Lens-to-Lens Bokeh Effect Transformation. NTIRE 2023 Challenge Report
Document Type
Conference
Author
Conde, Marcos V.; Kolmet, Manuel; Seizinger, Tim; Bishop, Tom E.; Timofte, Radu; Kong, Xiangyu; Zhang, Dafeng; Wu, Jinlong; Wang, Fan; Peng, Juewen; Pan, Zhiyu; Liu, Chengxin; Luo, Xianrui; Sun, Huiqiang; Shen, Liao; Cao, Zhiguo; Xian, Ke; Liu, Chaowei; Chen, Zigeng; Yang, Xingyi; Liu, Songhua; Jing, Yongcheng; Mi, Michael Bi; Wang, Xinchao; Yang, Zhihao; Lian, Wenyi; Lai, Siyuan; Zhang, Haichuan; Hoang, Trung; Yazdani, Amirsaeed; Monga, Vishal; Luo, Ziwei; Gustafsson, Fredrik K.; Zhao, Zheng; Sjolund, Jens; Schon, Thomas B.; Zhao, Yuxuan; Chen, Baoliang; Xu, Yiqing; JiXiangNiu
Source
2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) CVPRW Computer Vision and Pattern Recognition Workshops (CVPRW), 2023 IEEE/CVF Conference on. :1643-1659 Jun, 2023
Subject
Language
ISSN
2160-7516
Abstract
We present the new Bokeh Effect Transformation Dataset (BETD), and review the proposed solutions for this novel task at the NTIRE 2023 Bokeh Effect Transformation Challenge. Recent advancements of mobile photography aim to reach the visual quality of full-frame cameras. Now, a goal in computational photography is to optimize the Bokeh effect itself, which is the aesthetic quality of the blur in out-of-focus areas of an image. Photographers create this aesthetic effect by benefiting from the lens optical properties.The aim of this work is to design a neural network capable of converting the the Bokeh effect of one lens to the effect of another lens without harming the sharp foreground regions in the image. For a given input image, knowing the target lens type, we render or transform the Bokeh effect accordingly to the lens properties. We build the BETD using two full-frame Sony cameras, and diverse lens setups.To the best of our knowledge, we are the first attempt to solve this novel task, and we provide the first BETD dataset and benchmark for it. The challenge had 99 registered participants. The submitted methods gauge the state-of-the-art in Bokeh effect rendering and transformation.