학술논문

Contextualized Styling of Images for Web Interfaces using Reinforcement Learning
Document Type
Conference
Source
2022 IEEE International Symposium on Multimedia (ISM) ISM Multimedia (ISM), 2022 IEEE International Symposium on. :169-172 Dec, 2022
Subject
Computing and Processing
Training
Scalability
Impedance matching
Sociology
Reinforcement learning
Media
Statistics
reinforcement learning
image enhancement
context
image modification
content variant generation
Language
Abstract
Content personalization is one of the foundations of today’s digital marketing. Often the same image needs to be adapted for different design schemes for content that is created for different occasions, geographic locations or other aspects of the target population. We present a novel reinforcement learning (RL) based method for automatically stylizing images to complement the design scheme of media, e.g., interactive websites, apps, or posters. Our approach considers attributes related to the design of the media and adapts the style of the input image to match the context. We do so using a preferential reward system in the RL framework that learns a reward function using human feedback. We conducted several user studies to evaluate our approach and demonstrate that we are able to effectively adapt image styles to different design schemes. In user studies, images stylized through our approach were the most preferred variation across a majority of our experiments. Additionally, we also release a dataset consisting of perceptual associations of web context with the associated image style.