학술논문

Multiview Video Coding Using Video Game Context Information
Document Type
Conference
Source
2012 IEEE International Conference on Multimedia and Expo Workshops Multimedia and Expo Workshops (ICMEW), 2012 IEEE International Conference on. :1-6 Jul, 2012
Subject
Computing and Processing
Communication, Networking and Broadcast Technologies
Components, Circuits, Devices and Systems
Games
Encoding
Rendering (computer graphics)
Vectors
Streaming media
Acceleration
Weapons
Computer Graphics
H.264/AVC
Multiview Coding
Video Encoding
Video Streaming
Language
Abstract
Remote rendering of video games for 3DTV becomes a hot topic with the emergence of 3D-enabled mobile devices and cloud-based services. It is however a very challenging task that requires live encoding at very low latency for user interactivity as well as optimal encoding decisions for an acceptable QoE. One key-aspect is that most video games make use of a 3D engine, which is typically accelerated on a GPU, containing information on the composition of the 3D scene and its objects as well as their motion. In this paper, we explore how to extract this information from the GPU and how to exploit it in order to successfully offload the most time consuming tasks of a multiview video encoder. We show that near-optimal encoding decisions can be taken while minimizing the encoder computational complexity as well as the total delay.