학술논문
An Adaptive Partitioning Method for Distributed Stream Processing Systems
Document Type
Conference
Source
2022 IEEE 11th Global Conference on Consumer Electronics (GCCE) Consumer Electronics (GCCE), 2022 IEEE 11th Global Conference on. :282-283 Oct, 2022
Subject
Language
Abstract
In recent years, stream processing systems have attracted attention for their ability to process big data, that is constantly generated, with low latency. However, the performance of stream processing deteriorates due to the bias in the amount of input data for parallel processing. This paper proposes an adaptive partitioning method based on the latency of each parallel process. Experimental results using a prototype system show that the latency bias can be reduced to half.