학술논문

Mitigating Serverless Tail Latency: A Comprehensive Study of Factors and Strategies
Document Type
Conference
Source
2023 OITS International Conference on Information Technology (OCIT) Information Technology (OCIT), 2023 OITS International Conference on. :369-374 Dec, 2023
Subject
Communication, Networking and Broadcast Technologies
Components, Circuits, Devices and Systems
Computing and Processing
General Topics for Engineers
Power, Energy and Industry Applications
Signal Processing and Analysis
Codes
Serverless computing
Tail
Writing
User experience
Information technology
Best practices
Cold-start
Function-as-a-Service
Tail Latency
Cloud computing
Language
Abstract
Serverless computing has gained widespread popularity due to its ability to dynamically allocate resources and abstract away the underlying infrastructure, allowing developers to focus on writing code without the need to manage servers. However, one challenge in serverless computing is tail latency, which refers to the time taken by the slowest requests to complete. High tail latency can result in poor user experience and decreased application performance. This research paper aims to explore techniques and best practices to reduce tail latency in serverless computing environments. We have reviewed the existing literature, identify the key factors affecting tail latency, and analyze various approaches and strategies to mitigate tail latency in serverless computing. Some real-world use cases and practical recommendations for developers and practitioners in term of tail latency in serverless computing to optimize the performance of serverless applications are also presented.