학술논문

Microservices Integrated Performance and Reliability Testing
Document Type
Conference
Source
2022 IEEE/ACM International Conference on Automation of Software Test (AST) AST Automation of Software Test (AST), 2022 IEEE/ACM International Conference on. :29-39 May, 2022
Subject
Computing and Processing
Measurement
Q-factor
Quality assurance
Costs
Microservice architectures
Data visualization
Benchmark testing
Microservices systems
reliability testing
performance testing
Language
Abstract
Continuous quality assurance for extra-functional properties of modern software systems is today a big challenge as their complexity is constantly increasing to satisfy market demands. This is the case of microservice systems. They provide high control on the scale of operation by means of fine-grained service decomposition, but this demands careful consideration of the relations between performance of individual microservices and service failures. In this work, we propose MlPaRT, a novel methodology, and platform to automatically test microservice operations for performance and reliability in combination. The proposed platform can be integrated into a DevOps cycle to support continuous testing and monitoring by the automatic (1) generation and execution of performance-reliability ex-vivo testing sessions, (2) collection of monitoring data, (3) computation of performance and reliability metrics, and (4) integrated visualization of the results. We apply our approach by operating the platform on an open source benchmark. Results show that our integrated approach can provide additional insights into the performance and reliability behaviour of microservices as well as their mutual relationships. CCS CONCEPTS • Software and its engineering →Software performance; Software reliability; Software verification and validation.