학술논문

Joint Optimization of Measurement Point Intelligent Selection and End-to-End Network Traffic Calculation in Datacenters
Document Type
Periodical
Source
IEEE Transactions on Network Science and Engineering IEEE Trans. Netw. Sci. Eng. Network Science and Engineering, IEEE Transactions on. 11(3):2438-2449 Jun, 2024
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Components, Circuits, Devices and Systems
Signal Processing and Analysis
Data centers
Cloud computing
Inference algorithms
Feature extraction
Costs
Tomography
Bayes methods
network measurement
measurement point selection
end-to-end
performance evaluation
Language
ISSN
2327-4697
2334-329X
Abstract
The effective design and management of data centers needs to follow the end-to-end traffic characteristics of data center networks (DCNs). However, directly measuring the end-to-end traffic of the network requires huge software and hardware costs. Since the particularity of the structure of DCNs, the flow estimation method used in the traditional computer network cannot be applied to existing DCNs. In this article, we study the end-to-end traffic calculation of cloud computing DCNs. We propose LLS-TC , which is an intelligent end-to-end traffic inference algorithm based on network tomography. Only using SNMP (simple network management protocol) data generally supported by switches, end-to-end traffic information can be calculated quickly and accurately. LLS-TC first devices a network traffic measurement point intelligent selection scheme based on node weighting. It first assigns weight to nodes through node criticality, and then uses node weighted incidence matrix approximation algorithm to calculate initial solution. LLS-TC then designs a network tomography method suitable for cloud computing network traffic calculation. It uses the time correlation of data center traffic to model the algorithm problem into a linear state space model, and finally calculates the traffic carried by each path through the improved Kalman filtering algorithm. Our evaluation and analysis demonstrate that LLS-TC can effectively use the extracted coarse-grained traffic characteristics, and greatly improve the accuracy of the calculation on the premise of ensuring the computational efficiency.