학술논문

Decentralized Learning over Wireless Networks: The Effect of Broadcast with Random Access
Document Type
Conference
Source
2023 IEEE 24th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) Signal Processing Advances in Wireless Communications (SPAWC), 2023 IEEE 24th International Workshop on. :316-320 Sep, 2023
Subject
Communication, Networking and Broadcast Technologies
Signal Processing and Analysis
Training
Network topology
Wireless networks
Stochastic processes
Distributed databases
Machine learning
Signal processing
Decentralized learning
consensus optimization
wireless networks
broadcast
random access
Language
ISSN
1948-3252
Abstract
In this work, we focus on the communication aspect of decentralized learning, which involves multiple agents training a shared machine learning model using decentralized stochastic gradient descent (D-SGD) over distributed data. In particular, we investigate the impact of broadcast transmission and probabilistic random access policy on the convergence performance of D-SGD, considering the broadcast nature of wireless channels and the link dynamics in the communication topology. Our results demonstrate that optimizing the access probability to maximize the expected number of successful links is a highly effective strategy for accelerating the system convergence.