학술논문

Dynamic clustering based on Q-Learning for load balancing in IoT
Document Type
Conference
Source
2022 4th IEEE Middle East and North Africa COMMunications Conference (MENACOMM) COMMunications Conference (MENACOMM), 2022 4th IEEE Middle East and North Africa. :203-208 Dec, 2022
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Signal Processing and Analysis
Performance evaluation
Q-learning
Scalability
Load management
Batteries
Proposals
Internet of Things
IoT
Reinforcement learning
Q-Learning
Load balancing
clustering
Language
Abstract
The advent of the Internet of Things (IoT) is leding to huge volumes of data from millions of connected devices dedicated to collecting, transferring, and generating data from a wide variety of domains. Thereby, several approaches have been proposed in the literature for data aggregation, most notably that rely on adding an edge computing layer to offload the network of data transferred to the cloud for processing. However, this approach faces several challenges related to IoT network clustering and load balancing. As a result, different methods for clustering networks based on static typologies have been proposed; however, this static aspect is ineffective when the batteries of some devices are depleted at the expense of others. In this work, we propose a method based on reinforcement learning to find dynamically an efficient clustering that guarantees load balancing. Our approach remains adaptive and able to adjust itself to changes in the energy capacity of devices. From the results obtained, our proposal achieved a significant improvement in terms of load balancing in the presence of devices with depleted batteries.