학술논문

Performance Evaluation of Split Computing with TinyML on IoT Devices
Document Type
Conference
Source
2024 IEEE 21st Consumer Communications & Networking Conference (CCNC) Consumer Communications & Networking Conference (CCNC), 2024 IEEE 21st. :1-6 Jan, 2024
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Robotics and Control Systems
Performance evaluation
Microcontrollers
Neural networks
Energy efficiency
Internet of Things
Servers
Proposals
tinyML
performance evaluation
split computing
Language
ISSN
2331-9860
Abstract
The proliferation of Internet of Things (IoT) devices has sparked a growing demand for lightweight and energy-efficient machine learning solutions, leading to the emergence of Tiny Machine Learning (TinyML). This paper presents a thorough evaluation of TinyML, encompassing its performance metrics, challenges, and prospects, focused on the use of Split Computing. Split Computing allows to offload a subset of layers of a neural network to a more powerful Edge server, to achieve a faster computation hence lower inference latency. We evaluate our proposal on a real testbed with ESP32 microcontrollers with different neural network structures, highlighting the benefits of split computing for IoT devices with varying conditions. Our results indicate that split computing on IoT devices is viable and can bring benefits particularly in heavy load scenarios where the network conditions may rapidly change.