학술논문

A Hybrid Approach for Home Energy Management With Imitation Learning and Online Optimization
Document Type
Periodical
Source
IEEE Transactions on Industrial Informatics IEEE Trans. Ind. Inf. Industrial Informatics, IEEE Transactions on. 20(3):4527-4539 Mar, 2024
Subject
Power, Energy and Industry Applications
Signal Processing and Analysis
Computing and Processing
Communication, Networking and Broadcast Technologies
Optimization
Energy management
Home appliances
Costs
Training
Real-time systems
Load modeling
Home energy management
imitation learning (IL)
mixed-integer linear programming (MILP)
online optimization
reinforcement learning (RL)
Language
ISSN
1551-3203
1941-0050
Abstract
A home energy management system exploits the time-varying electricity tariff and renewable energy profiles to lower residents' electricity bills via wise scheduling of various domestic appliances. This study targets the rather typical case of a general household with solar panels. All four classes of loads are considered, while many existing studies only investigate a restricted subset. Considering the high stochasticity in real-time pricing and solar power generation, we propose an online approach in a hybrid semidecentralized framework, where each shiftable load is controlled by a deep neural network (DNN), and all adjustable loads are coordinated together by fast online optimization. We train each DNN via efficient and effective imitation learning (IL) instead of popular reinforcement learning (RL). This framework allows adjustable loads to react properly to possibly poor actions of shiftable loads via online one-step optimization to alleviate their adverse impact. Numerical experiments with real-world data show that, compared with RL, our approach can reduce the training time significantly, while its execution time is only slightly affected. Moreover, our approach outperforms the traditional day-ahead optimization method and the fully decentralized multiagent RL and multiagent IL methods by a wide margin, attaining an average cost fairly close to the theoretical minimum.