학술논문

Energy-Efficient Ferroelectric-FET-Based Agent With Memory Trace for Enhanced Reinforcement Learning
Document Type
Periodical
Source
IEEE Electron Device Letters IEEE Electron Device Lett. Electron Device Letters, IEEE. 45(2):264-267 Feb, 2024
Subject
Engineered Materials, Dielectrics and Plasmas
Components, Circuits, Devices and Systems
FeFETs
Iron
Voltage measurement
Memory management
Threshold voltage
Plastics
Convergence
Ferroelectric FET (FeFET)
reinforcement learning
memory trace
short-term and long-term memory
Language
ISSN
0741-3106
1558-0563
Abstract
In this work, for the first time, we algorithmically merge the memory trace effect into activation function in neural network for reinforcement learning, and a novel ferroelectric FET (FeFET) based agent with both activation function and plastic weight is proposed and experimentally demonstrated. By exploiting the physics of short-time scale dynamics of depolarization process induced by depolarization field, the activation function with memory trace effect can be emulated in one FeFET at ultra-low operating voltage of 0.5V. In addition, the plastic weight with multilevel states can be realized by the long-time scale retention of spontaneous polarization in FeFET simultaneously. Moreover, based on the proposed FeFET-based agent, reinforcement learning is demonstrated with convergence rate boost and high energy efficiency. This work provides a promising highly-integrated agent solution for RL system.