학술논문

Designing and Modeling Analog Neural Network Training Accelerators
Document Type
Conference
Source
2019 International Symposium on VLSI Technology, Systems and Application (VLSI-TSA) VLSI Technology, Systems and Application (VLSI-TSA), 2019 International Symposium on. :1-2 Apr, 2019
Subject
Components, Circuits, Devices and Systems
Computing and Processing
Engineered Materials, Dielectrics and Plasmas
Power, Energy and Industry Applications
Very large scale integration
Biological neural networks
Neuroscience
Language
Abstract
Analog crossbars have the potential to reduce the energy and latency required to train a neural network by three orders of magnitude when compared to an optimized digital ASIC. The crossbar simulator, CrossSim, can be used to model device nonidealities and determine what device properties are needed to create an accurate neural network accelerator. Experimentally measured device statistics are used to simulate neural network training accuracy and compare different classes of devices including TaOx ReRAM, Lir-Co-Oz devices, and conventional floating gate SONOS memories. A technique called “Periodic Carry” can overcomes device nonidealities by using a positional number system while maintaining the benefit of parallel analog matrix operations.