학술논문

3-D In-Sensor Computing for Real-Time DVS Data Compression: 65-nm Hardware-Algorithm Co-Design
Document Type
Periodical
Source
IEEE Solid-State Circuits Letters IEEE Solid-State Circuits Lett. Solid-State Circuits Letters, IEEE. 7:119-122 2024
Subject
Components, Circuits, Devices and Systems
Computing and Processing
Voltage control
Computer architecture
Three-dimensional displays
Artificial intelligence
Weight measurement
Through-silicon vias
Semiconductor device measurement
3-D stacking
data compression
dynamic vision sensor (DVS)
in-memory computing (IMC)
in-sensor computing
Language
ISSN
2573-9603
Abstract
Traditional IO links are insufficient to transport high volume of image sensor data, under stringent power and latency constraints. To address this, we demonstrate a low latency, low power in-sensor computing architecture to compress the data from a 3D-stacked dynamic vision sensor (DVS). In this design, we adopt a 4-bit autoencoder algorithm and implement it on an AI computing layer with in-memory computing (IMC) to enable real-time compression of DVS data. To support 3-D integration, this architecture is optimized to handle the unique constraints, including footprint to match the size of the sensor array, low latency to manage the continuous data stream, and low-power consumption to avoid thermal issues. Our prototype chip in 65-nm CMOS demonstrates the new concept of 3-D in-sensor computing, achieving < 6 mW power consumption at 1–10 MHz operating frequency, and $10\times $ compression ratio on $256\times 256$ DVS pixels.