학술논문

Exploring the Latency Sensitivity of Cache Replacement Policies
Document Type
Periodical
Source
IEEE Computer Architecture Letters IEEE Comput. Arch. Lett. Computer Architecture Letters. 22(2):93-96 Dec, 2023
Subject
Computing and Processing
Metadata
Delays
Optimized production technology
Prefetching
Multicore processing
Hardware
Computational modeling
Cache replacement policies
computer architecture
high-performance computing
Language
ISSN
1556-6056
1556-6064
2473-2575
Abstract
With DRAM latencies increasing relative to CPU speeds, the performance of caches has become more important. This has led to increasingly sophisticated replacement policies that require complex calculations to update their replacement metadata, which often require multiple cycles. To minimize the negative impact of these metadata updates, architects have focused on policies that incur as little update latency as possible through a combination of reducing the policies’ precision and using parallel hardware. In this work we investigate whether these tradeoffs to reduce cache metadata update latency are needed. Specifically, we look at the performance and energy impact of increasing the latency of cache replacement policy updates. We find that even dramatic increases in replacement policy update latency have very limited effect. This indicates that designers have far more freedom to increase policy complexity and latency than previously assumed.