학술논문

I/O Workload Management for All-Flash Datacenter Storage Systems Based on Total Cost of Ownership
Document Type
Periodical
Source
IEEE Transactions on Big Data IEEE Trans. Big Data Big Data, IEEE Transactions on. 8(2):332-345 Apr, 2022
Subject
Computing and Processing
Resource management
Throughput
Data models
Servers
Big Data
Measurement
Cloud computing
Flash resource management
total cost of ownership model
SSD write amplification
NVMe
wearout prediction
workload sequentiality pattern
data center storage system
RAID
Language
ISSN
2332-7790
2372-2096
Abstract
Recently, the capital expenditure of flash-based Solid State Driver (SSDs) keeps declining and the storage capacity of SSDs keeps increasing. As a result, all-flash storage systems have started to become more economically viable for large shared storage installations in datacenters, where metrics like Total Cost of Ownership (TCO) are of paramount importance. On the other hand, flash devices suffer from write amplification, which, if unaccounted, can substantially increase the TCO of a storage system. In this paper, we first develop a TCO model for datacenter all-flash storage systems, and then plug a Write Amplification model (WAF) of NVMe SSDs we build based on empirical data into this TCO model. Our new WAF model accounts for workload characteristics like write rate and percentage of sequential writes. Furthermore, using both the TCO and WAF models as the optimization criterion, we design new flash resource management schemes (minTCO) to guide datacenter managers to make workload allocation decisions under the consideration of TCO for SSDs. Based on that, we also develop minTCO-RAID to support RAID SSDs and minTCO-Offline to optimize the offline workload-disk deployment problem during the initialization phase. Experimental results show that minTCO can reduce the TCO and keep relatively high throughput and space utilization of the entire datacenter storage resources.