학술논문

HyCloud: Tweaking Hybrid Cloud Storage Services for Cost-Efficient Filesystem Hosting
Document Type
Periodical
Source
IEEE/ACM Transactions on Networking IEEE/ACM Trans. Networking Networking, IEEE/ACM Transactions on. 28(6):2629-2642 Dec, 2020
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Signal Processing and Analysis
Cloud computing
Relays
Data transfer
Bandwidth
IEEE transactions
Benchmark testing
Indexes
Hybrid cloud storage
filesystem hosting
cloud computing
transfer efficiency
Language
ISSN
1063-6692
1558-2566
Abstract
Today’s cloud storage infrastructures typically provide two distinct types of services for hosting files: object storage like Amazon S3 and filesystem storage like Amazon EFS. In practice, a cloud storage user often desires the advantages of both—efficient filesystem operations with a low unit storage price. An intuitive approach to achieving this goal is to combine the two types of services, e.g., by hosting large files in S3 and small files together with directory structures in EFS. Unfortunately, our benchmark experiments indicate that the clients’ download performance for large files becomes a severe system bottleneck. In this article, we attempt to address the bottleneck with little overhead by carefully tweaking the usages of S3 and EFS. Guided by two key observations, we design and implement an open-source system called HyCloud. It automatically invokes the data APIs of S3 and EFS on behalf of users, and intelligently schedules the data transfer among S3, EFS and the clients in a distributed manner. Real-world evaluations demonstrate that the unit storage price of HyCloud is close to that of S3, and the filesystem operations are executed as quickly as in EFS in most times (sometimes even more quickly than in EFS).