학술논문

Software-based erasure codes for scalable distributed storage
Document Type
Conference
Source
20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, 2003. (MSST 2003). Proceedings. Mass storage systems and technologies Mass Storage Systems and Technologies, 2003. (MSST 2003). Proceedings. 20th IEEE/11th NASA Goddard Conference on. :157-164 2003
Subject
Computing and Processing
Communication, Networking and Broadcast Technologies
Optical fiber networks
Computer architecture
Testing
Knowledge management
Protection
Silicon
Optical fibers
Moore's Law
Space technology
Laboratories
Language
Abstract
This paper presents a new class of erasure codes, Lincoln Erasure codes (LEC), applicable to large-scale distributed storage that includes thousands of disks attached to multiple networks. A high-performance software implementation that demonstrates the capability to meet these anticipated requirements is described. A framework for evaluation of candidate codes was developed to support in-depth analysis. When compared with erasure codes based on the work of Reed-Solomon and Luby (2000), tests indicate LEC has a higher throughput for encoding and decoding and lower probability of failure across a range of test conditions. Strategies are described for integration with storage-related hardware and software.