cs 18: e1

Research Article

On the Adoption of Erasure Code for Cloud Storage by Major Distributed Storage Systems

Download78 downloads
  • @ARTICLE{10.4108/eai.14-9-2021.170955,
        author={Aatish Chiniah and Avinash Mungur},
        title={On the Adoption of Erasure Code for Cloud  Storage by Major Distributed Storage Systems},
        journal={EAI Endorsed Transactions on Cloud Systems: Online First},
        volume={},
        number={},
        publisher={EAI},
        journal_a={CS},
        year={2021},
        month={9},
        keywords={Distributed Storage Systems (DSS), Erasure Code, Cloud Storage, Redundancy, CAP Theorem},
        doi={10.4108/eai.14-9-2021.170955}
    }
    
  • Aatish Chiniah
    Avinash Mungur
    Year: 2021
    On the Adoption of Erasure Code for Cloud Storage by Major Distributed Storage Systems
    CS
    EAI
    DOI: 10.4108/eai.14-9-2021.170955
Aatish Chiniah1,*, Avinash Mungur2
  • 1: Department of Digital Technologies, Faculty of Information, Communication and Digital Technologies, University of Mauritius
  • 2: Department of Information and Communication Technologies, Faculty of Information, Communication and Digital Technologies, University of Mauritius
*Contact email: a.chiniah@uom.ac.mu

Abstract

INTRODUCTION: Traditional Cloud Systems are struggling to cope with the exponential growth of data in todays’ distributed application environment. The amount of data online has continuously increased since 2003. From an estimated 5 Exabyte in 2003 to 988 Exabyte in 2010. Presently it is estimated that 5 Exabyte of data are produced daily. To cope with such astronomical load of data, Distributed Storage Systems such as Amazon, Google and Microsoft Azure are becoming the de-facto method for the storage of data. Replication is the method used for providing redundancy. However Erasure Coding is a worthy alternative.

OBJECTIVES: The purpose of this paper is to assess the most used distributed storage systems using different evaluation criteria and identifying how erasure code can be integrated into them.

METHODS: This paper provides a survey of well-known Distributed Storage Systems by using the CAP (Consistency, Availability and Partition Tolerance) Theorem. We go by presenting the solution according to the objectives set and trade-off acknowledged by the designers.

RESULTS: A comprehensive survey is presented using five evaluation criteria (design principle, data model, failure detection and recovery, consistency and security). Adoption of erasure code in Distributed Storage Systems is discussed and its advantages are deliberated. Several open challenges are also put forward.

CONCLUSION: This paper provides researchers in the field with a comprehensive review of Distributed Storage Systems and how the adoption of erasure codes will enhance their capabilities.