Skip to main navigation Skip to search Skip to main content

gPPM: A Generalized Matrix Operation and Parallel Algorithm to Accelerate the Encoding/Decoding Process of Erasure Codes

  • Shiyi Li
  • , Qiang Cao
  • , Shenggang Wan
  • , Wen Xia*
  • , Changsheng Xie
  • *Corresponding author for this work
  • Harbin Institute of Technology Shenzhen
  • Huazhong University of Science and Technology
  • Peng Cheng Laboratory

Research output: Contribution to journalArticlepeer-review

Abstract

Erasure codes are widely deployed in modern storage systems, leading to frequent usage of their encoding/decoding operations. The encoding/decoding process for erasure codes is generally carried out using the parity-check matrix approach. However, this approach is serial and computationally expensive, mainly due to dealing with matrix operations, which results in low encoding/decoding performance. These drawbacks are particularly evident for newer erasure codes, including SD and LRC codes. To address these limitations, this article introduces the Partitioned and Parallel Matrix (PPM) algorithm. This algorithm partitions the parity-check matrix, parallelizes encoding/decoding operations, and optimizes calculation sequence to facilitate fast encoding/decoding of these codes. Furthermore, we present a generalized PPM (gPPM) algorithm that surpasses PPM in performance by employing fine-grained dynamic matrix calculation sequence selection. Unlike PPM, gPPM is also applicable to erasure codes such as RS code. Experimental results demonstrate that PPM improves the encoding/decoding speed of SD and LRC codes by up to 210.81%. Besides, gPPM achieves up to 102.41% improvement over PPM and 32.25% improvement over RS regarding encoding/decoding speed.

Original languageEnglish
Article number51
JournalACM Transactions on Architecture and Code Optimization
Volume20
Issue number4
DOIs
StatePublished - 14 Dec 2023
Externally publishedYes

Keywords

  • Erasure codes
  • computational cost
  • fault tolerance
  • parallelism
  • performance optimization
  • storage system

Fingerprint

Dive into the research topics of 'gPPM: A Generalized Matrix Operation and Parallel Algorithm to Accelerate the Encoding/Decoding Process of Erasure Codes'. Together they form a unique fingerprint.

Cite this