Hardware-Oriented Succinct-Data-Structure for Text Processing Based on Block-Size-Constrained Compression

Authors

  • Hasitha Muthumala Waidyasooriya Graduate School of Information Sciences, Tohoku University, Aoba 6-6-05, Aramaki, Aoba, Sendai, Miyagi,980-8579, Japan
  • Daisuke Ono Graduate School of Information Sciences, Tohoku University, Aoba 6-6-05, Aramaki, Aoba, Sendai, Miyagi,980-8579, Japan
  • Masanori Hariyama Graduate School of Information Sciences, Tohoku University, Aoba 6-6-05, Aramaki, Aoba, Sendai, Miyagi,980-8579, Japan

Keywords:

Succinct data structures, data compression, text-search, FPGA, big-data

Abstract

Succinct data structures are introduced to efficiently solve a given problem while representing the data using as little space as possible. However, the full potential of the succinct data structures has not been utilized in software-based implementations due to the large storage size and the memory access bottleneck. This paper proposes a hardware-oriented data compression method based on clustering of blocks. We use a parallel processing architecture to reduce the decompression overhead. According to the evaluation, we achieve 73% and 27% of storage size and memory access reductions respectively.

Downloads

Download data is not yet available.

Downloads

Published

2016-01-01

How to Cite

Hasitha Muthumala Waidyasooriya, Daisuke Ono, & Masanori Hariyama. (2016). Hardware-Oriented Succinct-Data-Structure for Text Processing Based on Block-Size-Constrained Compression. International Journal of Computer Information Systems and Industrial Management Applications, 8, 11. Retrieved from https://cspub-ijcisim.org/index.php/ijcisim/article/view/302

Issue

Section

Original Articles