Index selection for NoSQL database with deep reinforcement learning

  • Yu Yan
  • , Shun Yao
  • , Hongzhi Wang*
  • , Meng Gao
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

With the development of big data technology, the data management of complex applications has become more and more resource intensive. In this paper, we propose an automatic approach (DRLISA) to achieve NoSQL database index selection. For different workloads, we automatically select its corresponding indexes and parameters which can totally improve the database performance. Our DRLISA establishes an optimal index by building a deep reinforcement learning model which is able to adapt the dynamic change of workloads. We conducted our experiments in five aspects (the impact of data manipulation, the impact of operation count, comparison with random selection, comparison with existing method and the robustness of DRLISA) using the open source benchmark, YCSB. The experimental results showed that DRLISA has a high efficient index recommendation under the dynamic workloads.

Original languageEnglish
Pages (from-to)20-30
Number of pages11
JournalInformation Sciences
Volume561
DOIs
StatePublished - Jun 2021
Externally publishedYes

Keywords

  • Index section
  • NoSQL
  • Reinforcement learning

Fingerprint

Dive into the research topics of 'Index selection for NoSQL database with deep reinforcement learning'. Together they form a unique fingerprint.

Cite this