Cost-Based Lightweight Storage Automatic Decision for In-Database Machine Learning

Shuangshuang Cui; Hongzhi Wang; Haiyao Gu; Yuntian Xie

doi:10.1007/978-3-030-90888-1_10

Cost-Based Lightweight Storage Automatic Decision for In-Database Machine Learning

Shuangshuang Cui
, Hongzhi Wang^*
, Haiyao Gu
, Yuntian Xie

^*Corresponding author for this work

Faculty of Computing

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Storage structure decision for a database aims to automatically determine the effective storage structure according to the data distribution and workload. With the integration of machine learning and database becoming closer, complex machine learning tasks are directly executed in database, and need the support of efficient storage structure. The existing storage decision methods are mainly oriented to common workloads and rely on the decision of experienced DBAs, which has low efficiency and high risk of error. Thus, an automated storage structure decision method for in-database machine learning is urgently needed. We propose a cost-based lightweight row-column storage automatic decision system. To the best of our knowledge, this is the first storage structure selection for machine learning tasks. Extensive experiments show that the accuracy of the storage structure above 90%, shorten the task execution time by about 85%, and greatly reduce the risk of decision error.

Original language	English
Title of host publication	Web Information Systems Engineering - WISE 2021 - 22nd International Conference on Web Information Systems Engineering, WISE 2021, Proceedings
Editors	Wenjie Zhang, Lei Zou, Zakaria Maamar, Lu Chen
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	119-126
Number of pages	8
ISBN (Print)	9783030908874
DOIs	https://doi.org/10.1007/978-3-030-90888-1_10
State	Published - 2021
Event	22nd International Conference on Web Information Systems Engineering, WISE 2021 - Melbourne, Australia Duration: 26 Oct 2021 → 29 Oct 2021

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	13080 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	22nd International Conference on Web Information Systems Engineering, WISE 2021
Country/Territory	Australia
City	Melbourne
Period	26/10/21 → 29/10/21

Keywords

AI for DB
Data partition
Row and column storage

Access to Document

10.1007/978-3-030-90888-1_10

Cite this

Cui, S., Wang, H., Gu, H., & Xie, Y. (2021). Cost-Based Lightweight Storage Automatic Decision for In-Database Machine Learning. In W. Zhang, L. Zou, Z. Maamar, & L. Chen (Eds.), Web Information Systems Engineering - WISE 2021 - 22nd International Conference on Web Information Systems Engineering, WISE 2021, Proceedings (pp. 119-126). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13080 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-90888-1_10

Cui, Shuangshuang ; Wang, Hongzhi ; Gu, Haiyao et al. / Cost-Based Lightweight Storage Automatic Decision for In-Database Machine Learning. Web Information Systems Engineering - WISE 2021 - 22nd International Conference on Web Information Systems Engineering, WISE 2021, Proceedings. editor / Wenjie Zhang ; Lei Zou ; Zakaria Maamar ; Lu Chen. Springer Science and Business Media Deutschland GmbH, 2021. pp. 119-126 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{a97e1e8e698f427da210b57658fa4286,

title = "Cost-Based Lightweight Storage Automatic Decision for In-Database Machine Learning",

abstract = "Storage structure decision for a database aims to automatically determine the effective storage structure according to the data distribution and workload. With the integration of machine learning and database becoming closer, complex machine learning tasks are directly executed in database, and need the support of efficient storage structure. The existing storage decision methods are mainly oriented to common workloads and rely on the decision of experienced DBAs, which has low efficiency and high risk of error. Thus, an automated storage structure decision method for in-database machine learning is urgently needed. We propose a cost-based lightweight row-column storage automatic decision system. To the best of our knowledge, this is the first storage structure selection for machine learning tasks. Extensive experiments show that the accuracy of the storage structure above 90\%, shorten the task execution time by about 85\%, and greatly reduce the risk of decision error.",

keywords = "AI for DB, Data partition, Row and column storage",

author = "Shuangshuang Cui and Hongzhi Wang and Haiyao Gu and Yuntian Xie",

note = "Publisher Copyright: {\textcopyright} 2021, Springer Nature Switzerland AG.; 22nd International Conference on Web Information Systems Engineering, WISE 2021 ; Conference date: 26-10-2021 Through 29-10-2021",

year = "2021",

doi = "10.1007/978-3-030-90888-1\_10",

language = "英语",

isbn = "9783030908874",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "119--126",

editor = "Wenjie Zhang and Lei Zou and Zakaria Maamar and Lu Chen",

booktitle = "Web Information Systems Engineering - WISE 2021 - 22nd International Conference on Web Information Systems Engineering, WISE 2021, Proceedings",

address = "德国",

}

Cui, S, Wang, H, Gu, H & Xie, Y 2021, Cost-Based Lightweight Storage Automatic Decision for In-Database Machine Learning. in W Zhang, L Zou, Z Maamar & L Chen (eds), Web Information Systems Engineering - WISE 2021 - 22nd International Conference on Web Information Systems Engineering, WISE 2021, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13080 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 119-126, 22nd International Conference on Web Information Systems Engineering, WISE 2021, Melbourne, Australia, 26/10/21. https://doi.org/10.1007/978-3-030-90888-1_10

Cost-Based Lightweight Storage Automatic Decision for In-Database Machine Learning. / Cui, Shuangshuang; Wang, Hongzhi; Gu, Haiyao et al.
Web Information Systems Engineering - WISE 2021 - 22nd International Conference on Web Information Systems Engineering, WISE 2021, Proceedings. ed. / Wenjie Zhang; Lei Zou; Zakaria Maamar; Lu Chen. Springer Science and Business Media Deutschland GmbH, 2021. p. 119-126 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13080 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Cost-Based Lightweight Storage Automatic Decision for In-Database Machine Learning

AU - Cui, Shuangshuang

AU - Wang, Hongzhi

AU - Gu, Haiyao

AU - Xie, Yuntian

PY - 2021

Y1 - 2021

N2 - Storage structure decision for a database aims to automatically determine the effective storage structure according to the data distribution and workload. With the integration of machine learning and database becoming closer, complex machine learning tasks are directly executed in database, and need the support of efficient storage structure. The existing storage decision methods are mainly oriented to common workloads and rely on the decision of experienced DBAs, which has low efficiency and high risk of error. Thus, an automated storage structure decision method for in-database machine learning is urgently needed. We propose a cost-based lightweight row-column storage automatic decision system. To the best of our knowledge, this is the first storage structure selection for machine learning tasks. Extensive experiments show that the accuracy of the storage structure above 90%, shorten the task execution time by about 85%, and greatly reduce the risk of decision error.

AB - Storage structure decision for a database aims to automatically determine the effective storage structure according to the data distribution and workload. With the integration of machine learning and database becoming closer, complex machine learning tasks are directly executed in database, and need the support of efficient storage structure. The existing storage decision methods are mainly oriented to common workloads and rely on the decision of experienced DBAs, which has low efficiency and high risk of error. Thus, an automated storage structure decision method for in-database machine learning is urgently needed. We propose a cost-based lightweight row-column storage automatic decision system. To the best of our knowledge, this is the first storage structure selection for machine learning tasks. Extensive experiments show that the accuracy of the storage structure above 90%, shorten the task execution time by about 85%, and greatly reduce the risk of decision error.

KW - AI for DB

KW - Data partition

KW - Row and column storage

UR - https://www.scopus.com/pages/publications/85121927547

U2 - 10.1007/978-3-030-90888-1_10

DO - 10.1007/978-3-030-90888-1_10

M3 - 会议稿件

AN - SCOPUS:85121927547

SN - 9783030908874

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 119

EP - 126

BT - Web Information Systems Engineering - WISE 2021 - 22nd International Conference on Web Information Systems Engineering, WISE 2021, Proceedings

A2 - Zhang, Wenjie

A2 - Zou, Lei

A2 - Maamar, Zakaria

A2 - Chen, Lu

PB - Springer Science and Business Media Deutschland GmbH

T2 - 22nd International Conference on Web Information Systems Engineering, WISE 2021

Y2 - 26 October 2021 through 29 October 2021

ER -

Cui S, Wang H, Gu H, Xie Y. Cost-Based Lightweight Storage Automatic Decision for In-Database Machine Learning. In Zhang W, Zou L, Maamar Z, Chen L, editors, Web Information Systems Engineering - WISE 2021 - 22nd International Conference on Web Information Systems Engineering, WISE 2021, Proceedings. Springer Science and Business Media Deutschland GmbH. 2021. p. 119-126. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-90888-1_10

Cost-Based Lightweight Storage Automatic Decision for In-Database Machine Learning

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this