Skip to main navigation Skip to search Skip to main content

An access prefetching strategy for accessing small files based on SWifT

  • Dongjie Zhu*
  • , Haiwen Du
  • , Xueming Qiao
  • , Chenglin Liu
  • , Liang Kong
  • , Aiguo Li
  • , Zhongchuan Fu
  • *Corresponding author for this work
  • Harbin Institute of Technology Weihai
  • WeiHai Power Supply Company

Research output: Contribution to journalConference articlepeer-review

Abstract

With the burst of Internet data, the real-time storage efficiency of massive small files has become a challenge for the cloud storage industry. Compared with large files, real-time access to massive small files can put tremendous pressure on file systems. Most distributed storage systems focus on large files in terms of network communication, metadata access and data layout, which affect the IOPS performance of massive small files. In this paper, aiming at the shortcomings of current distributed storage systems in file relevancy assessment, this paper proposes a new object relevance assessment method based on the relevance measure of object access timing and attribute semantics. We firstly introduced the present research on data prefetching and relevance analyzing. Then, we define files relevance and analyze the influencing factors on relevance of files. File prefetching model is constructed by assessing the relevance of the files. At last, the validity of the proposed strategy is verified through experimental tests.

Original languageEnglish
Pages (from-to)816-824
Number of pages9
JournalProcedia Computer Science
Volume131
DOIs
StatePublished - 2018
Event8th International Congress of Information and Communication Technology, ICICT 2018 - Xiamen, China
Duration: 27 Jan 201828 Jan 2018

Keywords

  • Distributed file system
  • File merging
  • Massive small files
  • Prefetching technology

Fingerprint

Dive into the research topics of 'An access prefetching strategy for accessing small files based on SWifT'. Together they form a unique fingerprint.

Cite this