Skip to main navigation Skip to search Skip to main content

Austere flash caching with deduplication and compression

  • Qiuping Wang
  • , Jinhong Li
  • , Wen Xia*
  • , Erik Kruus
  • , Biplob Debnath
  • , Patrick P.C. Lee
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Modern storage systems leverage flash caching to boost I/O performance, and enhancing the space efficiency and endurance of flash caching remains a critical yet challenging issue in the face of ever-growing data-intensive workloads. Deduplication and compression are promising data reduction techniques for storage and I/O savings via the removal of duplicate content, yet they also incur substantial memory overhead for index management. We propose AustereCache, a new flash caching design that aims for memory-efficient indexing, while preserving the data reduction benefits of deduplication and compression. AustereCache emphasizes austere cache management and proposes different core techniques for efficient data organization and cache replacement, so as to eliminate as much indexing metadata as possible and make lightweight in-memory index structures viable. Trace-driven experiments show that our AustereCache prototype saves 69.9-97.0% of memory usage compared to the state-of-the-art flash caching design that supports deduplication and compression, while maintaining comparable read hit ratios and write reduction ratios and achieving high I/O throughput.

Original languageEnglish
Title of host publicationProceedings of the 2020 USENIX Annual Technical Conference, ATC 2020
PublisherUSENIX Association
Pages713-726
Number of pages14
ISBN (Electronic)9781939133144
StatePublished - 2020
Externally publishedYes
Event2020 USENIX Annual Technical Conference, ATC 2020 - Virtual, Online
Duration: 15 Jul 202017 Jul 2020

Publication series

NameProceedings of the 2020 USENIX Annual Technical Conference, ATC 2020

Conference

Conference2020 USENIX Annual Technical Conference, ATC 2020
CityVirtual, Online
Period15/07/2017/07/20

Fingerprint

Dive into the research topics of 'Austere flash caching with deduplication and compression'. Together they form a unique fingerprint.

Cite this