OpenKV: LSM-tree-based key-value store for open-channel SSD

Log-structured merge (LSM) tree-based key-value stores, such as LevelDB and RocksDB, have seen great adoption in industry due to their high write speed. However, one major issue with LSM-based databases is the high write amplification. The root cause of this problem is the LSM tree structure that demands each level to be completely sorted. In this work, we propose OpenKV, a novel key-value store for open-channel SSD that achieves very low write amplification with good read performance. We propose a design with partially sorted levels with lazy compaction to reduce write amplification, and we have designed a central lookup table based on the cuckoo filter to utilize the open-channel SSD's direct page-level access. In our evaluation we show that compared to LevelDB, our design can reduce write traffic by 2.6x to 3.5x while improving random read performance by up to 1.8x.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Electrical & Computer Engr

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2020

Author dc:creator

• Wang, Xiaohao

Contributors dc:contributor

• Huang, Jian

• Key-Value Store, Cuckoo Filter, Open-Channel SSD

Statement dc:rights

• Copyright 2019 Xiaohao Wang

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/106349

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/106349