bokket/kirsidb

Kirsidb

kirsidb's Issues

Questions about sstable

Related Code

Questions

Why construct a std::string from cur_key.data() ?

Why move std::string::data to last_key ?

The life cycle of the cur_key

Tracking issue for Todo List

Overview

Kirsidb is a skiplist key-value database using an LSM tree, developed in C++17~20 to learn the optimization of rocksdb for write amplification and read performance, and to simplify its use.

Todo List

• The compaction is used to ensure that the keys are ordered between sstables at each layer L1-L6.There is an overlap of keys between sstables.
• Non-configurable comparator. Currently the block's comparator is the one that comes with std::string_view.
• When a MemTable reaches a certain size, it is transformed into an Immutable.Immutable is an intermediate state. Write operations are handled by the new MemTable and do not block data update operations during the dumping process.
• The current skiplist implementation does not work with iterator_trait.h and needs to be refactored.(Memtable)

Why name

銀<イン> is DARKER THAN BLACK.The silver night, the heart never wavers on the water surface.

We should add commit hook for linting, formatting, and testing

Intro

We need to run clang-format, CPP Check, infer, and each function testing and Fuzzing after every commit push to whatever branch

Infer here means the meta infer, which is the static analysis tool for Meta, from their official documents, it can discover thousands of serious issues and bugs before delivery to users.

According to a paper published on PLDI 2021, the current state-of-the-art race detection is the RacerD, part of the Infer project.

How to

The open-source project won't force developers to install specific tools for such work, so we should use GitHub Action to run linting and CVE checking.

We can currently use some self-host runners to build the project and run testing in the promised time.

More Information will be added later.