Kenshin
Kenshin (るろうに剣心)
Kenshin project consists of two major components:
-
Kenshinis a fixed-size time-series database format, similar in design to Whisper, it's an alternative to Whisper for Graphite storage component. Whisper performs lots of tiny I/O operations on lots of different files, Kenshin is aiming to improve the I/O performance. For more design details please refer to design docs (Chinese) and QCon 2016 Presentation slide. -
Rurouni-cacheis a storage agent that sits in front of kenshin to batch up writes to files to make them more sequential, rurouni-cache is to kenshin as carbon-cache is to whisper.
Kenshin is developing and maintaining by Douban Inc. Currently, it is working in production environment, powering all metrics (host, service, DAE app, user defined) in douban.com.
What's the performance of Kenshin?
In our environment, after using Kenshin, the IOPS is decreased by 97.5%, and the query latency is not significantly slower than Whisper.
<img src="/img/kenshin-perf.png" width="400"/>Quick Start
We recommend using virtualenv when installing dependencies:
$ git clone https://github.com/douban/Kenshin.git
$ cd Kenshin
$ virtualenv venv
$ source venv/bin/activate
$ pip install -r requirements.txt
Tests can be run using nosetests:
$ nosetests -v
Setup configuration
$ misc/init_setup_demo.sh
Setup Kenshin
$ python setup.py build_ext --inplace && python setup.py install