README_CN.md 6.0 KB
Newer Older
K
KernelMaker 已提交
1
# Pika
S
SongZhao 已提交
2
## 简介 [English](https://github.com/Qihoo360/pika/blob/master/README.md)
S
SongZhao 已提交
3
Pika是一个可持久化的大容量redis存储服务,兼容string、hash、list、zset、set的绝大接口([兼容详情](https://github.com/Qihoo360/pika/wiki/pika-支持的redis接口及兼容情况)),解决redis由于存储数据量巨大而导致内存不够用的容量瓶颈,并且可以像redis一样,通过slaveof命令进行主从备份,支持全同步和部分同步,pika还可以用在twemproxy或者codis中来实现静态数据分片(pika已经可以支持codis的动态迁移slot功能,目前在合并到master分支,欢迎使用,感谢作者[left2right](https://github.com/left2right)同学提交pr)
L
Leviathan 已提交
4 5

## Pika用户
S
SongZhao 已提交
6

L
Leviathan 已提交
7
<img src="http://i.imgur.com/dcHpCm4.png" height = "100" width = "120" alt="Qihoo"> <img src="http://i.imgur.com/jjZczkN.png" height = "100" width = "120" alt="Weibo"> <img src="http://i.imgur.com/zoel46r.gif" height = "100" width = "120" alt="Garena"> <img src="http://i.imgur.com/kHqACbn.png" height = "100" width = "120" alt="Apus"> 
S
SongZhao 已提交
8

L
Leviathan 已提交
9
<img src="http://i.imgur.com/2c57z8U.png" height = "100" width = "120" alt="Ffan"> <img src="http://i.imgur.com/rUiO5VU.png" height = "100" width = "120" alt="Meituan"> <img src="http://i.imgur.com/px5mEuW.png" height = "100" width = "120" alt="XES"><img src="http://imgur.com/yJe4FP8.png" height = "100" width = "120" alt="HX">
S
SongZhao 已提交
10

L
Leviathan 已提交
11
<img src="http://i.imgur.com/o8ZDXCH.png" height = "100" width = "120" alt="XL"><img src="http://imgur.com/w3qNQ9T.png" height = "100" width = "120" alt="GWD"><img src="http://i.imgur.com/Ll6SifR.png" height = "100" width = "120" alt="DYD"><img src="http://i.imgur.com/vJbAfri.png" height = "100" width = "120" alt="YM">
S
SongZhao 已提交
12

S
SongZhao 已提交
13
<img src="http://i.imgur.com/aNxzwsY.png" height = "100" width = "120" alt="XM"><img src="http://i.imgur.com/mrWxwkF.png" height = "100" width = "120" alt="XL">
S
SongZhao 已提交
14

S
SongZhao 已提交
15 16 17

[更多](https://github.com/Qihoo360/pika/blob/master/USERS.md)

K
KernelMaker 已提交
18 19 20 21
## 特点
* 容量大,支持百G数据量的存储
* 兼容redis,不用修改代码即可平滑从redis迁移到pika
* 支持主从(slaveof)
S
SongZhao 已提交
22
* 完善的[运维](https://github.com/Qihoo360/pika/wiki/pika的一些管理命令方式说明)命令
K
KernelMaker 已提交
23

B
baotiao 已提交
24 25 26 27 28

## 快速试用
  如果想快速试用pika,目前提供了Centos5,Centos6的binary版本,可以在[release页面](https://github.com/Qihoo360/pika/releases)看到,具体文件是pikaX.Y.Z_centosK_bin.tar.gz。

```
S
SongZhao 已提交
29
# 1. 解压文件
B
baotiao 已提交
30
tar zxf pikaX.Y.Z_centosK_bin.tar.gz
S
SongZhao 已提交
31
# 2. 切到output目录(rpath是./lib)
B
baotiao 已提交
32
cd output
S
SongZhao 已提交
33
# 3. 运行pika:
B
baotiao 已提交
34 35 36
./bin/pika -c conf/pika.conf
```

K
KernelMaker 已提交
37
## 编译安装
W
wuxiaofei-xy 已提交
38 39 40 41

1.在编译机上安装snappy-devel bz2 libzip-dev libsnappy-dev libprotobuf-dev libevent-dev protobuf-compiler libgoogle-glog-dev protobuf-devel libevent-devel bzip2-devel l ibbz2-dev zlib-devel等。CentOS系统可以用yum安装,Ubuntu可以用apt-get安装。如是CentOS系统,执行如下命令:

```
S
SongZhao 已提交
42
    yum install snappy-devel bz2 libzip-dev libsnappy-dev libprotobuf-dev libevent-dev protobuf-compiler libgoogle-glog-dev protobuf-devel libevent-devel bzip2-devel libbz2-dev zlib-devel
W
wuxiaofei-xy 已提交
43 44 45 46
```

2.安装g++(若没有安装), 在CentOS上执行如下命令:

K
KernelMaker 已提交
47
```
W
wuxiaofei-xy 已提交
48
    yum install gcc-c++
K
KernelMaker 已提交
49 50
```

S
SongZhao 已提交
51
3.把gcc版本临时切换到4.8(若已是,则忽略), 在CentOs上执行如下命令:
W
wuxiaofei-xy 已提交
52 53

```
S
SongZhao 已提交
54 55 56 57
	a. sudo rpm --import http://ftp.scientificlinux.org/linux/scientific/5x/x86_64/RPM-GPG-KEYs/RPM-GPG-KEY-cern
	b. sudo wget http://people.centos.org/tru/devtools-2/devtools-2.repo -O /etc/yum.repos.d/devtools-2.repo
	c. sudo yum install -y devtoolset-2-gcc devtoolset-2-binutils devtoolset-2-gcc-c++
	d. scl enable devtoolset-2 bash
W
wuxiaofei-xy 已提交
58 59 60 61
```
4.获取源代码

```
S
SongZhao 已提交
62
	git clone --recursive https://github.com/Qihoo360/pika.git && cd pika
W
wuxiaofei-xy 已提交
63 64
```

S
SongZhao 已提交
65
5.编译
W
wuxiaofei-xy 已提交
66 67 68 69 70 71

```
	make __REL=1
```
若编译过程中,提示有依赖的库没有安装,则有提示安装后再重新编译

S
SongZhao 已提交
72 73
**注:我们推荐使用TCMalloc来进行内存管理**

K
KernelMaker 已提交
74 75
## 使用
```
J
JacketWoo 已提交
76
	./output/bin/pika -c ./conf/pika.conf
K
KernelMaker 已提交
77
```
W
wuxiaofei-xy 已提交
78 79 80 81 82 83 84 85
若启动失败,把./lib/_VERSION/的内容拷贝到Makefile定义的rpath目录下,然后重新启动

```
	cp PIKA_SOURCE/lib/_VERSION/* RPATH
```
PIKA_SOURCE表示的pika的源代码根目录;
_VERSION表示的是编译机的CenOS版本,如6.2, 5.4...
RPATH在Makefile定义,表示的是程序运行的库预先加载路径
K
KernelMaker 已提交
86

Z
zhaoanan 已提交
87

K
KernelMaker 已提交
88
## 性能
S
SongZhao 已提交
89

L
Leviathan 已提交
90
### 测试环境:
K
KernelMaker 已提交
91
```
S
SongZhao 已提交
92
	相同配置服务端、客户机各一台:
K
KernelMaker 已提交
93 94 95 96 97
	处理器:24核 Intel(R) Xeon(R) CPU E5-2630 v2 @ 2.60GHz
	内存:165157944 kB
	操作系统:CentOS release 6.2 (Final)
	网卡:Intel Corporation I350 Gigabit Network Connection
```
L
Leviathan 已提交
98
### 测试接口:
S
SongZhao 已提交
99 100 101 102
```
	Set、Get
```

L
Leviathan 已提交
103
### 测试方法:
S
SongZhao 已提交
104 105 106 107 108
```
	pika配16个worker,客户机执行 ./redis-benchmark -h ... -p ... -n 1000000000 -t set,get -r 10000000000 -c 120 -d 200
	通过set和get接口对pika进行10亿次写入+10亿次读取
```

L
Leviathan 已提交
109
### 测试结果:
S
SongZhao 已提交
110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145
```
    Set
    1000000000 requests completed in 11890.80 seconds
    18.09% <= 1 milliseconds
    93.32% <= 2 milliseconds
    99.71% <= 3 milliseconds
    99.86% <= 4 milliseconds
    99.92% <= 5 milliseconds
    99.94% <= 6 milliseconds
    99.96% <= 7 milliseconds
    99.97% <= 8 milliseconds
    99.97% <= 9 milliseconds
    99.98% <= 10 milliseconds
    99.98% <= 11 milliseconds
    99.99% <= 12 milliseconds
    ...
    100.00% <= 19 milliseconds
    ...
    100.00% <= 137 milliseconds

    84098.66 requests per second
```

```
    Get
    1000000000 requests completed in 9063.05 seconds
    84.97% <= 1 milliseconds
    99.76% <= 2 milliseconds
    99.99% <= 3 milliseconds
    100.00% <= 4 milliseconds
    ...
    100.00% <= 33 milliseconds

    110338.10 requests per second
```

L
Leviathan 已提交
146
### 与SSDB性能对比([详情](https://github.com/Qihoo360/pika/wiki/pika-vs-ssdb))
S
SongZhao 已提交
147 148
<img src="http://imgur.com/rGMZmpD.png" height = "400" width = "480" alt="1">
<img src="http://imgur.com/gnwMDof.png" height = "400" width = "480" alt="10">
S
SongZhao 已提交
149

L
Leviathan 已提交
150
### 与Redis性能对比
S
SongZhao 已提交
151 152
<img src="http://imgur.com/k99VyFN.png" height = "400" width = "600" alt="2">

K
KernelMaker 已提交
153
## 文档
S
SongZhao 已提交
154
1. [Wiki] (https://github.com/Qihoo360/pika/wiki)
K
KernelMaker 已提交
155 156

## 联系方式
Z
Zongzhi Chen 已提交
157
邮箱:g-infra-bada@360.cn
S
SongZhao 已提交
158 159

QQ群:294254078