README_CN.md 6.3 KB
Newer Older
K
KernelMaker 已提交
1
# Pika
S
SongZhao 已提交
2
## 简介 [English](https://github.com/Qihoo360/pika/blob/master/README.md)
S
SongZhao 已提交
3
Pika是一个可持久化的大容量redis存储服务,兼容string、hash、list、zset、set的绝大接口([兼容详情](https://github.com/Qihoo360/pika/wiki/pika-支持的redis接口及兼容情况)),解决redis由于存储数据量巨大而导致内存不够用的容量瓶颈,并且可以像redis一样,通过slaveof命令进行主从备份,支持全同步和部分同步,pika还可以用在twemproxy或者codis中来实现静态数据分片(pika已经可以支持codis的动态迁移slot功能,目前在合并到master分支,欢迎使用,感谢作者[left2right](https://github.com/left2right)同学提交pr)
L
Leviathan 已提交
4 5

## Pika用户
S
SongZhao 已提交
6

G
Gao Dunqiao 已提交
7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
<table>
<tr>
<td height = "100" width = "150"><img src="http://i.imgur.com/dcHpCm4.png" alt="Qihoo"></td>
<td height = "100" width = "150"><img src="http://i.imgur.com/jjZczkN.png" alt="Weibo"></td>
<td height = "100" width = "150"><img src="http://i.imgur.com/zoel46r.gif" alt="Garena"></td>
<td height = "100" width = "150"><img src="http://i.imgur.com/kHqACbn.png" alt="Apus"></td>
</tr>
<tr>
<td height = "100" width = "150"><img src="http://i.imgur.com/2c57z8U.png" alt="Ffan"></td>
<td height = "100" width = "150"><img src="http://i.imgur.com/rUiO5VU.png" alt="Meituan"></td>
<td height = "100" width = "150"><img src="http://i.imgur.com/px5mEuW.png" alt="XES"></td>
<td height = "100" width = "150"><img src="http://imgur.com/yJe4FP8.png" alt="HX"></td>
</tr>
<tr>
<td height = "100" width = "150"><img src="http://i.imgur.com/o8ZDXCH.png" alt="XL"></td>
<td height = "100" width = "150"><img src="http://imgur.com/w3qNQ9T.png" alt="GWD"></td>
<td height = "100" width = "150"><img src="http://i.imgur.com/Ll6SifR.png" alt="DYD"></td>
<td height = "100" width = "150"><img src="http://i.imgur.com/vJbAfri.png" alt="YM"></td>
</tr>
<tr>
<td height = "100" width = "150"><img src="http://i.imgur.com/aNxzwsY.png" alt="XM"></td>
<td height = "100" width = "150"><img src="http://i.imgur.com/mrWxwkF.png" alt="XL"></td>
</tr>
</table>
S
SongZhao 已提交
31

S
SongZhao 已提交
32 33 34

[更多](https://github.com/Qihoo360/pika/blob/master/USERS.md)

K
KernelMaker 已提交
35 36 37 38
## 特点
* 容量大,支持百G数据量的存储
* 兼容redis,不用修改代码即可平滑从redis迁移到pika
* 支持主从(slaveof)
S
SongZhao 已提交
39
* 完善的[运维](https://github.com/Qihoo360/pika/wiki/pika的一些管理命令方式说明)命令
K
KernelMaker 已提交
40

B
baotiao 已提交
41 42 43 44 45

## 快速试用
  如果想快速试用pika,目前提供了Centos5,Centos6的binary版本,可以在[release页面](https://github.com/Qihoo360/pika/releases)看到,具体文件是pikaX.Y.Z_centosK_bin.tar.gz。

```
S
SongZhao 已提交
46
# 1. 解压文件
B
baotiao 已提交
47
tar zxf pikaX.Y.Z_centosK_bin.tar.gz
S
SongZhao 已提交
48
# 2. 切到output目录(rpath是./lib)
B
baotiao 已提交
49
cd output
S
SongZhao 已提交
50
# 3. 运行pika:
B
baotiao 已提交
51 52 53
./bin/pika -c conf/pika.conf
```

K
KernelMaker 已提交
54
## 编译安装
W
wuxiaofei-xy 已提交
55 56 57 58

1.在编译机上安装snappy-devel bz2 libzip-dev libsnappy-dev libprotobuf-dev libevent-dev protobuf-compiler libgoogle-glog-dev protobuf-devel libevent-devel bzip2-devel l ibbz2-dev zlib-devel等。CentOS系统可以用yum安装,Ubuntu可以用apt-get安装。如是CentOS系统,执行如下命令:

```
S
SongZhao 已提交
59
    yum install snappy-devel bz2 libzip-dev libsnappy-dev libprotobuf-dev libevent-dev protobuf-compiler libgoogle-glog-dev protobuf-devel libevent-devel bzip2-devel libbz2-dev zlib-devel
W
wuxiaofei-xy 已提交
60 61 62 63
```

2.安装g++(若没有安装), 在CentOS上执行如下命令:

K
KernelMaker 已提交
64
```
W
wuxiaofei-xy 已提交
65
    yum install gcc-c++
K
KernelMaker 已提交
66 67
```

S
SongZhao 已提交
68
3.把gcc版本临时切换到4.8(若已是,则忽略), 在CentOs上执行如下命令:
W
wuxiaofei-xy 已提交
69 70

```
S
SongZhao 已提交
71 72 73
	a. sudo wget http://people.centos.org/tru/devtools-2/devtools-2.repo -O /etc/yum.repos.d/devtools-2.repo
	b. sudo yum install -y devtoolset-2-gcc devtoolset-2-binutils devtoolset-2-gcc-c++
	c. scl enable devtoolset-2 bash
W
wuxiaofei-xy 已提交
74 75 76 77
```
4.获取源代码

```
S
SongZhao 已提交
78
	git clone --recursive https://github.com/Qihoo360/pika.git && cd pika
W
wuxiaofei-xy 已提交
79
```
S
SongZhao 已提交
80
5.切换到最新release版本
W
wuxiaofei-xy 已提交
81

S
SongZhao 已提交
82 83 84 85 86 87 88
```
	a. 执行 git tag 查看最新的release tag,(如 v2.2.3)
	b. 执行 git checkout TAG切换到最新版本,(如 git checkout v2.2.3)
	c. 执行 git submodule update更新依赖
```

6.编译
W
wuxiaofei-xy 已提交
89 90 91 92 93 94

```
	make __REL=1
```
若编译过程中,提示有依赖的库没有安装,则有提示安装后再重新编译

S
SongZhao 已提交
95 96
**注:我们推荐使用TCMalloc来进行内存管理**

K
KernelMaker 已提交
97 98
## 使用
```
J
JacketWoo 已提交
99
	./output/bin/pika -c ./conf/pika.conf
K
KernelMaker 已提交
100
```
W
wuxiaofei-xy 已提交
101 102 103 104 105 106 107 108
若启动失败,把./lib/_VERSION/的内容拷贝到Makefile定义的rpath目录下,然后重新启动

```
	cp PIKA_SOURCE/lib/_VERSION/* RPATH
```
PIKA_SOURCE表示的pika的源代码根目录;
_VERSION表示的是编译机的CenOS版本,如6.2, 5.4...
RPATH在Makefile定义,表示的是程序运行的库预先加载路径
K
KernelMaker 已提交
109

Z
zhaoanan 已提交
110

K
KernelMaker 已提交
111
## 性能
S
SongZhao 已提交
112

L
Leviathan 已提交
113
### 测试环境:
K
KernelMaker 已提交
114
```
S
SongZhao 已提交
115
	相同配置服务端、客户机各一台:
K
KernelMaker 已提交
116 117 118 119 120
	处理器:24核 Intel(R) Xeon(R) CPU E5-2630 v2 @ 2.60GHz
	内存:165157944 kB
	操作系统:CentOS release 6.2 (Final)
	网卡:Intel Corporation I350 Gigabit Network Connection
```
L
Leviathan 已提交
121
### 测试接口:
S
SongZhao 已提交
122 123 124 125
```
	Set、Get
```

L
Leviathan 已提交
126
### 测试方法:
S
SongZhao 已提交
127 128 129 130 131
```
	pika配16个worker,客户机执行 ./redis-benchmark -h ... -p ... -n 1000000000 -t set,get -r 10000000000 -c 120 -d 200
	通过set和get接口对pika进行10亿次写入+10亿次读取
```

L
Leviathan 已提交
132
### 测试结果:
S
SongZhao 已提交
133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168
```
    Set
    1000000000 requests completed in 11890.80 seconds
    18.09% <= 1 milliseconds
    93.32% <= 2 milliseconds
    99.71% <= 3 milliseconds
    99.86% <= 4 milliseconds
    99.92% <= 5 milliseconds
    99.94% <= 6 milliseconds
    99.96% <= 7 milliseconds
    99.97% <= 8 milliseconds
    99.97% <= 9 milliseconds
    99.98% <= 10 milliseconds
    99.98% <= 11 milliseconds
    99.99% <= 12 milliseconds
    ...
    100.00% <= 19 milliseconds
    ...
    100.00% <= 137 milliseconds

    84098.66 requests per second
```

```
    Get
    1000000000 requests completed in 9063.05 seconds
    84.97% <= 1 milliseconds
    99.76% <= 2 milliseconds
    99.99% <= 3 milliseconds
    100.00% <= 4 milliseconds
    ...
    100.00% <= 33 milliseconds

    110338.10 requests per second
```

L
Leviathan 已提交
169
### 与SSDB性能对比([详情](https://github.com/Qihoo360/pika/wiki/pika-vs-ssdb))
S
SongZhao 已提交
170 171
<img src="http://imgur.com/rGMZmpD.png" height = "400" width = "480" alt="1">
<img src="http://imgur.com/gnwMDof.png" height = "400" width = "480" alt="10">
S
SongZhao 已提交
172

L
Leviathan 已提交
173
### 与Redis性能对比
S
SongZhao 已提交
174 175
<img src="http://imgur.com/k99VyFN.png" height = "400" width = "600" alt="2">

K
KernelMaker 已提交
176
## 文档
S
SongZhao 已提交
177
1. [Wiki] (https://github.com/Qihoo360/pika/wiki)
K
KernelMaker 已提交
178 179

## 联系方式
Z
Zongzhi Chen 已提交
180
邮箱:g-infra-bada@360.cn
S
SongZhao 已提交
181 182

QQ群:294254078