README_CN.md 5.8 KB
Newer Older
K
KernelMaker 已提交
1
# Pika
S
SongZhao 已提交
2
## 简介 [English](https://github.com/Qihoo360/pika/blob/master/README.md)
S
SongZhao 已提交
3
Pika是一个可持久化的大容量redis存储服务,兼容string、hash、list、zset、set的绝大接口([兼容详情](https://github.com/Qihoo360/pika/wiki/pika-支持的redis接口及兼容情况)),解决redis由于存储数据量巨大而导致内存不够用的容量瓶颈,并且可以像redis一样,通过slaveof命令进行主从备份,支持全同步和部分同步,pika还可以用在twemproxy或者codis中来实现静态数据分片(pika已经可以支持codis的动态迁移slot功能,目前在合并到master分支,欢迎使用,感谢作者[left2right](https://github.com/left2right)同学提交pr)
L
Leviathan 已提交
4 5

## Pika用户
S
SongZhao 已提交
6 7 8 9 10 11 12 13

<img src="http://i.imgur.com/dcHpCm4.png" height = "100" width = "120" alt="Qihoo">
<img src="http://i.imgur.com/jjZczkN.png" height = "100" width = "120" alt="Weibo">
<img src="http://i.imgur.com/zoel46r.gif" height = "100" width = "120" alt="Garena">
<img src="http://i.imgur.com/kHqACbn.png" height = "100" width = "120" alt="Apus">
<img src="http://i.imgur.com/2c57z8U.png" height = "100" width = "120" alt="Ffan">

<img src="http://i.imgur.com/rUiO5VU.png" height = "100" width = "120" alt="Meituan">
S
SongZhao 已提交
14
<img src="http://i.imgur.com/px5mEuW.png" height = "100" width = "120" alt="XES">
S
SongZhao 已提交
15
<img src="http://imgur.com/yJe4FP8.png" height = "100" width = "120" alt="HX">
B
baotiao 已提交
16
<img src="http://i.imgur.com/o8ZDXCH.png" height = "100" width = "120" alt="XL">
S
SongZhao 已提交
17
<img src="http://imgur.com/w3qNQ9T.png" height = "100" width = "120" alt="GWD">
S
SongZhao 已提交
18

S
SongZhao 已提交
19 20 21
<img src="http://i.imgur.com/Ll6SifR.png" height = "100" width = "120" alt="DYD">
<img src="http://i.imgur.com/vJbAfri.png" height = "100" width = "120" alt="YM">

S
SongZhao 已提交
22 23 24

[更多](https://github.com/Qihoo360/pika/blob/master/USERS.md)

K
KernelMaker 已提交
25 26 27 28
## 特点
* 容量大,支持百G数据量的存储
* 兼容redis,不用修改代码即可平滑从redis迁移到pika
* 支持主从(slaveof)
S
SongZhao 已提交
29
* 完善的[运维](https://github.com/Qihoo360/pika/wiki/pika的一些管理命令方式说明)命令
K
KernelMaker 已提交
30

B
baotiao 已提交
31 32 33 34 35

## 快速试用
  如果想快速试用pika,目前提供了Centos5,Centos6的binary版本,可以在[release页面](https://github.com/Qihoo360/pika/releases)看到,具体文件是pikaX.Y.Z_centosK_bin.tar.gz。

```
S
SongZhao 已提交
36
# 1. 解压文件
B
baotiao 已提交
37
tar zxf pikaX.Y.Z_centosK_bin.tar.gz
S
SongZhao 已提交
38
# 2. 切到output目录(rpath是./lib)
B
baotiao 已提交
39
cd output
S
SongZhao 已提交
40
# 3. 运行pika:
B
baotiao 已提交
41 42 43
./bin/pika -c conf/pika.conf
```

K
KernelMaker 已提交
44
## 编译安装
W
wuxiaofei-xy 已提交
45 46 47 48

1.在编译机上安装snappy-devel bz2 libzip-dev libsnappy-dev libprotobuf-dev libevent-dev protobuf-compiler libgoogle-glog-dev protobuf-devel libevent-devel bzip2-devel l ibbz2-dev zlib-devel等。CentOS系统可以用yum安装,Ubuntu可以用apt-get安装。如是CentOS系统,执行如下命令:

```
J
JacketWoo 已提交
49
    yum install snappy-devel bz2 libzip-dev libsnappy-dev libprotobuf-dev libevent-dev protobuf-compiler libgoogle-glog-dev protobuf-devel libevent-devel bzip2-    devel libbz2-dev zlib-devel
W
wuxiaofei-xy 已提交
50 51 52 53
```

2.安装g++(若没有安装), 在CentOS上执行如下命令:

K
KernelMaker 已提交
54
```
W
wuxiaofei-xy 已提交
55
    yum install gcc-c++
K
KernelMaker 已提交
56 57
```

S
SongZhao 已提交
58
3.把gcc版本临时切换到4.8(若已是,则忽略), 在CentOs上执行如下命令:
W
wuxiaofei-xy 已提交
59 60

```
S
SongZhao 已提交
61 62 63 64
	a. sudo rpm --import http://ftp.scientificlinux.org/linux/scientific/5x/x86_64/RPM-GPG-KEYs/RPM-GPG-KEY-cern
	b. sudo wget http://people.centos.org/tru/devtools-2/devtools-2.repo -O /etc/yum.repos.d/devtools-2.repo
	c. sudo yum install -y devtoolset-2-gcc devtoolset-2-binutils devtoolset-2-gcc-c++
	d. scl enable devtoolset-2 bash
W
wuxiaofei-xy 已提交
65 66 67 68
```
4.获取源代码

```
S
SongZhao 已提交
69
	git clone --recursive https://github.com/Qihoo360/pika.git && cd pika
W
wuxiaofei-xy 已提交
70 71
```

S
SongZhao 已提交
72
5.编译
W
wuxiaofei-xy 已提交
73 74 75 76 77 78

```
	make __REL=1
```
若编译过程中,提示有依赖的库没有安装,则有提示安装后再重新编译

K
KernelMaker 已提交
79 80
## 使用
```
J
JacketWoo 已提交
81
	./output/bin/pika -c ./conf/pika.conf
K
KernelMaker 已提交
82
```
W
wuxiaofei-xy 已提交
83 84 85 86 87 88 89 90
若启动失败,把./lib/_VERSION/的内容拷贝到Makefile定义的rpath目录下,然后重新启动

```
	cp PIKA_SOURCE/lib/_VERSION/* RPATH
```
PIKA_SOURCE表示的pika的源代码根目录;
_VERSION表示的是编译机的CenOS版本,如6.2, 5.4...
RPATH在Makefile定义,表示的是程序运行的库预先加载路径
K
KernelMaker 已提交
91

Z
zhaoanan 已提交
92

K
KernelMaker 已提交
93
## 性能
S
SongZhao 已提交
94

L
Leviathan 已提交
95
### 测试环境:
K
KernelMaker 已提交
96
```
S
SongZhao 已提交
97
	相同配置服务端、客户机各一台:
K
KernelMaker 已提交
98 99 100 101 102
	处理器:24核 Intel(R) Xeon(R) CPU E5-2630 v2 @ 2.60GHz
	内存:165157944 kB
	操作系统:CentOS release 6.2 (Final)
	网卡:Intel Corporation I350 Gigabit Network Connection
```
L
Leviathan 已提交
103
### 测试接口:
S
SongZhao 已提交
104 105 106 107
```
	Set、Get
```

L
Leviathan 已提交
108
### 测试方法:
S
SongZhao 已提交
109 110 111 112 113
```
	pika配16个worker,客户机执行 ./redis-benchmark -h ... -p ... -n 1000000000 -t set,get -r 10000000000 -c 120 -d 200
	通过set和get接口对pika进行10亿次写入+10亿次读取
```

L
Leviathan 已提交
114
### 测试结果:
S
SongZhao 已提交
115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150
```
    Set
    1000000000 requests completed in 11890.80 seconds
    18.09% <= 1 milliseconds
    93.32% <= 2 milliseconds
    99.71% <= 3 milliseconds
    99.86% <= 4 milliseconds
    99.92% <= 5 milliseconds
    99.94% <= 6 milliseconds
    99.96% <= 7 milliseconds
    99.97% <= 8 milliseconds
    99.97% <= 9 milliseconds
    99.98% <= 10 milliseconds
    99.98% <= 11 milliseconds
    99.99% <= 12 milliseconds
    ...
    100.00% <= 19 milliseconds
    ...
    100.00% <= 137 milliseconds

    84098.66 requests per second
```

```
    Get
    1000000000 requests completed in 9063.05 seconds
    84.97% <= 1 milliseconds
    99.76% <= 2 milliseconds
    99.99% <= 3 milliseconds
    100.00% <= 4 milliseconds
    ...
    100.00% <= 33 milliseconds

    110338.10 requests per second
```

L
Leviathan 已提交
151
### 与SSDB性能对比([详情](https://github.com/Qihoo360/pika/wiki/pika-vs-ssdb))
S
SongZhao 已提交
152 153
<img src="http://imgur.com/rGMZmpD.png" height = "400" width = "480" alt="1">
<img src="http://imgur.com/gnwMDof.png" height = "400" width = "480" alt="10">
S
SongZhao 已提交
154

L
Leviathan 已提交
155
### 与Redis性能对比
S
SongZhao 已提交
156 157
<img src="http://imgur.com/k99VyFN.png" height = "400" width = "600" alt="2">

K
KernelMaker 已提交
158
## 文档
S
SongZhao 已提交
159
1. [Wiki] (https://github.com/Qihoo360/pika/wiki)
K
KernelMaker 已提交
160 161

## 联系方式
Z
Zongzhi Chen 已提交
162
邮箱:g-infra-bada@360.cn
S
SongZhao 已提交
163 164

QQ群:294254078