@@ -8,34 +8,45 @@ There are two examples on CTR under python / examples, they are criteo_ctr, crit
...
@@ -8,34 +8,45 @@ There are two examples on CTR under python / examples, they are criteo_ctr, crit
The local mode of Cube is different from distributed Cube, which is designed to be convenient for developers to use in experiments and demos. If there is a demand for distributed sparse parameter service, please continue reading [Distributed Cube Usage Guide] (Distributed Cube) after reading this document (still developing).
The local mode of Cube is different from distributed Cube, which is designed to be convenient for developers to use in experiments and demos. If there is a demand for distributed sparse parameter service, please continue reading [Distributed Cube Usage Guide] (Distributed Cube) after reading this document (still developing).
# Example
## Example
in directory python/example/criteo_ctr_with_cube, run
in directory python/example/criteo_ctr_with_cube, run
```
```
python local_train.py # train model
python local_train.py # train model
cp ../../../build_server/core/predictor/seq_generator seq_generator # copy the sequence file generator
you will convert the Sparse Parameters from trained model to the Cube Server.
you will convert the Sparse Parameters from trained model to the Cube Server.
# Components of Cube
## Components of Cube
### cube-builder
## cube-builder
cube-builder is a tool for generating model shard files and version management. As the cube is used for distributed sparse parameter services, for each node in the distribution, different shards need to be loaded. However, the generated sparse parameter file is often a large file, and it needs to be divided into different shards by a hash function. At the same time, industrial-level scenarios need to support regular model distribution and streaming training, so it is very important for the version management of the model. This is also the missing part when training and saving the model. Therefore, while the cube-builder generates the shards, You can also manually specify version information.
cube-builder is a tool for generating model shard files and version management. As the cube is used for distributed sparse parameter services, for each node in the distribution, different shards need to be loaded. However, the generated sparse parameter file is often a large file, and it needs to be divided into different shards by a hash function. At the same time, industrial-level scenarios need to support regular model distribution and streaming training, so it is very important for the version management of the model. This is also the missing part when training and saving the model. Therefore, while the cube-builder generates the shards, You can also manually specify version information.
## cube-server
### cube-server
The cube-server is the sparse parameter server itself. It provides high-performance distributed query service through brpc, and makes remote calls through RestAPI.
The cube-server is the sparse parameter server itself. It provides high-performance distributed query service through brpc, and makes remote calls through RestAPI.
## cube-cli
### cube-cli
cube-cli is the client of cube-server. This part has been integrated into paddle serving. When we prepare the cube.conf configuration file and specify the kv_infer related op in the code of paddle serving server, cube-cli will Ready on the serving side.
cube-cli is the client of cube-server. This part has been integrated into paddle serving. When we prepare the cube.conf configuration file and specify the kv_infer related op in the code of paddle serving server, cube-cli will Ready on the serving side.
# Serving the Model Step by Step
## Serving the Model Step by Step
## Generate Sequence File from Sparse Parameter
### precondition
we need a trained model, and copy the tool kits from build_server folder.
In order to get the model parameters from the training end to the prediction end, we need to convert the trained model from the Paddle model save format to the Sequence File format.
In order to get the model parameters from the training end to the prediction end, we need to convert the trained model from the Paddle model save format to the Sequence File format.
...
@@ -43,10 +54,12 @@ In order to get the model parameters from the training end to the prediction end
...
@@ -43,10 +54,12 @@ In order to get the model parameters from the training end to the prediction end
Sequence File is a common format for the Hadoop File System. It was mentioned at the beginning of the article that distributed cubes can provide support for ultra-large-scale sparse parameter services, and large-scale sparse parameters are stored in distributed file systems in actual production environments. Hadoop File System is one of the most stable distributed open source. So the Sequence File format became the file format for the Cube loading model.
Sequence File is a common format for the Hadoop File System. It was mentioned at the beginning of the article that distributed cubes can provide support for ultra-large-scale sparse parameter services, and large-scale sparse parameters are stored in distributed file systems in actual production environments. Hadoop File System is one of the most stable distributed open source. So the Sequence File format became the file format for the Cube loading model.
The process of the cube local version is very simple, you only need to store the index files. in ./data folder where the cube binary program is located.
The process of the cube local version is very simple, you only need to store the index files. in ./data folder where the cube binary program is located.
```
```
cp ../../../build_server/output/bin/cube* ./cube
mv ./cube/data/0_0/test_dict_part0/* ./cube/data/
bash cube_prepare.sh
cd cube && ./cube &
```
```
## Cube-Client Verification
### Cube-Client Verification
this step is not necessary, but it can help you to verify if the model is ready.
this step is not necessary, but it can help you to verify if the model is ready.
If you see that each key has a corresponding value output, it means that the delivery was successful. This file can also be used by Serving to perform cube query in general kv infer op in Serving.
If you see that each key has a corresponding value output, it means that the delivery was successful. This file can also be used by Serving to perform cube query in general kv infer op in Serving.
## Appendix: Configuration
the config file is cube.config located in python/examples/criteo_ctr_with_cube/cube/conf, this file is used by cube-cli.the Cube Local Mode users do not need to understand that just use it, it would be quite important in Cube Distributed Mode.