README.md

Prepare

download model and extract

wget https://paddle-inference-dist.cdn.bcebos.com/PaddleLite/models_and_data_for_unittests/ernie.tar.gz
tar zxvf ernie.tar.gz

convert model

python3 -m paddle_serving_client.convert --dirname ernie

or, you can get the serving saved model directly

wget https://paddle-serving.bj.bcebos.com/models/xpu/ernie.tar.gz
tar zxvf ernie.tar.gz 

Getting Dict and Sample Dataset

sh get_data.sh

this script will download Chinese Dictionary File vocab.txt and Chinese Sample Data data-c.txt

RPC Service

Start Service

python3 -m paddle_serving_server.serve --model serving_server --port 7704 --use_lite --use_xpu --ir_optim

Client Prediction

head data-c.txt | python3 ernie_client.py --model serving_client/serving_client_conf.prototxt