Skip to content

S
Serving

PaddlePaddle / Serving
10 个月 前同步成功

通知 183
Star 833
Fork 253
S
Serving

前往新版Gitcode，体验更适合开发者的 AI 搜索 >>

提交 3bc25b2a 编写于 作者: W wangjiawei04
浏览文件
操作

adapt grpc to blazeface

上级 08f5877f
展开全部 隐藏空白更改
内联 并排
Showing with 2710 addition and 0 deletion
python/examples/grpc_impl_example/blazeface/README.md 0 → 100644
浏览文件 @ 3bc25b2a
# Blazeface
## Get Model
```
python -m paddle_serving_app.package --get_model blazeface
tar -xzvf blazeface.tar.gz
```
## RPC Service
### Start Service
```
python -m paddle_serving_server.serve --model serving_server --port 9494
```
### Client Prediction
```
python test_client.py serving_client/serving_client_conf.prototxt test.jpg
```
the result is in `output` folder, including a json file and image file with bounding boxes.
python/examples/grpc_impl_example/blazeface/client.py 0 → 100644
浏览文件 @ 3bc25b2a
from paddle_serving_client import MultiLangClient as Client
from paddle_serving_app.reader import *
import sys
import numpy as np
preprocess = Sequential([
File2Image(),
Normalize([104, 117, 123], [127.502231, 127.502231, 127.502231], False)
])
postprocess = BlazeFacePostprocess("label_list.txt", "output")
client = Client()
client.connect(['127.0.0.1:9393'])
im_0 = preprocess(sys.argv[1])
tmp = Transpose((2,0,1))
im = tmp(im_0)
fetch_map = client.predict(
feed={
"image": im
},
fetch=["detection_output_0.tmp_0"], batch=True)
print(fetch_map)
fetch_map["image"] = sys.argv[1]
fetch_map["im_shape"] = im_0.shape
postprocess(fetch_map)
python/examples/grpc_impl_example/blazeface/log/serving.ERROR 0 → 120000
浏览文件 @ 3bc25b2a
serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.ERROR.20200806-145211.106942
\ No newline at end of file
python/examples/grpc_impl_example/blazeface/log/serving.INFO 0 → 120000
浏览文件 @ 3bc25b2a
serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-153718.213749
\ No newline at end of file
python/examples/grpc_impl_example/blazeface/log/serving.WARNING 0 → 120000
浏览文件 @ 3bc25b2a
serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-153718.213749
\ No newline at end of file
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.ERROR.20200806-145211.106942 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:52:11
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
E0806 14:52:11.281495 106942 server.cpp:929] Fail to listen 0.0.0.0:12005
E0806 14:52:11.286175 106942 server.cpp:95] Failed to start Paddle Inference Server
E0806 14:52:11.286290 106942 pdserving.cpp:221] Failed start server and wait!
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-145210.106942 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:52:10
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 14:52:10.966982 106942 resource.cpp:110] Successfully proc initialized mempool wrapper
I0806 14:52:10.967720 106942 infer.h:782] model_toolkit_conf.engines(0).name: general_infer_0
I0806 14:52:10.967741 106942 infer.h:74] InferEngineCreationParams: model_path = serving_server, enable_memory_optimization = 1, enable_ir_optimization = 0, static_optimization = 0, force_update_static_cache = 0
I0806 14:52:10.967803 106942 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 14:52:10.976392 106942 analysis_predictor.cc:833] MODEL VERSION: 0.0.0
I0806 14:52:10.976413 106942 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.2
I0806 14:52:10.976677 106942 analysis_predictor.cc:440] ir_optim is turned off, no IR pass will be executed
I0806 14:52:11.248062 106942 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_2 size: 384
I0806 14:52:11.248090 106942 memory_optimize_pass.cc:223] Cluster name : depthwise_conv2d_7.tmp_0 size: 384
I0806 14:52:11.248093 106942 memory_optimize_pass.cc:223] Cluster name : reshape2_2.tmp_0 size: 16
I0806 14:52:11.248097 106942 memory_optimize_pass.cc:223] Cluster name : image size: 12
I0806 14:52:11.248101 106942 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_1 size: 384
I0806 14:52:11.248106 106942 memory_optimize_pass.cc:223] Cluster name : batch_norm_30.tmp_0 size: 384
I0806 14:52:11.248109 106942 memory_optimize_pass.cc:223] Cluster name : reshape2_3.tmp_0 size: 8
I0806 14:52:11.248112 106942 memory_optimize_pass.cc:223] Cluster name : batch_norm_15.tmp_3 size: 384
I0806 14:52:11.248116 106942 memory_optimize_pass.cc:223] Cluster name : elementwise_add_6.tmp_1 size: 384
I0806 14:52:11.248121 106942 memory_optimize_pass.cc:223] Cluster name : reshape2_4.tmp_0 size: 16
I0806 14:52:11.248123 106942 memory_optimize_pass.cc:223] Cluster name : reshape2_5.tmp_0 size: 16
I0806 14:52:11.270274 106942 analysis_predictor.cc:462] ======= optimize end =======
W0806 14:52:11.271471 106942 infer.h:487] Succ load common model[0x6ccb800], path[serving_server].
W0806 14:52:11.271499 106942 infer.h:185] Succ load model_data_pathserving_server
W0806 14:52:11.271510 106942 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 14:52:11.271518 106942 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 14:52:11.271525 106942 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 14:52:11.271597 106942 kv_manager.h:70] general_infer_0:
W0806 14:52:11.271605 106942 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
I0806 14:52:11.271821 106942 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0806 14:52:11.271833 106942 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0806 14:52:11.271838 106942 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0806 14:52:11.271854 106942 dag.cpp:158] DAG: workflow1
I0806 14:52:11.271859 106942 dag.cpp:159] , Op Num: 3
I0806 14:52:11.271863 106942 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0806 14:52:11.271867 106942 dag.cpp:164] depends: 0
I0806 14:52:11.271872 106942 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0806 14:52:11.271876 106942 dag.cpp:164] depends: 1
I0806 14:52:11.271880 106942 dag.cpp:168] general_reader_0 0
I0806 14:52:11.271884 106942 dag.cpp:162] , OP-3-general_response_0-GeneralResponseOp
I0806 14:52:11.271888 106942 dag.cpp:164] depends: 1
I0806 14:52:11.271893 106942 dag.cpp:168] general_infer_0 0
I0806 14:52:11.271898 106942 dag.cpp:171]
I0806 14:52:11.271903 106942 manager.h:86] Succ init item:workflow1 from conf:workdir/workflow.prototxt, at:0!
W0806 14:52:11.271955 106942 service.cpp:49] Succ get merger: default for service: GeneralModelService
I0806 14:52:11.271973 106942 service.cpp:61] service[GeneralModelService], enable_map_request_to_workflow[0].
I0806 14:52:11.271987 106942 predictor_metric.h:170] try to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 14:52:11.272101 106942 predictor_metric.h:175] succ to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 14:52:11.272111 106942 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 14:52:11.272140 106942 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 14:52:11.272145 106942 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 14:52:11.272179 106942 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 14:52:11.272195 106942 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 14:52:11.272226 106942 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 14:52:11.272233 106942 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 14:52:11.272259 106942 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 14:52:11.272272 106942 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 14:52:11.272305 106942 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 14:52:11.272320 106942 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 14:52:11.272351 106942 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 14:52:11.272359 106942 service.cpp:126] Succ load infer_service: GeneralModelService!
I0806 14:52:11.272366 106942 manager.h:184] Succ init item:GeneralModelService from conf:workdir/infer_service.prototxt, at:0!
I0806 14:52:11.272586 107002 server.cpp:147] Entrence reload worker, interval_s: 10
I0806 14:52:11.272717 107002 server.cpp:150] Begin reload framework...
W0806 14:52:11.272738 107002 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:52:11.272770 107002 manager.h:131] Finish reload 1 workflow(s)
W0806 14:52:11.275002 107003 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.275043 107003 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.275321 107003 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:52:11.275362 107003 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:52:11.277890 107003 infer.h:524] td_core[0x7f6a04004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.277915 107003 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.277923 107003 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:52:11.277931 107003 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6a04067570
W0806 14:52:11.278015 107004 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.278060 107004 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.278085 107004 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:52:11.278110 107004 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:52:11.280226 107004 infer.h:524] td_core[0x7f69f8004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.280256 107004 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.280266 107004 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:52:11.280282 107004 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f69f8067570
W0806 14:52:11.280328 107005 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.280501 107005 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.280968 107005 memory.cpp:73] Succ thread initialize mempool wrapper
E0806 14:52:11.281495 106942 server.cpp:929] Fail to listen 0.0.0.0:12005
I0806 14:52:11.281589 107005 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
E0806 14:52:11.286175 106942 server.cpp:95] Failed to start Paddle Inference Server
E0806 14:52:11.286290 106942 pdserving.cpp:221] Failed start server and wait!
W0806 14:52:11.287925 107005 infer.h:524] td_core[0x7f69f0004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.288049 107005 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.288060 107005 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:52:11.288079 107005 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f69f0067570
W0806 14:52:11.288179 107006 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.288208 107006 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.288231 107006 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:52:11.288259 107006 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:52:11.289176 106942 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 14:52:11.289906 107006 infer.h:524] td_core[0x7f69e4004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.289921 106942 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 14:52:11.289939 107006 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.290014 106942 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-152639.78753 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 15:26:39
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 15:26:39.811251 78753 resource.cpp:110] Successfully proc initialized mempool wrapper
I0806 15:26:39.812160 78753 infer.h:782] model_toolkit_conf.engines(0).name: general_infer_0
I0806 15:26:39.812181 78753 infer.h:74] InferEngineCreationParams: model_path = serving_server, enable_memory_optimization = 1, enable_ir_optimization = 0, static_optimization = 0, force_update_static_cache = 0
I0806 15:26:39.812237 78753 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 15:26:39.821099 78753 analysis_predictor.cc:833] MODEL VERSION: 0.0.0
I0806 15:26:39.821118 78753 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.2
I0806 15:26:39.821379 78753 analysis_predictor.cc:440] ir_optim is turned off, no IR pass will be executed
I0806 15:26:40.043308 78753 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_2 size: 384
I0806 15:26:40.043332 78753 memory_optimize_pass.cc:223] Cluster name : depthwise_conv2d_7.tmp_0 size: 384
I0806 15:26:40.043337 78753 memory_optimize_pass.cc:223] Cluster name : reshape2_2.tmp_0 size: 16
I0806 15:26:40.043341 78753 memory_optimize_pass.cc:223] Cluster name : image size: 12
I0806 15:26:40.043345 78753 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_1 size: 384
I0806 15:26:40.043349 78753 memory_optimize_pass.cc:223] Cluster name : batch_norm_30.tmp_0 size: 384
I0806 15:26:40.043352 78753 memory_optimize_pass.cc:223] Cluster name : reshape2_3.tmp_0 size: 8
I0806 15:26:40.043355 78753 memory_optimize_pass.cc:223] Cluster name : batch_norm_15.tmp_3 size: 384
I0806 15:26:40.043359 78753 memory_optimize_pass.cc:223] Cluster name : elementwise_add_6.tmp_1 size: 384
I0806 15:26:40.043363 78753 memory_optimize_pass.cc:223] Cluster name : reshape2_4.tmp_0 size: 16
I0806 15:26:40.043366 78753 memory_optimize_pass.cc:223] Cluster name : reshape2_5.tmp_0 size: 16
I0806 15:26:40.065661 78753 analysis_predictor.cc:462] ======= optimize end =======
W0806 15:26:40.066874 78753 infer.h:487] Succ load common model[0x72be800], path[serving_server].
W0806 15:26:40.066896 78753 infer.h:185] Succ load model_data_pathserving_server
W0806 15:26:40.066906 78753 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 15:26:40.066913 78753 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 15:26:40.066920 78753 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 15:26:40.066992 78753 kv_manager.h:70] general_infer_0:
W0806 15:26:40.066998 78753 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
I0806 15:26:40.067216 78753 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0806 15:26:40.067226 78753 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0806 15:26:40.067230 78753 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0806 15:26:40.067245 78753 dag.cpp:158] DAG: workflow1
I0806 15:26:40.067250 78753 dag.cpp:159] , Op Num: 3
I0806 15:26:40.067253 78753 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0806 15:26:40.067257 78753 dag.cpp:164] depends: 0
I0806 15:26:40.067261 78753 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0806 15:26:40.067265 78753 dag.cpp:164] depends: 1
I0806 15:26:40.067268 78753 dag.cpp:168] general_reader_0 0
I0806 15:26:40.067272 78753 dag.cpp:162] , OP-3-general_response_0-GeneralResponseOp
I0806 15:26:40.067276 78753 dag.cpp:164] depends: 1
I0806 15:26:40.067281 78753 dag.cpp:168] general_infer_0 0
I0806 15:26:40.067284 78753 dag.cpp:171]
I0806 15:26:40.067289 78753 manager.h:86] Succ init item:workflow1 from conf:workdir/workflow.prototxt, at:0!
W0806 15:26:40.067344 78753 service.cpp:49] Succ get merger: default for service: GeneralModelService
I0806 15:26:40.067363 78753 service.cpp:61] service[GeneralModelService], enable_map_request_to_workflow[0].
I0806 15:26:40.067376 78753 predictor_metric.h:170] try to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 15:26:40.067494 78753 predictor_metric.h:175] succ to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 15:26:40.067505 78753 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 15:26:40.067533 78753 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 15:26:40.067539 78753 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 15:26:40.067566 78753 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 15:26:40.067574 78753 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 15:26:40.067598 78753 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 15:26:40.067605 78753 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 15:26:40.067631 78753 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 15:26:40.067637 78753 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 15:26:40.067662 78753 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 15:26:40.067668 78753 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 15:26:40.067695 78753 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 15:26:40.067703 78753 service.cpp:126] Succ load infer_service: GeneralModelService!
I0806 15:26:40.067719 78753 manager.h:184] Succ init item:GeneralModelService from conf:workdir/infer_service.prototxt, at:0!
I0806 15:26:40.067939 78839 server.cpp:147] Entrence reload worker, interval_s: 10
I0806 15:26:40.068127 78839 server.cpp:150] Begin reload framework...
W0806 15:26:40.068145 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:26:40.068156 78839 manager.h:131] Finish reload 1 workflow(s)
W0806 15:26:40.070395 78840 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.070421 78840 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.070459 78840 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.070503 78840 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.071964 78840 infer.h:524] td_core[0x7ff80c004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.071995 78840 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.072003 78840 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.072011 78840 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff80c067570
W0806 15:26:40.072075 78841 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.072121 78841 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.072146 78841 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.072172 78841 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.074611 78841 infer.h:524] td_core[0x7ff800004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.074635 78841 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.074642 78841 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.074651 78841 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff800067570
W0806 15:26:40.074693 78842 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.074712 78842 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.074733 78842 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.074762 78842 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.077550 78842 infer.h:524] td_core[0x7ff7f4004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.077597 78842 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.077608 78842 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.077616 78842 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7f4067570
I0806 15:26:40.077626 78753 server.cpp:1037] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is serving on port=12005.
W0806 15:26:40.077713 78843 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.077751 78843 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.077783 78843 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.077816 78843 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 15:26:40.078102 78753 server.cpp:1040] Check out http://yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com:12005 in web browser.
W0806 15:26:40.079548 78843 infer.h:524] td_core[0x7ff7ec004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.079599 78843 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.079619 78843 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.079628 78843 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7ec06b140
W0806 15:26:40.079739 78845 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.079782 78845 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.079810 78845 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.079841 78845 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.082089 78845 infer.h:524] td_core[0x7ff7e0004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.082123 78845 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.082132 78845 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.082139 78845 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7e006b140
W0806 15:26:40.082198 78846 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.082222 78846 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.082243 78846 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.082288 78846 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.084091 78846 infer.h:524] td_core[0x7ff7d4004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.084132 78846 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.084142 78846 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.084151 78846 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7d406b140
W0806 15:26:40.084208 78847 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.084230 78847 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.084256 78847 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.084278 78847 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.085944 78847 infer.h:524] td_core[0x7ff7a8004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.085985 78847 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.085994 78847 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.086004 78847 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7a806b140
W0806 15:26:40.086084 78848 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.086325 78848 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.086367 78848 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.086393 78848 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.088397 78848 infer.h:524] td_core[0x7ff79c004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.088433 78848 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.088443 78848 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.088452 78848 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff79c06b140
W0806 15:26:40.088598 78844 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.088953 78844 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.088991 78844 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.089030 78844 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.090581 78844 infer.h:524] td_core[0x7ff7d0004a20] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.090620 78844 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.090628 78844 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.090637 78844 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7d006b140
W0806 15:26:40.090682 78849 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.090716 78849 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.090740 78849 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.090770 78849 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.092309 78849 infer.h:524] td_core[0x7ff7d8004a20] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.092658 78849 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.092681 78849 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.092701 78849 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7d806b140
W0806 15:26:40.092747 78850 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.092779 78850 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.092801 78850 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.092834 78850 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.094321 78850 infer.h:524] td_core[0x7ff7c0004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.099390 78850 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.099424 78850 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.099457 78850 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7c006b140
I0806 15:26:50.068229 78839 server.cpp:150] Begin reload framework...
W0806 15:26:50.068300 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:26:50.068322 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:27:00.068401 78839 server.cpp:150] Begin reload framework...
W0806 15:27:00.068467 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:27:00.068482 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:27:10.068552 78839 server.cpp:150] Begin reload framework...
W0806 15:27:10.069015 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:27:10.069116 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:27:20.069195 78839 server.cpp:150] Begin reload framework...
W0806 15:27:20.069417 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:27:20.069811 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:27:30.069891 78839 server.cpp:150] Begin reload framework...
W0806 15:27:30.070196 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:27:30.070439 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:27:40.070523 78839 server.cpp:150] Begin reload framework...
W0806 15:27:40.070731 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:27:40.070988 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:27:50.071066 78839 server.cpp:150] Begin reload framework...
W0806 15:27:50.071149 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:27:50.071167 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:28:00.071242 78839 server.cpp:150] Begin reload framework...
W0806 15:28:00.071322 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:28:00.071339 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:28:10.071413 78839 server.cpp:150] Begin reload framework...
W0806 15:28:10.071635 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:28:10.071827 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:28:20.071903 78839 server.cpp:150] Begin reload framework...
W0806 15:28:20.072158 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:28:20.072371 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:28:30.072446 78839 server.cpp:150] Begin reload framework...
W0806 15:28:30.072932 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:28:30.073240 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:28:40.073336 78839 server.cpp:150] Begin reload framework...
W0806 15:28:40.073549 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:28:40.073745 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:28:50.073782 78839 server.cpp:150] Begin reload framework...
W0806 15:28:50.073853 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:28:50.073873 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:29:00.073943 78839 server.cpp:150] Begin reload framework...
W0806 15:29:00.074016 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:29:00.074035 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:29:10.074110 78839 server.cpp:150] Begin reload framework...
W0806 15:29:10.074385 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:29:10.074802 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:29:20.074892 78839 server.cpp:150] Begin reload framework...
W0806 15:29:20.075325 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:29:20.075563 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:29:25.879223 78753 server.cpp:1095] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is going to quit
I0806 15:29:30.075656 78839 server.cpp:162] Exit reload worker!
W0806 15:29:30.076113 78753 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 15:29:30.076478 78753 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 15:29:30.076723 78753 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-153534.188891 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 15:35:34
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 15:35:34.886662 188891 resource.cpp:110] Successfully proc initialized mempool wrapper
I0806 15:35:34.887372 188891 infer.h:782] model_toolkit_conf.engines(0).name: general_infer_0
I0806 15:35:34.887393 188891 infer.h:74] InferEngineCreationParams: model_path = serving_server, enable_memory_optimization = 1, enable_ir_optimization = 0, static_optimization = 0, force_update_static_cache = 0
I0806 15:35:34.887447 188891 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 15:35:34.896382 188891 analysis_predictor.cc:833] MODEL VERSION: 0.0.0
I0806 15:35:34.896404 188891 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.2
I0806 15:35:34.896670 188891 analysis_predictor.cc:440] ir_optim is turned off, no IR pass will be executed
I0806 15:35:35.119560 188891 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_2 size: 384
I0806 15:35:35.119586 188891 memory_optimize_pass.cc:223] Cluster name : depthwise_conv2d_7.tmp_0 size: 384
I0806 15:35:35.119591 188891 memory_optimize_pass.cc:223] Cluster name : reshape2_2.tmp_0 size: 16
I0806 15:35:35.119594 188891 memory_optimize_pass.cc:223] Cluster name : image size: 12
I0806 15:35:35.119598 188891 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_1 size: 384
I0806 15:35:35.119602 188891 memory_optimize_pass.cc:223] Cluster name : batch_norm_30.tmp_0 size: 384
I0806 15:35:35.119606 188891 memory_optimize_pass.cc:223] Cluster name : reshape2_3.tmp_0 size: 8
I0806 15:35:35.119609 188891 memory_optimize_pass.cc:223] Cluster name : batch_norm_15.tmp_3 size: 384
I0806 15:35:35.119613 188891 memory_optimize_pass.cc:223] Cluster name : elementwise_add_6.tmp_1 size: 384
I0806 15:35:35.119617 188891 memory_optimize_pass.cc:223] Cluster name : reshape2_4.tmp_0 size: 16
I0806 15:35:35.119621 188891 memory_optimize_pass.cc:223] Cluster name : reshape2_5.tmp_0 size: 16
I0806 15:35:35.141611 188891 analysis_predictor.cc:462] ======= optimize end =======
W0806 15:35:35.142822 188891 infer.h:487] Succ load common model[0x6266800], path[serving_server].
W0806 15:35:35.142841 188891 infer.h:185] Succ load model_data_pathserving_server
W0806 15:35:35.142851 188891 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 15:35:35.142858 188891 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 15:35:35.142864 188891 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 15:35:35.142933 188891 kv_manager.h:70] general_infer_0:
W0806 15:35:35.142940 188891 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
I0806 15:35:35.143143 188891 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0806 15:35:35.143153 188891 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0806 15:35:35.143158 188891 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0806 15:35:35.143172 188891 dag.cpp:158] DAG: workflow1
I0806 15:35:35.143177 188891 dag.cpp:159] , Op Num: 3
I0806 15:35:35.143182 188891 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0806 15:35:35.143185 188891 dag.cpp:164] depends: 0
I0806 15:35:35.143188 188891 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0806 15:35:35.143193 188891 dag.cpp:164] depends: 1
I0806 15:35:35.143196 188891 dag.cpp:168] general_reader_0 0
I0806 15:35:35.143200 188891 dag.cpp:162] , OP-3-general_response_0-GeneralResponseOp
I0806 15:35:35.143203 188891 dag.cpp:164] depends: 1
I0806 15:35:35.143208 188891 dag.cpp:168] general_infer_0 0
I0806 15:35:35.143211 188891 dag.cpp:171]
I0806 15:35:35.143216 188891 manager.h:86] Succ init item:workflow1 from conf:workdir/workflow.prototxt, at:0!
W0806 15:35:35.143271 188891 service.cpp:49] Succ get merger: default for service: GeneralModelService
I0806 15:35:35.143290 188891 service.cpp:61] service[GeneralModelService], enable_map_request_to_workflow[0].
I0806 15:35:35.143302 188891 predictor_metric.h:170] try to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 15:35:35.143451 188891 predictor_metric.h:175] succ to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 15:35:35.143472 188891 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 15:35:35.143501 188891 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 15:35:35.143515 188891 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 15:35:35.143553 188891 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 15:35:35.143560 188891 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 15:35:35.143594 188891 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 15:35:35.143601 188891 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 15:35:35.143628 188891 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 15:35:35.143642 188891 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 15:35:35.143668 188891 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 15:35:35.143682 188891 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 15:35:35.143710 188891 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 15:35:35.143724 188891 service.cpp:126] Succ load infer_service: GeneralModelService!
I0806 15:35:35.143733 188891 manager.h:184] Succ init item:GeneralModelService from conf:workdir/infer_service.prototxt, at:0!
I0806 15:35:35.143956 189150 server.cpp:147] Entrence reload worker, interval_s: 10
I0806 15:35:35.144258 189150 server.cpp:150] Begin reload framework...
W0806 15:35:35.144469 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:35:35.144480 189150 manager.h:131] Finish reload 1 workflow(s)
W0806 15:35:35.146505 189151 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.146545 189151 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.146737 189151 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.146781 189151 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.148248 189151 infer.h:524] td_core[0x7fade4004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.148283 189151 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.148290 189151 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.148298 189151 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fade4067570
W0806 15:35:35.148363 189153 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.148396 189153 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.148418 189153 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.148440 189153 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.149902 189153 infer.h:524] td_core[0x7fadd8004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.150717 189153 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.150882 189153 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.150892 189153 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fadd8067570
W0806 15:35:35.150938 189155 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.150974 189155 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.151016 189155 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.151093 189155 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 15:35:35.153738 188891 server.cpp:1037] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is serving on port=12005.
W0806 15:35:35.153961 189155 infer.h:524] td_core[0x7fadd0004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.154050 189155 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.154072 189155 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.154083 189155 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fadd0067570
W0806 15:35:35.154227 189156 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.154254 189156 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.154325 189156 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.154361 189156 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 15:35:35.154390 188891 server.cpp:1040] Check out http://yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com:12005 in web browser.
W0806 15:35:35.156725 189156 infer.h:524] td_core[0x7fadc4004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.156760 189156 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.156776 189156 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.156785 189156 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fadc406b140
W0806 15:35:35.157027 189157 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.157063 189157 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.157083 189157 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.157105 189157 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.159118 189157 infer.h:524] td_core[0x7fadb8004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.159153 189157 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.159162 189157 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.159170 189157 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fadb806b140
W0806 15:35:35.159222 189158 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.159246 189158 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.159302 189158 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.159337 189158 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.160917 189158 infer.h:524] td_core[0x7fad8c004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.160979 189158 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.161000 189158 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.161011 189158 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fad8c06b140
W0806 15:35:35.161080 189159 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.161113 189159 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.161147 189159 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.161185 189159 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.162650 189159 infer.h:524] td_core[0x7fadbc004a20] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.162685 189159 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.162694 189159 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.162703 189159 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fadbc06b140
W0806 15:35:35.162760 189160 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.162794 189160 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.162815 189160 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.162837 189160 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.164260 189160 infer.h:524] td_core[0x7fadb4004a20] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.164294 189160 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.164322 189160 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.164331 189160 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fadb406b140
W0806 15:35:35.164376 189161 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.164397 189161 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.164417 189161 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.164438 189161 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.165877 189161 infer.h:524] td_core[0x7fada0004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.165907 189161 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.165916 189161 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.165925 189161 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fada006b140
W0806 15:35:35.165971 189162 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.166005 189162 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.166025 189162 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.166055 189162 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.167418 189162 infer.h:524] td_core[0x7fada4004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.167449 189162 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.167469 189162 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.167479 189162 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fada406b140
W0806 15:35:35.167515 189163 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.167543 189163 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.167572 189163 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.167603 189163 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.169037 189163 infer.h:524] td_core[0x7fada8004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.169055 189163 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.169064 189163 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.169073 189163 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fada806b140
I0806 15:35:45.144551 189150 server.cpp:150] Begin reload framework...
W0806 15:35:45.144615 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:35:45.144634 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:35:55.144703 189150 server.cpp:150] Begin reload framework...
W0806 15:35:55.144759 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:35:55.144781 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:36:05.144851 189150 server.cpp:150] Begin reload framework...
W0806 15:36:05.144901 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:36:05.144917 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:36:15.144986 189150 server.cpp:150] Begin reload framework...
W0806 15:36:15.145774 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:36:15.146031 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:36:25.146126 189150 server.cpp:150] Begin reload framework...
W0806 15:36:25.146376 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:36:25.146566 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:36:35.146639 189150 server.cpp:150] Begin reload framework...
W0806 15:36:35.146873 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:36:35.146960 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:36:45.146992 189150 server.cpp:150] Begin reload framework...
W0806 15:36:45.147060 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:36:45.147079 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:36:55.147150 189150 server.cpp:150] Begin reload framework...
W0806 15:36:55.147209 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:36:55.147228 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:37:05.147296 189150 server.cpp:150] Begin reload framework...
W0806 15:37:05.147361 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:37:05.147403 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:37:15.147490 189150 server.cpp:150] Begin reload framework...
W0806 15:37:15.147891 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:37:15.148109 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:37:15.781627 188891 server.cpp:1095] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is going to quit
I0806 15:37:25.148181 189150 server.cpp:162] Exit reload worker!
W0806 15:37:25.149278 188891 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 15:37:25.149458 188891 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 15:37:25.149477 188891 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-153718.213749 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 15:37:18
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 15:37:18.051189 213749 resource.cpp:110] Successfully proc initialized mempool wrapper
I0806 15:37:18.051698 213749 infer.h:782] model_toolkit_conf.engines(0).name: general_infer_0
I0806 15:37:18.051717 213749 infer.h:74] InferEngineCreationParams: model_path = serving_server, enable_memory_optimization = 1, enable_ir_optimization = 0, static_optimization = 0, force_update_static_cache = 0
I0806 15:37:18.051777 213749 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 15:37:18.060642 213749 analysis_predictor.cc:833] MODEL VERSION: 0.0.0
I0806 15:37:18.060663 213749 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.2
I0806 15:37:18.060945 213749 analysis_predictor.cc:440] ir_optim is turned off, no IR pass will be executed
I0806 15:37:18.277473 213749 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_2 size: 384
I0806 15:37:18.277496 213749 memory_optimize_pass.cc:223] Cluster name : depthwise_conv2d_7.tmp_0 size: 384
I0806 15:37:18.277501 213749 memory_optimize_pass.cc:223] Cluster name : reshape2_2.tmp_0 size: 16
I0806 15:37:18.277505 213749 memory_optimize_pass.cc:223] Cluster name : image size: 12
I0806 15:37:18.277509 213749 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_1 size: 384
I0806 15:37:18.277513 213749 memory_optimize_pass.cc:223] Cluster name : batch_norm_30.tmp_0 size: 384
I0806 15:37:18.277516 213749 memory_optimize_pass.cc:223] Cluster name : reshape2_3.tmp_0 size: 8
I0806 15:37:18.277520 213749 memory_optimize_pass.cc:223] Cluster name : batch_norm_15.tmp_3 size: 384
I0806 15:37:18.277523 213749 memory_optimize_pass.cc:223] Cluster name : elementwise_add_6.tmp_1 size: 384
I0806 15:37:18.277527 213749 memory_optimize_pass.cc:223] Cluster name : reshape2_4.tmp_0 size: 16
I0806 15:37:18.277530 213749 memory_optimize_pass.cc:223] Cluster name : reshape2_5.tmp_0 size: 16
I0806 15:37:18.299327 213749 analysis_predictor.cc:462] ======= optimize end =======
W0806 15:37:18.300521 213749 infer.h:487] Succ load common model[0x671f800], path[serving_server].
W0806 15:37:18.300546 213749 infer.h:185] Succ load model_data_pathserving_server
W0806 15:37:18.300556 213749 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 15:37:18.300562 213749 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 15:37:18.300570 213749 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 15:37:18.300642 213749 kv_manager.h:70] general_infer_0:
W0806 15:37:18.300649 213749 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
I0806 15:37:18.300865 213749 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0806 15:37:18.300875 213749 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0806 15:37:18.300879 213749 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0806 15:37:18.300894 213749 dag.cpp:158] DAG: workflow1
I0806 15:37:18.300899 213749 dag.cpp:159] , Op Num: 3
I0806 15:37:18.300902 213749 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0806 15:37:18.300906 213749 dag.cpp:164] depends: 0
I0806 15:37:18.300910 213749 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0806 15:37:18.300913 213749 dag.cpp:164] depends: 1
I0806 15:37:18.300917 213749 dag.cpp:168] general_reader_0 0
I0806 15:37:18.300921 213749 dag.cpp:162] , OP-3-general_response_0-GeneralResponseOp
I0806 15:37:18.300925 213749 dag.cpp:164] depends: 1
I0806 15:37:18.300930 213749 dag.cpp:168] general_infer_0 0
I0806 15:37:18.300932 213749 dag.cpp:171]
I0806 15:37:18.300938 213749 manager.h:86] Succ init item:workflow1 from conf:workdir/workflow.prototxt, at:0!
W0806 15:37:18.300992 213749 service.cpp:49] Succ get merger: default for service: GeneralModelService
I0806 15:37:18.301010 213749 service.cpp:61] service[GeneralModelService], enable_map_request_to_workflow[0].
I0806 15:37:18.301023 213749 predictor_metric.h:170] try to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 15:37:18.301297 213749 predictor_metric.h:175] succ to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 15:37:18.301318 213749 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 15:37:18.301348 213749 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 15:37:18.301357 213749 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 15:37:18.301385 213749 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 15:37:18.301395 213749 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 15:37:18.301421 213749 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 15:37:18.301429 213749 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 15:37:18.301456 213749 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 15:37:18.301465 213749 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 15:37:18.301491 213749 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 15:37:18.301497 213749 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 15:37:18.301524 213749 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 15:37:18.301533 213749 service.cpp:126] Succ load infer_service: GeneralModelService!
I0806 15:37:18.301542 213749 manager.h:184] Succ init item:GeneralModelService from conf:workdir/infer_service.prototxt, at:0!
I0806 15:37:18.301775 213817 server.cpp:147] Entrence reload worker, interval_s: 10
I0806 15:37:18.302067 213817 server.cpp:150] Begin reload framework...
W0806 15:37:18.302085 213817 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:37:18.302099 213817 manager.h:131] Finish reload 1 workflow(s)
W0806 15:37:18.304368 213818 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.304457 213818 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.304514 213818 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.304553 213818 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.306993 213818 infer.h:524] td_core[0x7f6e6c004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.307034 213818 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.307044 213818 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.307054 213818 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e6c067570
W0806 15:37:18.307114 213819 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.307148 213819 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.307169 213819 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.307193 213819 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.308980 213819 infer.h:524] td_core[0x7f6e60004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.309002 213819 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.309010 213819 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.309020 213819 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e60067570
W0806 15:37:18.309060 213820 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.309077 213820 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.309096 213820 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.309680 213820 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.311779 213820 infer.h:524] td_core[0x7f6e54004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.311816 213820 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.311836 213820 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.311852 213820 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e54067570
I0806 15:37:18.311910 213749 server.cpp:1037] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is serving on port=12005.
W0806 15:37:18.311955 213821 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.312002 213821 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.312032 213821 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.312079 213821 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 15:37:18.312316 213749 server.cpp:1040] Check out http://yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com:12005 in web browser.
W0806 15:37:18.313676 213821 infer.h:524] td_core[0x7f6e4c004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.313716 213821 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.313725 213821 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.313742 213821 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e4c06b140
W0806 15:37:18.313823 213822 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.313860 213822 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.313896 213822 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.313930 213822 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.315584 213822 infer.h:524] td_core[0x7f6e40004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.315616 213822 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.315624 213822 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.315632 213822 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e4006b140
W0806 15:37:18.315724 213823 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.315748 213823 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.315805 213823 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.315858 213823 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.317441 213823 infer.h:524] td_core[0x7f6e38004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.317476 213823 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.317484 213823 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.317493 213823 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e3806b140
W0806 15:37:18.317553 213824 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.317576 213824 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.317597 213824 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.317618 213824 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.319192 213824 infer.h:524] td_core[0x7f6e0c004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.319228 213824 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.319237 213824 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.319247 213824 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e0c06b140
W0806 15:37:18.319326 213825 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.319352 213825 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.319375 213825 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.319397 213825 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.320974 213825 infer.h:524] td_core[0x7f6e00004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.320998 213825 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.321008 213825 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.321018 213825 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e0006b140
W0806 15:37:18.321060 213826 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.321091 213826 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.321113 213826 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.321135 213826 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.322616 213826 infer.h:524] td_core[0x7f6e2c004a20] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.322638 213826 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.322646 213826 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.322655 213826 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e2c06b140
W0806 15:37:18.322692 213827 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.322721 213827 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.322743 213827 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.322767 213827 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.324208 213827 infer.h:524] td_core[0x7f6e24004a20] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.324225 213827 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.324234 213827 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.324242 213827 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e2406b140
W0806 15:37:18.324287 213828 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.324309 213828 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.324332 213828 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.324353 213828 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.325800 213828 infer.h:524] td_core[0x7f6e18004a20] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.325819 213828 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.325829 213828 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.325837 213828 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e1806b140
I0806 15:37:21.712553 213823 general_model_service.pb.cc:2975] remote_side=[127.0.0.1:53476]
I0806 15:37:21.712646 213823 general_model_service.pb.cc:2976] local_side=[127.0.0.1:12005]
I0806 15:37:21.712654 213823 general_model_service.pb.cc:2977] service_name=[GeneralModelService]
I0806 15:37:21.712661 213823 general_model_service.pb.cc:2978] log_id=[0]
I0806 15:37:21.712674 213823 service.cpp:173] enable map request == False
I0806 15:37:21.717833 213823 op.cpp:159] general_reader_0_time=[4002]
I0806 15:37:22.793880 213823 op.cpp:159] general_infer_0_time=[1075995]
I0806 15:37:22.794189 213823 op.cpp:159] general_response_0_time=[47]
I0806 15:37:22.794234 213823 service.cpp:238] workflow total time: 1081558
I0806 15:37:22.794991 213823 general_model_service.pb.cc:2989] tc=[1082446]
I0806 15:37:28.302170 213817 server.cpp:150] Begin reload framework...
W0806 15:37:28.303360 213817 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:37:28.303452 213817 manager.h:131] Finish reload 1 workflow(s)
I0806 15:37:29.856223 213749 server.cpp:1095] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is going to quit
I0806 15:37:38.303527 213817 server.cpp:162] Exit reload worker!
W0806 15:37:38.303831 213749 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 15:37:38.303936 213749 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 15:37:38.303953 213749 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-143558.119594 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:35:58
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 14:35:58.982995 119594 resource.cpp:110] Successfully proc initialized mempool wrapper
W0806 14:35:59.226161 119594 infer.h:487] Succ load common model[0x73e1800], path[serving_server].
W0806 14:35:59.226184 119594 infer.h:185] Succ load model_data_pathserving_server
W0806 14:35:59.226194 119594 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 14:35:59.226202 119594 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 14:35:59.226208 119594 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 14:35:59.226281 119594 kv_manager.h:70] general_infer_0:
W0806 14:35:59.226287 119594 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
W0806 14:35:59.226617 119594 service.cpp:49] Succ get merger: default for service: GeneralModelService
W0806 14:35:59.227495 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:35:59.229777 119910 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.229818 119910 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.229908 119910 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.232357 119910 infer.h:524] td_core[0x7ff410004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.232388 119910 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.232398 119910 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.232452 119911 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.232484 119911 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.232506 119911 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.234267 119911 infer.h:524] td_core[0x7ff404004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.234309 119911 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.234318 119911 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.234372 119912 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.234406 119912 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.234468 119912 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.237015 119912 infer.h:524] td_core[0x7ff3fc004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.237056 119912 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.237073 119912 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.237166 119913 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.237293 119913 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.237341 119913 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.238987 119913 infer.h:524] td_core[0x7ff3f0004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.239040 119913 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.239051 119913 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.239130 119914 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.239158 119914 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.239181 119914 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.240805 119914 infer.h:524] td_core[0x7ff3e8004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.240855 119914 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.240876 119914 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.240947 119915 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.240974 119915 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.241281 119915 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.243010 119915 infer.h:524] td_core[0x7ff3dc004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.243083 119915 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.243093 119915 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.243155 119916 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.243180 119916 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.243204 119916 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.244889 119916 infer.h:524] td_core[0x7ff3d0004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.244930 119916 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.244951 119916 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.245100 119917 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.245141 119917 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.245163 119917 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.246835 119917 infer.h:524] td_core[0x7ff3ac004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.246866 119917 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.246876 119917 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.246949 119918 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.246975 119918 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.246999 119918 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.248579 119918 infer.h:524] td_core[0x7ff398004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.248601 119918 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.248610 119918 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.248651 119919 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.248677 119919 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.248698 119919 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.250190 119919 infer.h:524] td_core[0x7ff3cc004a20] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.250210 119919 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.250218 119919 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.250274 119920 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.250298 119920 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.250317 119920 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.251790 119920 infer.h:524] td_core[0x7ff3d4004a20] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.251823 119920 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.251832 119920 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:36:09.228847 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:36:19.229439 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:36:29.229853 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:36:39.230340 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:36:49.230597 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:36:59.230760 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:37:09.232548 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:37:19.233659 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:37:29.234233 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:37:39.235018 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:37:49.235304 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:37:59.235473 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:38:09.236246 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:38:19.237109 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:38:29.239338 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:38:39.240639 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:38:49.240865 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:38:59.241040 119909 infer.h:673] Succ reload version engine: 18446744073709551615
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-145210.106942 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:52:10
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 14:52:10.966982 106942 resource.cpp:110] Successfully proc initialized mempool wrapper
W0806 14:52:11.271471 106942 infer.h:487] Succ load common model[0x6ccb800], path[serving_server].
W0806 14:52:11.271499 106942 infer.h:185] Succ load model_data_pathserving_server
W0806 14:52:11.271510 106942 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 14:52:11.271518 106942 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 14:52:11.271525 106942 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 14:52:11.271597 106942 kv_manager.h:70] general_infer_0:
W0806 14:52:11.271605 106942 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
W0806 14:52:11.271955 106942 service.cpp:49] Succ get merger: default for service: GeneralModelService
W0806 14:52:11.272738 107002 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:52:11.275002 107003 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.275043 107003 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.275321 107003 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.277890 107003 infer.h:524] td_core[0x7f6a04004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.277915 107003 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.277923 107003 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:52:11.278015 107004 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.278060 107004 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.278085 107004 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.280226 107004 infer.h:524] td_core[0x7f69f8004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.280256 107004 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.280266 107004 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:52:11.280328 107005 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.280501 107005 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.280968 107005 memory.cpp:73] Succ thread initialize mempool wrapper
E0806 14:52:11.281495 106942 server.cpp:929] Fail to listen 0.0.0.0:12005
E0806 14:52:11.286175 106942 server.cpp:95] Failed to start Paddle Inference Server
E0806 14:52:11.286290 106942 pdserving.cpp:221] Failed start server and wait!
W0806 14:52:11.287925 107005 infer.h:524] td_core[0x7f69f0004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.288049 107005 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.288060 107005 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:52:11.288179 107006 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.288208 107006 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.288231 107006 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.289176 106942 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 14:52:11.289906 107006 infer.h:524] td_core[0x7f69e4004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.289921 106942 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 14:52:11.289939 107006 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.290014 106942 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-152639.78753 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 15:26:39
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 15:26:39.811251 78753 resource.cpp:110] Successfully proc initialized mempool wrapper
W0806 15:26:40.066874 78753 infer.h:487] Succ load common model[0x72be800], path[serving_server].
W0806 15:26:40.066896 78753 infer.h:185] Succ load model_data_pathserving_server
W0806 15:26:40.066906 78753 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 15:26:40.066913 78753 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 15:26:40.066920 78753 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 15:26:40.066992 78753 kv_manager.h:70] general_infer_0:
W0806 15:26:40.066998 78753 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
W0806 15:26:40.067344 78753 service.cpp:49] Succ get merger: default for service: GeneralModelService
W0806 15:26:40.068145 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:26:40.070395 78840 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.070421 78840 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.070459 78840 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.071964 78840 infer.h:524] td_core[0x7ff80c004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.071995 78840 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.072003 78840 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.072075 78841 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.072121 78841 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.072146 78841 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.074611 78841 infer.h:524] td_core[0x7ff800004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.074635 78841 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.074642 78841 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.074693 78842 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.074712 78842 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.074733 78842 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.077550 78842 infer.h:524] td_core[0x7ff7f4004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.077597 78842 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.077608 78842 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.077713 78843 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.077751 78843 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.077783 78843 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.079548 78843 infer.h:524] td_core[0x7ff7ec004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.079599 78843 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.079619 78843 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.079739 78845 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.079782 78845 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.079810 78845 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.082089 78845 infer.h:524] td_core[0x7ff7e0004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.082123 78845 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.082132 78845 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.082198 78846 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.082222 78846 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.082243 78846 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.084091 78846 infer.h:524] td_core[0x7ff7d4004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.084132 78846 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.084142 78846 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.084208 78847 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.084230 78847 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.084256 78847 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.085944 78847 infer.h:524] td_core[0x7ff7a8004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.085985 78847 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.085994 78847 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.086084 78848 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.086325 78848 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.086367 78848 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.088397 78848 infer.h:524] td_core[0x7ff79c004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.088433 78848 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.088443 78848 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.088598 78844 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.088953 78844 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.088991 78844 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.090581 78844 infer.h:524] td_core[0x7ff7d0004a20] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.090620 78844 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.090628 78844 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.090682 78849 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.090716 78849 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.090740 78849 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.092309 78849 infer.h:524] td_core[0x7ff7d8004a20] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.092658 78849 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.092681 78849 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.092747 78850 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.092779 78850 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.092801 78850 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.094321 78850 infer.h:524] td_core[0x7ff7c0004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.099390 78850 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.099424 78850 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:50.068300 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:27:00.068467 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:27:10.069015 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:27:20.069417 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:27:30.070196 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:27:40.070731 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:27:50.071149 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:28:00.071322 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:28:10.071635 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:28:20.072158 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:28:30.072932 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:28:40.073549 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:28:50.073853 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:29:00.074016 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:29:10.074385 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:29:20.075325 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:29:30.076113 78753 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 15:29:30.076478 78753 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 15:29:30.076723 78753 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-153534.188891 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 15:35:34
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 15:35:34.886662 188891 resource.cpp:110] Successfully proc initialized mempool wrapper
W0806 15:35:35.142822 188891 infer.h:487] Succ load common model[0x6266800], path[serving_server].
W0806 15:35:35.142841 188891 infer.h:185] Succ load model_data_pathserving_server
W0806 15:35:35.142851 188891 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 15:35:35.142858 188891 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 15:35:35.142864 188891 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 15:35:35.142933 188891 kv_manager.h:70] general_infer_0:
W0806 15:35:35.142940 188891 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
W0806 15:35:35.143271 188891 service.cpp:49] Succ get merger: default for service: GeneralModelService
W0806 15:35:35.144469 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:35:35.146505 189151 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.146545 189151 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.146737 189151 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.148248 189151 infer.h:524] td_core[0x7fade4004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.148283 189151 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.148290 189151 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.148363 189153 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.148396 189153 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.148418 189153 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.149902 189153 infer.h:524] td_core[0x7fadd8004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.150717 189153 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.150882 189153 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.150938 189155 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.150974 189155 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.151016 189155 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.153961 189155 infer.h:524] td_core[0x7fadd0004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.154050 189155 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.154072 189155 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.154227 189156 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.154254 189156 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.154325 189156 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.156725 189156 infer.h:524] td_core[0x7fadc4004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.156760 189156 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.156776 189156 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.157027 189157 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.157063 189157 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.157083 189157 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.159118 189157 infer.h:524] td_core[0x7fadb8004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.159153 189157 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.159162 189157 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.159222 189158 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.159246 189158 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.159302 189158 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.160917 189158 infer.h:524] td_core[0x7fad8c004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.160979 189158 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.161000 189158 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.161080 189159 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.161113 189159 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.161147 189159 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.162650 189159 infer.h:524] td_core[0x7fadbc004a20] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.162685 189159 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.162694 189159 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.162760 189160 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.162794 189160 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.162815 189160 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.164260 189160 infer.h:524] td_core[0x7fadb4004a20] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.164294 189160 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.164322 189160 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.164376 189161 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.164397 189161 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.164417 189161 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.165877 189161 infer.h:524] td_core[0x7fada0004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.165907 189161 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.165916 189161 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.165971 189162 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.166005 189162 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.166025 189162 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.167418 189162 infer.h:524] td_core[0x7fada4004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.167449 189162 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.167469 189162 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.167515 189163 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.167543 189163 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.167572 189163 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.169037 189163 infer.h:524] td_core[0x7fada8004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.169055 189163 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.169064 189163 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:45.144615 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:35:55.144759 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:36:05.144901 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:36:15.145774 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:36:25.146376 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:36:35.146873 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:36:45.147060 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:36:55.147209 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:37:05.147361 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:37:15.147891 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:37:25.149278 188891 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 15:37:25.149458 188891 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 15:37:25.149477 188891 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-153718.213749 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 15:37:18
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 15:37:18.051189 213749 resource.cpp:110] Successfully proc initialized mempool wrapper
W0806 15:37:18.300521 213749 infer.h:487] Succ load common model[0x671f800], path[serving_server].
W0806 15:37:18.300546 213749 infer.h:185] Succ load model_data_pathserving_server
W0806 15:37:18.300556 213749 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 15:37:18.300562 213749 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 15:37:18.300570 213749 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 15:37:18.300642 213749 kv_manager.h:70] general_infer_0:
W0806 15:37:18.300649 213749 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
W0806 15:37:18.300992 213749 service.cpp:49] Succ get merger: default for service: GeneralModelService
W0806 15:37:18.302085 213817 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:37:18.304368 213818 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.304457 213818 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.304514 213818 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.306993 213818 infer.h:524] td_core[0x7f6e6c004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.307034 213818 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.307044 213818 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.307114 213819 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.307148 213819 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.307169 213819 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.308980 213819 infer.h:524] td_core[0x7f6e60004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.309002 213819 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.309010 213819 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.309060 213820 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.309077 213820 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.309096 213820 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.311779 213820 infer.h:524] td_core[0x7f6e54004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.311816 213820 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.311836 213820 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.311955 213821 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.312002 213821 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.312032 213821 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.313676 213821 infer.h:524] td_core[0x7f6e4c004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.313716 213821 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.313725 213821 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.313823 213822 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.313860 213822 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.313896 213822 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.315584 213822 infer.h:524] td_core[0x7f6e40004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.315616 213822 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.315624 213822 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.315724 213823 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.315748 213823 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.315805 213823 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.317441 213823 infer.h:524] td_core[0x7f6e38004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.317476 213823 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.317484 213823 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.317553 213824 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.317576 213824 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.317597 213824 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.319192 213824 infer.h:524] td_core[0x7f6e0c004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.319228 213824 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.319237 213824 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.319326 213825 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.319352 213825 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.319375 213825 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.320974 213825 infer.h:524] td_core[0x7f6e00004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.320998 213825 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.321008 213825 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.321060 213826 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.321091 213826 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.321113 213826 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.322616 213826 infer.h:524] td_core[0x7f6e2c004a20] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.322638 213826 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.322646 213826 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.322692 213827 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.322721 213827 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.322743 213827 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.324208 213827 infer.h:524] td_core[0x7f6e24004a20] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.324225 213827 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.324234 213827 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.324287 213828 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.324309 213828 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.324332 213828 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.325800 213828 infer.h:524] td_core[0x7f6e18004a20] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.325819 213828 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.325829 213828 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:28.303360 213817 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:37:38.303831 213749 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 15:37:38.303936 213749 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 15:37:38.303953 213749 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/serving_client/serving_client_conf.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
feed_var {
name: "image"
alias_name: "image"
is_lod_tensor: false
feed_type: 1
shape: 3
}
fetch_var {
name: "detection_output_0.tmp_0"
alias_name: "detection_output_0.tmp_0"
is_lod_tensor: true
fetch_type: 1
shape: -1
}
python/examples/grpc_impl_example/blazeface/test.jpg 0 → 100644
浏览文件 @ 3bc25b2a
此差异已折叠。
python/examples/grpc_impl_example/ocr_detection/7.jpg 0 → 100644
浏览文件 @ 3bc25b2a
此差异已折叠。
Markdown is supported
0% 或 .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑！
想要评论请 注册 或