Skip to content

S
Serving

PaddlePaddle / Serving
1 年多 前同步成功

通知 186
Star 833
Fork 253
S
Serving
提交 3bc25b2a 编写于 作者: W wangjiawei04
浏览文件
操作

adapt grpc to blazeface

上级 08f5877f
显示空白变更内容
内联 并排
Showing with 2710 addition and 0 deletion
python/examples/grpc_impl_example/blazeface/README.md 0 → 100644
浏览文件 @ 3bc25b2a
# Blazeface
## Get Model
```
python -m paddle_serving_app.package --get_model blazeface
tar -xzvf blazeface.tar.gz
```
## RPC Service
### Start Service
```
python -m paddle_serving_server.serve --model serving_server --port 9494
```
### Client Prediction
```
python test_client.py serving_client/serving_client_conf.prototxt test.jpg
```
the result is in `output` folder, including a json file and image file with bounding boxes.
python/examples/grpc_impl_example/blazeface/client.py 0 → 100644
浏览文件 @ 3bc25b2a
from paddle_serving_client import MultiLangClient as Client
from paddle_serving_app.reader import *
import sys
import numpy as np
preprocess = Sequential([
File2Image(),
Normalize([104, 117, 123], [127.502231, 127.502231, 127.502231], False)
])
postprocess = BlazeFacePostprocess("label_list.txt", "output")
client = Client()
client.connect(['127.0.0.1:9393'])
im_0 = preprocess(sys.argv[1])
tmp = Transpose((2,0,1))
im = tmp(im_0)
fetch_map = client.predict(
feed={
"image": im
},
fetch=["detection_output_0.tmp_0"], batch=True)
print(fetch_map)
fetch_map["image"] = sys.argv[1]
fetch_map["im_shape"] = im_0.shape
postprocess(fetch_map)
python/examples/grpc_impl_example/blazeface/log/serving.ERROR 0 → 120000
浏览文件 @ 3bc25b2a
serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.ERROR.20200806-145211.106942
\ No newline at end of file
python/examples/grpc_impl_example/blazeface/log/serving.INFO 0 → 120000
浏览文件 @ 3bc25b2a
serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-153718.213749
\ No newline at end of file
python/examples/grpc_impl_example/blazeface/log/serving.WARNING 0 → 120000
浏览文件 @ 3bc25b2a
serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-153718.213749
\ No newline at end of file
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.ERROR.20200806-145211.106942 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:52:11
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
E0806 14:52:11.281495 106942 server.cpp:929] Fail to listen 0.0.0.0:12005
E0806 14:52:11.286175 106942 server.cpp:95] Failed to start Paddle Inference Server
E0806 14:52:11.286290 106942 pdserving.cpp:221] Failed start server and wait!
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-143558.119594 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:35:58
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 14:35:58.982995 119594 resource.cpp:110] Successfully proc initialized mempool wrapper
I0806 14:35:58.983376 119594 infer.h:782] model_toolkit_conf.engines(0).name: general_infer_0
I0806 14:35:58.983395 119594 infer.h:74] InferEngineCreationParams: model_path = serving_server, enable_memory_optimization = 1, enable_ir_optimization = 0, static_optimization = 0, force_update_static_cache = 0
I0806 14:35:58.983450 119594 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 14:35:58.991873 119594 analysis_predictor.cc:833] MODEL VERSION: 0.0.0
I0806 14:35:58.991894 119594 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.2
I0806 14:35:58.992154 119594 analysis_predictor.cc:440] ir_optim is turned off, no IR pass will be executed
I0806 14:35:59.202584 119594 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_2 size: 384
I0806 14:35:59.202608 119594 memory_optimize_pass.cc:223] Cluster name : depthwise_conv2d_7.tmp_0 size: 384
I0806 14:35:59.202612 119594 memory_optimize_pass.cc:223] Cluster name : reshape2_2.tmp_0 size: 16
I0806 14:35:59.202616 119594 memory_optimize_pass.cc:223] Cluster name : image size: 12
I0806 14:35:59.202620 119594 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_1 size: 384
I0806 14:35:59.202625 119594 memory_optimize_pass.cc:223] Cluster name : batch_norm_30.tmp_0 size: 384
I0806 14:35:59.202627 119594 memory_optimize_pass.cc:223] Cluster name : reshape2_3.tmp_0 size: 8
I0806 14:35:59.202631 119594 memory_optimize_pass.cc:223] Cluster name : batch_norm_15.tmp_3 size: 384
I0806 14:35:59.202634 119594 memory_optimize_pass.cc:223] Cluster name : elementwise_add_6.tmp_1 size: 384
I0806 14:35:59.202638 119594 memory_optimize_pass.cc:223] Cluster name : reshape2_4.tmp_0 size: 16
I0806 14:35:59.202641 119594 memory_optimize_pass.cc:223] Cluster name : reshape2_5.tmp_0 size: 16
I0806 14:35:59.224946 119594 analysis_predictor.cc:462] ======= optimize end =======
W0806 14:35:59.226161 119594 infer.h:487] Succ load common model[0x73e1800], path[serving_server].
W0806 14:35:59.226184 119594 infer.h:185] Succ load model_data_pathserving_server
W0806 14:35:59.226194 119594 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 14:35:59.226202 119594 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 14:35:59.226208 119594 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 14:35:59.226281 119594 kv_manager.h:70] general_infer_0:
W0806 14:35:59.226287 119594 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
I0806 14:35:59.226495 119594 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0806 14:35:59.226503 119594 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0806 14:35:59.226508 119594 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0806 14:35:59.226522 119594 dag.cpp:158] DAG: workflow1
I0806 14:35:59.226526 119594 dag.cpp:159] , Op Num: 3
I0806 14:35:59.226531 119594 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0806 14:35:59.226534 119594 dag.cpp:164] depends: 0
I0806 14:35:59.226538 119594 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0806 14:35:59.226542 119594 dag.cpp:164] depends: 1
I0806 14:35:59.226547 119594 dag.cpp:168] general_reader_0 0
I0806 14:35:59.226550 119594 dag.cpp:162] , OP-3-general_response_0-GeneralResponseOp
I0806 14:35:59.226554 119594 dag.cpp:164] depends: 1
I0806 14:35:59.226557 119594 dag.cpp:168] general_infer_0 0
I0806 14:35:59.226562 119594 dag.cpp:171]
I0806 14:35:59.226567 119594 manager.h:86] Succ init item:workflow1 from conf:workdir/workflow.prototxt, at:0!
W0806 14:35:59.226617 119594 service.cpp:49] Succ get merger: default for service: GeneralModelService
I0806 14:35:59.226636 119594 service.cpp:61] service[GeneralModelService], enable_map_request_to_workflow[0].
I0806 14:35:59.226649 119594 predictor_metric.h:170] try to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 14:35:59.226810 119594 predictor_metric.h:175] succ to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 14:35:59.226822 119594 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 14:35:59.226851 119594 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 14:35:59.226864 119594 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 14:35:59.226892 119594 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 14:35:59.226900 119594 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 14:35:59.226925 119594 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 14:35:59.226931 119594 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 14:35:59.226965 119594 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 14:35:59.226974 119594 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 14:35:59.226999 119594 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 14:35:59.227010 119594 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 14:35:59.227036 119594 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 14:35:59.227043 119594 service.cpp:126] Succ load infer_service: GeneralModelService!
I0806 14:35:59.227049 119594 manager.h:184] Succ init item:GeneralModelService from conf:workdir/infer_service.prototxt, at:0!
I0806 14:35:59.227268 119909 server.cpp:147] Entrence reload worker, interval_s: 10
I0806 14:35:59.227476 119909 server.cpp:150] Begin reload framework...
W0806 14:35:59.227495 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:35:59.227510 119909 manager.h:131] Finish reload 1 workflow(s)
W0806 14:35:59.229777 119910 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.229818 119910 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.229908 119910 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:35:59.229948 119910 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:35:59.232357 119910 infer.h:524] td_core[0x7ff410004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.232388 119910 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.232398 119910 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:35:59.232405 119910 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff410067570
W0806 14:35:59.232452 119911 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.232484 119911 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.232506 119911 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:35:59.232527 119911 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:35:59.234267 119911 infer.h:524] td_core[0x7ff404004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.234309 119911 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.234318 119911 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:35:59.234326 119911 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff404067570
W0806 14:35:59.234372 119912 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.234406 119912 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.234468 119912 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:35:59.234917 119912 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:35:59.237015 119912 infer.h:524] td_core[0x7ff3fc004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.237056 119912 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.237073 119912 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:35:59.237090 119912 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff3fc067570
W0806 14:35:59.237166 119913 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.237293 119913 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.237341 119913 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:35:59.237375 119913 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 14:35:59.237442 119594 server.cpp:1037] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is serving on port=12005.
W0806 14:35:59.238987 119913 infer.h:524] td_core[0x7ff3f0004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.239040 119913 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.239051 119913 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:35:59.239059 119913 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff3f006b140
W0806 14:35:59.239130 119914 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.239158 119914 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.239181 119914 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:35:59.239212 119914 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 14:35:59.239375 119594 server.cpp:1040] Check out http://yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com:12005 in web browser.
W0806 14:35:59.240805 119914 infer.h:524] td_core[0x7ff3e8004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.240855 119914 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.240876 119914 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:35:59.240885 119914 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff3e806b140
W0806 14:35:59.240947 119915 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.240974 119915 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.241281 119915 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:35:59.241320 119915 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:35:59.243010 119915 infer.h:524] td_core[0x7ff3dc004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.243083 119915 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.243093 119915 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:35:59.243103 119915 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff3dc06b140
W0806 14:35:59.243155 119916 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.243180 119916 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.243204 119916 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:35:59.243227 119916 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:35:59.244889 119916 infer.h:524] td_core[0x7ff3d0004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.244930 119916 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.244951 119916 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:35:59.244961 119916 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff3d006b140
W0806 14:35:59.245100 119917 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.245141 119917 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.245163 119917 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:35:59.245185 119917 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:35:59.246835 119917 infer.h:524] td_core[0x7ff3ac004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.246866 119917 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.246876 119917 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:35:59.246884 119917 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff3ac06b140
W0806 14:35:59.246949 119918 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.246975 119918 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.246999 119918 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:35:59.247020 119918 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:35:59.248579 119918 infer.h:524] td_core[0x7ff398004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.248601 119918 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.248610 119918 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:35:59.248618 119918 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff39806b140
W0806 14:35:59.248651 119919 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.248677 119919 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.248698 119919 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:35:59.248719 119919 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:35:59.250190 119919 infer.h:524] td_core[0x7ff3cc004a20] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.250210 119919 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.250218 119919 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:35:59.250227 119919 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff3cc06b140
W0806 14:35:59.250274 119920 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.250298 119920 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.250317 119920 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:35:59.250337 119920 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:35:59.251790 119920 infer.h:524] td_core[0x7ff3d4004a20] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.251823 119920 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.251832 119920 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:35:59.251840 119920 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff3d406b140
I0806 14:36:09.227581 119909 server.cpp:150] Begin reload framework...
W0806 14:36:09.228847 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:36:09.229097 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:36:19.229176 119909 server.cpp:150] Begin reload framework...
W0806 14:36:19.229439 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:36:19.229530 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:36:29.229609 119909 server.cpp:150] Begin reload framework...
W0806 14:36:29.229853 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:36:29.230049 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:36:39.230134 119909 server.cpp:150] Begin reload framework...
W0806 14:36:39.230340 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:36:39.230437 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:36:49.230530 119909 server.cpp:150] Begin reload framework...
W0806 14:36:49.230597 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:36:49.230623 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:36:59.230695 119909 server.cpp:150] Begin reload framework...
W0806 14:36:59.230760 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:36:59.230785 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:37:09.230857 119909 server.cpp:150] Begin reload framework...
W0806 14:37:09.232548 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:37:09.232746 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:37:19.232995 119909 server.cpp:150] Begin reload framework...
W0806 14:37:19.233659 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:37:19.233747 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:37:29.233783 119909 server.cpp:150] Begin reload framework...
W0806 14:37:29.234233 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:37:29.234541 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:37:39.234710 119909 server.cpp:150] Begin reload framework...
W0806 14:37:39.235018 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:37:39.235172 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:37:49.235244 119909 server.cpp:150] Begin reload framework...
W0806 14:37:49.235304 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:37:49.235321 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:37:59.235391 119909 server.cpp:150] Begin reload framework...
W0806 14:37:59.235473 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:37:59.235489 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:38:09.235560 119909 server.cpp:150] Begin reload framework...
W0806 14:38:09.236246 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:38:09.236405 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:38:19.236483 119909 server.cpp:150] Begin reload framework...
W0806 14:38:19.237109 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:38:19.237273 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:38:29.237346 119909 server.cpp:150] Begin reload framework...
W0806 14:38:29.239338 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:38:29.239452 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:38:39.239528 119909 server.cpp:150] Begin reload framework...
W0806 14:38:39.240639 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:38:39.240717 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:38:49.240783 119909 server.cpp:150] Begin reload framework...
W0806 14:38:49.240865 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:38:49.240888 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:38:59.240963 119909 server.cpp:150] Begin reload framework...
W0806 14:38:59.241040 119909 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:38:59.241060 119909 manager.h:131] Finish reload 1 workflow(s)
I0806 14:39:06.902720 119916 general_model_service.pb.cc:2975] remote_side=[127.0.0.1:53939]
I0806 14:39:06.902947 119916 general_model_service.pb.cc:2976] local_side=[127.0.0.1:12005]
I0806 14:39:06.902959 119916 general_model_service.pb.cc:2977] service_name=[GeneralModelService]
I0806 14:39:06.902972 119916 general_model_service.pb.cc:2978] log_id=[0]
I0806 14:39:06.902992 119916 service.cpp:173] enable map request == False
I0806 14:39:06.907811 119916 op.cpp:159] general_reader_0_time=[3751]
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-145210.106942 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:52:10
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 14:52:10.966982 106942 resource.cpp:110] Successfully proc initialized mempool wrapper
I0806 14:52:10.967720 106942 infer.h:782] model_toolkit_conf.engines(0).name: general_infer_0
I0806 14:52:10.967741 106942 infer.h:74] InferEngineCreationParams: model_path = serving_server, enable_memory_optimization = 1, enable_ir_optimization = 0, static_optimization = 0, force_update_static_cache = 0
I0806 14:52:10.967803 106942 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 14:52:10.976392 106942 analysis_predictor.cc:833] MODEL VERSION: 0.0.0
I0806 14:52:10.976413 106942 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.2
I0806 14:52:10.976677 106942 analysis_predictor.cc:440] ir_optim is turned off, no IR pass will be executed
I0806 14:52:11.248062 106942 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_2 size: 384
I0806 14:52:11.248090 106942 memory_optimize_pass.cc:223] Cluster name : depthwise_conv2d_7.tmp_0 size: 384
I0806 14:52:11.248093 106942 memory_optimize_pass.cc:223] Cluster name : reshape2_2.tmp_0 size: 16
I0806 14:52:11.248097 106942 memory_optimize_pass.cc:223] Cluster name : image size: 12
I0806 14:52:11.248101 106942 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_1 size: 384
I0806 14:52:11.248106 106942 memory_optimize_pass.cc:223] Cluster name : batch_norm_30.tmp_0 size: 384
I0806 14:52:11.248109 106942 memory_optimize_pass.cc:223] Cluster name : reshape2_3.tmp_0 size: 8
I0806 14:52:11.248112 106942 memory_optimize_pass.cc:223] Cluster name : batch_norm_15.tmp_3 size: 384
I0806 14:52:11.248116 106942 memory_optimize_pass.cc:223] Cluster name : elementwise_add_6.tmp_1 size: 384
I0806 14:52:11.248121 106942 memory_optimize_pass.cc:223] Cluster name : reshape2_4.tmp_0 size: 16
I0806 14:52:11.248123 106942 memory_optimize_pass.cc:223] Cluster name : reshape2_5.tmp_0 size: 16
I0806 14:52:11.270274 106942 analysis_predictor.cc:462] ======= optimize end =======
W0806 14:52:11.271471 106942 infer.h:487] Succ load common model[0x6ccb800], path[serving_server].
W0806 14:52:11.271499 106942 infer.h:185] Succ load model_data_pathserving_server
W0806 14:52:11.271510 106942 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 14:52:11.271518 106942 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 14:52:11.271525 106942 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 14:52:11.271597 106942 kv_manager.h:70] general_infer_0:
W0806 14:52:11.271605 106942 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
I0806 14:52:11.271821 106942 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0806 14:52:11.271833 106942 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0806 14:52:11.271838 106942 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0806 14:52:11.271854 106942 dag.cpp:158] DAG: workflow1
I0806 14:52:11.271859 106942 dag.cpp:159] , Op Num: 3
I0806 14:52:11.271863 106942 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0806 14:52:11.271867 106942 dag.cpp:164] depends: 0
I0806 14:52:11.271872 106942 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0806 14:52:11.271876 106942 dag.cpp:164] depends: 1
I0806 14:52:11.271880 106942 dag.cpp:168] general_reader_0 0
I0806 14:52:11.271884 106942 dag.cpp:162] , OP-3-general_response_0-GeneralResponseOp
I0806 14:52:11.271888 106942 dag.cpp:164] depends: 1
I0806 14:52:11.271893 106942 dag.cpp:168] general_infer_0 0
I0806 14:52:11.271898 106942 dag.cpp:171]
I0806 14:52:11.271903 106942 manager.h:86] Succ init item:workflow1 from conf:workdir/workflow.prototxt, at:0!
W0806 14:52:11.271955 106942 service.cpp:49] Succ get merger: default for service: GeneralModelService
I0806 14:52:11.271973 106942 service.cpp:61] service[GeneralModelService], enable_map_request_to_workflow[0].
I0806 14:52:11.271987 106942 predictor_metric.h:170] try to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 14:52:11.272101 106942 predictor_metric.h:175] succ to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 14:52:11.272111 106942 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 14:52:11.272140 106942 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 14:52:11.272145 106942 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 14:52:11.272179 106942 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 14:52:11.272195 106942 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 14:52:11.272226 106942 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 14:52:11.272233 106942 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 14:52:11.272259 106942 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 14:52:11.272272 106942 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 14:52:11.272305 106942 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 14:52:11.272320 106942 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 14:52:11.272351 106942 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 14:52:11.272359 106942 service.cpp:126] Succ load infer_service: GeneralModelService!
I0806 14:52:11.272366 106942 manager.h:184] Succ init item:GeneralModelService from conf:workdir/infer_service.prototxt, at:0!
I0806 14:52:11.272586 107002 server.cpp:147] Entrence reload worker, interval_s: 10
I0806 14:52:11.272717 107002 server.cpp:150] Begin reload framework...
W0806 14:52:11.272738 107002 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:52:11.272770 107002 manager.h:131] Finish reload 1 workflow(s)
W0806 14:52:11.275002 107003 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.275043 107003 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.275321 107003 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:52:11.275362 107003 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:52:11.277890 107003 infer.h:524] td_core[0x7f6a04004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.277915 107003 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.277923 107003 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:52:11.277931 107003 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6a04067570
W0806 14:52:11.278015 107004 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.278060 107004 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.278085 107004 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:52:11.278110 107004 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:52:11.280226 107004 infer.h:524] td_core[0x7f69f8004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.280256 107004 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.280266 107004 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:52:11.280282 107004 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f69f8067570
W0806 14:52:11.280328 107005 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.280501 107005 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.280968 107005 memory.cpp:73] Succ thread initialize mempool wrapper
E0806 14:52:11.281495 106942 server.cpp:929] Fail to listen 0.0.0.0:12005
I0806 14:52:11.281589 107005 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
E0806 14:52:11.286175 106942 server.cpp:95] Failed to start Paddle Inference Server
E0806 14:52:11.286290 106942 pdserving.cpp:221] Failed start server and wait!
W0806 14:52:11.287925 107005 infer.h:524] td_core[0x7f69f0004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.288049 107005 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.288060 107005 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:52:11.288079 107005 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f69f0067570
W0806 14:52:11.288179 107006 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.288208 107006 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.288231 107006 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:52:11.288259 107006 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:52:11.289176 106942 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 14:52:11.289906 107006 infer.h:524] td_core[0x7f69e4004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.289921 106942 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 14:52:11.289939 107006 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.290014 106942 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-152639.78753 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 15:26:39
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 15:26:39.811251 78753 resource.cpp:110] Successfully proc initialized mempool wrapper
I0806 15:26:39.812160 78753 infer.h:782] model_toolkit_conf.engines(0).name: general_infer_0
I0806 15:26:39.812181 78753 infer.h:74] InferEngineCreationParams: model_path = serving_server, enable_memory_optimization = 1, enable_ir_optimization = 0, static_optimization = 0, force_update_static_cache = 0
I0806 15:26:39.812237 78753 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 15:26:39.821099 78753 analysis_predictor.cc:833] MODEL VERSION: 0.0.0
I0806 15:26:39.821118 78753 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.2
I0806 15:26:39.821379 78753 analysis_predictor.cc:440] ir_optim is turned off, no IR pass will be executed
I0806 15:26:40.043308 78753 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_2 size: 384
I0806 15:26:40.043332 78753 memory_optimize_pass.cc:223] Cluster name : depthwise_conv2d_7.tmp_0 size: 384
I0806 15:26:40.043337 78753 memory_optimize_pass.cc:223] Cluster name : reshape2_2.tmp_0 size: 16
I0806 15:26:40.043341 78753 memory_optimize_pass.cc:223] Cluster name : image size: 12
I0806 15:26:40.043345 78753 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_1 size: 384
I0806 15:26:40.043349 78753 memory_optimize_pass.cc:223] Cluster name : batch_norm_30.tmp_0 size: 384
I0806 15:26:40.043352 78753 memory_optimize_pass.cc:223] Cluster name : reshape2_3.tmp_0 size: 8
I0806 15:26:40.043355 78753 memory_optimize_pass.cc:223] Cluster name : batch_norm_15.tmp_3 size: 384
I0806 15:26:40.043359 78753 memory_optimize_pass.cc:223] Cluster name : elementwise_add_6.tmp_1 size: 384
I0806 15:26:40.043363 78753 memory_optimize_pass.cc:223] Cluster name : reshape2_4.tmp_0 size: 16
I0806 15:26:40.043366 78753 memory_optimize_pass.cc:223] Cluster name : reshape2_5.tmp_0 size: 16
I0806 15:26:40.065661 78753 analysis_predictor.cc:462] ======= optimize end =======
W0806 15:26:40.066874 78753 infer.h:487] Succ load common model[0x72be800], path[serving_server].
W0806 15:26:40.066896 78753 infer.h:185] Succ load model_data_pathserving_server
W0806 15:26:40.066906 78753 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 15:26:40.066913 78753 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 15:26:40.066920 78753 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 15:26:40.066992 78753 kv_manager.h:70] general_infer_0:
W0806 15:26:40.066998 78753 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
I0806 15:26:40.067216 78753 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0806 15:26:40.067226 78753 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0806 15:26:40.067230 78753 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0806 15:26:40.067245 78753 dag.cpp:158] DAG: workflow1
I0806 15:26:40.067250 78753 dag.cpp:159] , Op Num: 3
I0806 15:26:40.067253 78753 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0806 15:26:40.067257 78753 dag.cpp:164] depends: 0
I0806 15:26:40.067261 78753 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0806 15:26:40.067265 78753 dag.cpp:164] depends: 1
I0806 15:26:40.067268 78753 dag.cpp:168] general_reader_0 0
I0806 15:26:40.067272 78753 dag.cpp:162] , OP-3-general_response_0-GeneralResponseOp
I0806 15:26:40.067276 78753 dag.cpp:164] depends: 1
I0806 15:26:40.067281 78753 dag.cpp:168] general_infer_0 0
I0806 15:26:40.067284 78753 dag.cpp:171]
I0806 15:26:40.067289 78753 manager.h:86] Succ init item:workflow1 from conf:workdir/workflow.prototxt, at:0!
W0806 15:26:40.067344 78753 service.cpp:49] Succ get merger: default for service: GeneralModelService
I0806 15:26:40.067363 78753 service.cpp:61] service[GeneralModelService], enable_map_request_to_workflow[0].
I0806 15:26:40.067376 78753 predictor_metric.h:170] try to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 15:26:40.067494 78753 predictor_metric.h:175] succ to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 15:26:40.067505 78753 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 15:26:40.067533 78753 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 15:26:40.067539 78753 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 15:26:40.067566 78753 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 15:26:40.067574 78753 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 15:26:40.067598 78753 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 15:26:40.067605 78753 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 15:26:40.067631 78753 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 15:26:40.067637 78753 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 15:26:40.067662 78753 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 15:26:40.067668 78753 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 15:26:40.067695 78753 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 15:26:40.067703 78753 service.cpp:126] Succ load infer_service: GeneralModelService!
I0806 15:26:40.067719 78753 manager.h:184] Succ init item:GeneralModelService from conf:workdir/infer_service.prototxt, at:0!
I0806 15:26:40.067939 78839 server.cpp:147] Entrence reload worker, interval_s: 10
I0806 15:26:40.068127 78839 server.cpp:150] Begin reload framework...
W0806 15:26:40.068145 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:26:40.068156 78839 manager.h:131] Finish reload 1 workflow(s)
W0806 15:26:40.070395 78840 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.070421 78840 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.070459 78840 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.070503 78840 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.071964 78840 infer.h:524] td_core[0x7ff80c004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.071995 78840 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.072003 78840 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.072011 78840 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff80c067570
W0806 15:26:40.072075 78841 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.072121 78841 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.072146 78841 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.072172 78841 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.074611 78841 infer.h:524] td_core[0x7ff800004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.074635 78841 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.074642 78841 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.074651 78841 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff800067570
W0806 15:26:40.074693 78842 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.074712 78842 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.074733 78842 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.074762 78842 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.077550 78842 infer.h:524] td_core[0x7ff7f4004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.077597 78842 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.077608 78842 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.077616 78842 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7f4067570
I0806 15:26:40.077626 78753 server.cpp:1037] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is serving on port=12005.
W0806 15:26:40.077713 78843 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.077751 78843 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.077783 78843 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.077816 78843 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 15:26:40.078102 78753 server.cpp:1040] Check out http://yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com:12005 in web browser.
W0806 15:26:40.079548 78843 infer.h:524] td_core[0x7ff7ec004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.079599 78843 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.079619 78843 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.079628 78843 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7ec06b140
W0806 15:26:40.079739 78845 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.079782 78845 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.079810 78845 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.079841 78845 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.082089 78845 infer.h:524] td_core[0x7ff7e0004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.082123 78845 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.082132 78845 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.082139 78845 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7e006b140
W0806 15:26:40.082198 78846 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.082222 78846 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.082243 78846 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.082288 78846 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.084091 78846 infer.h:524] td_core[0x7ff7d4004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.084132 78846 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.084142 78846 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.084151 78846 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7d406b140
W0806 15:26:40.084208 78847 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.084230 78847 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.084256 78847 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.084278 78847 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.085944 78847 infer.h:524] td_core[0x7ff7a8004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.085985 78847 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.085994 78847 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.086004 78847 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7a806b140
W0806 15:26:40.086084 78848 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.086325 78848 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.086367 78848 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.086393 78848 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.088397 78848 infer.h:524] td_core[0x7ff79c004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.088433 78848 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.088443 78848 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.088452 78848 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff79c06b140
W0806 15:26:40.088598 78844 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.088953 78844 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.088991 78844 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.089030 78844 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.090581 78844 infer.h:524] td_core[0x7ff7d0004a20] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.090620 78844 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.090628 78844 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.090637 78844 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7d006b140
W0806 15:26:40.090682 78849 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.090716 78849 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.090740 78849 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.090770 78849 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.092309 78849 infer.h:524] td_core[0x7ff7d8004a20] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.092658 78849 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.092681 78849 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.092701 78849 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7d806b140
W0806 15:26:40.092747 78850 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.092779 78850 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.092801 78850 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:26:40.092834 78850 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:26:40.094321 78850 infer.h:524] td_core[0x7ff7c0004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.099390 78850 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.099424 78850 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:26:40.099457 78850 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7ff7c006b140
I0806 15:26:50.068229 78839 server.cpp:150] Begin reload framework...
W0806 15:26:50.068300 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:26:50.068322 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:27:00.068401 78839 server.cpp:150] Begin reload framework...
W0806 15:27:00.068467 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:27:00.068482 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:27:10.068552 78839 server.cpp:150] Begin reload framework...
W0806 15:27:10.069015 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:27:10.069116 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:27:20.069195 78839 server.cpp:150] Begin reload framework...
W0806 15:27:20.069417 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:27:20.069811 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:27:30.069891 78839 server.cpp:150] Begin reload framework...
W0806 15:27:30.070196 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:27:30.070439 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:27:40.070523 78839 server.cpp:150] Begin reload framework...
W0806 15:27:40.070731 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:27:40.070988 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:27:50.071066 78839 server.cpp:150] Begin reload framework...
W0806 15:27:50.071149 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:27:50.071167 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:28:00.071242 78839 server.cpp:150] Begin reload framework...
W0806 15:28:00.071322 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:28:00.071339 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:28:10.071413 78839 server.cpp:150] Begin reload framework...
W0806 15:28:10.071635 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:28:10.071827 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:28:20.071903 78839 server.cpp:150] Begin reload framework...
W0806 15:28:20.072158 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:28:20.072371 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:28:30.072446 78839 server.cpp:150] Begin reload framework...
W0806 15:28:30.072932 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:28:30.073240 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:28:40.073336 78839 server.cpp:150] Begin reload framework...
W0806 15:28:40.073549 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:28:40.073745 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:28:50.073782 78839 server.cpp:150] Begin reload framework...
W0806 15:28:50.073853 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:28:50.073873 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:29:00.073943 78839 server.cpp:150] Begin reload framework...
W0806 15:29:00.074016 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:29:00.074035 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:29:10.074110 78839 server.cpp:150] Begin reload framework...
W0806 15:29:10.074385 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:29:10.074802 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:29:20.074892 78839 server.cpp:150] Begin reload framework...
W0806 15:29:20.075325 78839 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:29:20.075563 78839 manager.h:131] Finish reload 1 workflow(s)
I0806 15:29:25.879223 78753 server.cpp:1095] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is going to quit
I0806 15:29:30.075656 78839 server.cpp:162] Exit reload worker!
W0806 15:29:30.076113 78753 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 15:29:30.076478 78753 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 15:29:30.076723 78753 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-153534.188891 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 15:35:34
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 15:35:34.886662 188891 resource.cpp:110] Successfully proc initialized mempool wrapper
I0806 15:35:34.887372 188891 infer.h:782] model_toolkit_conf.engines(0).name: general_infer_0
I0806 15:35:34.887393 188891 infer.h:74] InferEngineCreationParams: model_path = serving_server, enable_memory_optimization = 1, enable_ir_optimization = 0, static_optimization = 0, force_update_static_cache = 0
I0806 15:35:34.887447 188891 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 15:35:34.896382 188891 analysis_predictor.cc:833] MODEL VERSION: 0.0.0
I0806 15:35:34.896404 188891 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.2
I0806 15:35:34.896670 188891 analysis_predictor.cc:440] ir_optim is turned off, no IR pass will be executed
I0806 15:35:35.119560 188891 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_2 size: 384
I0806 15:35:35.119586 188891 memory_optimize_pass.cc:223] Cluster name : depthwise_conv2d_7.tmp_0 size: 384
I0806 15:35:35.119591 188891 memory_optimize_pass.cc:223] Cluster name : reshape2_2.tmp_0 size: 16
I0806 15:35:35.119594 188891 memory_optimize_pass.cc:223] Cluster name : image size: 12
I0806 15:35:35.119598 188891 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_1 size: 384
I0806 15:35:35.119602 188891 memory_optimize_pass.cc:223] Cluster name : batch_norm_30.tmp_0 size: 384
I0806 15:35:35.119606 188891 memory_optimize_pass.cc:223] Cluster name : reshape2_3.tmp_0 size: 8
I0806 15:35:35.119609 188891 memory_optimize_pass.cc:223] Cluster name : batch_norm_15.tmp_3 size: 384
I0806 15:35:35.119613 188891 memory_optimize_pass.cc:223] Cluster name : elementwise_add_6.tmp_1 size: 384
I0806 15:35:35.119617 188891 memory_optimize_pass.cc:223] Cluster name : reshape2_4.tmp_0 size: 16
I0806 15:35:35.119621 188891 memory_optimize_pass.cc:223] Cluster name : reshape2_5.tmp_0 size: 16
I0806 15:35:35.141611 188891 analysis_predictor.cc:462] ======= optimize end =======
W0806 15:35:35.142822 188891 infer.h:487] Succ load common model[0x6266800], path[serving_server].
W0806 15:35:35.142841 188891 infer.h:185] Succ load model_data_pathserving_server
W0806 15:35:35.142851 188891 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 15:35:35.142858 188891 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 15:35:35.142864 188891 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 15:35:35.142933 188891 kv_manager.h:70] general_infer_0:
W0806 15:35:35.142940 188891 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
I0806 15:35:35.143143 188891 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0806 15:35:35.143153 188891 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0806 15:35:35.143158 188891 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0806 15:35:35.143172 188891 dag.cpp:158] DAG: workflow1
I0806 15:35:35.143177 188891 dag.cpp:159] , Op Num: 3
I0806 15:35:35.143182 188891 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0806 15:35:35.143185 188891 dag.cpp:164] depends: 0
I0806 15:35:35.143188 188891 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0806 15:35:35.143193 188891 dag.cpp:164] depends: 1
I0806 15:35:35.143196 188891 dag.cpp:168] general_reader_0 0
I0806 15:35:35.143200 188891 dag.cpp:162] , OP-3-general_response_0-GeneralResponseOp
I0806 15:35:35.143203 188891 dag.cpp:164] depends: 1
I0806 15:35:35.143208 188891 dag.cpp:168] general_infer_0 0
I0806 15:35:35.143211 188891 dag.cpp:171]
I0806 15:35:35.143216 188891 manager.h:86] Succ init item:workflow1 from conf:workdir/workflow.prototxt, at:0!
W0806 15:35:35.143271 188891 service.cpp:49] Succ get merger: default for service: GeneralModelService
I0806 15:35:35.143290 188891 service.cpp:61] service[GeneralModelService], enable_map_request_to_workflow[0].
I0806 15:35:35.143302 188891 predictor_metric.h:170] try to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 15:35:35.143451 188891 predictor_metric.h:175] succ to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 15:35:35.143472 188891 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 15:35:35.143501 188891 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 15:35:35.143515 188891 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 15:35:35.143553 188891 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 15:35:35.143560 188891 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 15:35:35.143594 188891 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 15:35:35.143601 188891 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 15:35:35.143628 188891 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 15:35:35.143642 188891 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 15:35:35.143668 188891 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 15:35:35.143682 188891 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 15:35:35.143710 188891 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 15:35:35.143724 188891 service.cpp:126] Succ load infer_service: GeneralModelService!
I0806 15:35:35.143733 188891 manager.h:184] Succ init item:GeneralModelService from conf:workdir/infer_service.prototxt, at:0!
I0806 15:35:35.143956 189150 server.cpp:147] Entrence reload worker, interval_s: 10
I0806 15:35:35.144258 189150 server.cpp:150] Begin reload framework...
W0806 15:35:35.144469 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:35:35.144480 189150 manager.h:131] Finish reload 1 workflow(s)
W0806 15:35:35.146505 189151 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.146545 189151 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.146737 189151 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.146781 189151 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.148248 189151 infer.h:524] td_core[0x7fade4004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.148283 189151 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.148290 189151 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.148298 189151 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fade4067570
W0806 15:35:35.148363 189153 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.148396 189153 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.148418 189153 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.148440 189153 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.149902 189153 infer.h:524] td_core[0x7fadd8004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.150717 189153 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.150882 189153 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.150892 189153 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fadd8067570
W0806 15:35:35.150938 189155 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.150974 189155 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.151016 189155 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.151093 189155 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 15:35:35.153738 188891 server.cpp:1037] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is serving on port=12005.
W0806 15:35:35.153961 189155 infer.h:524] td_core[0x7fadd0004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.154050 189155 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.154072 189155 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.154083 189155 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fadd0067570
W0806 15:35:35.154227 189156 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.154254 189156 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.154325 189156 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.154361 189156 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 15:35:35.154390 188891 server.cpp:1040] Check out http://yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com:12005 in web browser.
W0806 15:35:35.156725 189156 infer.h:524] td_core[0x7fadc4004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.156760 189156 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.156776 189156 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.156785 189156 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fadc406b140
W0806 15:35:35.157027 189157 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.157063 189157 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.157083 189157 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.157105 189157 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.159118 189157 infer.h:524] td_core[0x7fadb8004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.159153 189157 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.159162 189157 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.159170 189157 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fadb806b140
W0806 15:35:35.159222 189158 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.159246 189158 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.159302 189158 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.159337 189158 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.160917 189158 infer.h:524] td_core[0x7fad8c004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.160979 189158 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.161000 189158 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.161011 189158 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fad8c06b140
W0806 15:35:35.161080 189159 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.161113 189159 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.161147 189159 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.161185 189159 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.162650 189159 infer.h:524] td_core[0x7fadbc004a20] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.162685 189159 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.162694 189159 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.162703 189159 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fadbc06b140
W0806 15:35:35.162760 189160 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.162794 189160 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.162815 189160 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.162837 189160 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.164260 189160 infer.h:524] td_core[0x7fadb4004a20] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.164294 189160 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.164322 189160 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.164331 189160 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fadb406b140
W0806 15:35:35.164376 189161 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.164397 189161 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.164417 189161 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.164438 189161 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.165877 189161 infer.h:524] td_core[0x7fada0004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.165907 189161 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.165916 189161 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.165925 189161 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fada006b140
W0806 15:35:35.165971 189162 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.166005 189162 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.166025 189162 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.166055 189162 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.167418 189162 infer.h:524] td_core[0x7fada4004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.167449 189162 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.167469 189162 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.167479 189162 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fada406b140
W0806 15:35:35.167515 189163 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.167543 189163 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.167572 189163 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:35:35.167603 189163 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:35:35.169037 189163 infer.h:524] td_core[0x7fada8004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.169055 189163 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.169064 189163 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:35:35.169073 189163 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fada806b140
I0806 15:35:45.144551 189150 server.cpp:150] Begin reload framework...
W0806 15:35:45.144615 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:35:45.144634 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:35:55.144703 189150 server.cpp:150] Begin reload framework...
W0806 15:35:55.144759 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:35:55.144781 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:36:05.144851 189150 server.cpp:150] Begin reload framework...
W0806 15:36:05.144901 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:36:05.144917 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:36:15.144986 189150 server.cpp:150] Begin reload framework...
W0806 15:36:15.145774 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:36:15.146031 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:36:25.146126 189150 server.cpp:150] Begin reload framework...
W0806 15:36:25.146376 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:36:25.146566 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:36:35.146639 189150 server.cpp:150] Begin reload framework...
W0806 15:36:35.146873 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:36:35.146960 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:36:45.146992 189150 server.cpp:150] Begin reload framework...
W0806 15:36:45.147060 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:36:45.147079 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:36:55.147150 189150 server.cpp:150] Begin reload framework...
W0806 15:36:55.147209 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:36:55.147228 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:37:05.147296 189150 server.cpp:150] Begin reload framework...
W0806 15:37:05.147361 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:37:05.147403 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:37:15.147490 189150 server.cpp:150] Begin reload framework...
W0806 15:37:15.147891 189150 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:37:15.148109 189150 manager.h:131] Finish reload 1 workflow(s)
I0806 15:37:15.781627 188891 server.cpp:1095] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is going to quit
I0806 15:37:25.148181 189150 server.cpp:162] Exit reload worker!
W0806 15:37:25.149278 188891 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 15:37:25.149458 188891 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 15:37:25.149477 188891 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-153718.213749 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 15:37:18
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 15:37:18.051189 213749 resource.cpp:110] Successfully proc initialized mempool wrapper
I0806 15:37:18.051698 213749 infer.h:782] model_toolkit_conf.engines(0).name: general_infer_0
I0806 15:37:18.051717 213749 infer.h:74] InferEngineCreationParams: model_path = serving_server, enable_memory_optimization = 1, enable_ir_optimization = 0, static_optimization = 0, force_update_static_cache = 0
I0806 15:37:18.051777 213749 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 15:37:18.060642 213749 analysis_predictor.cc:833] MODEL VERSION: 0.0.0
I0806 15:37:18.060663 213749 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.2
I0806 15:37:18.060945 213749 analysis_predictor.cc:440] ir_optim is turned off, no IR pass will be executed
I0806 15:37:18.277473 213749 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_2 size: 384
I0806 15:37:18.277496 213749 memory_optimize_pass.cc:223] Cluster name : depthwise_conv2d_7.tmp_0 size: 384
I0806 15:37:18.277501 213749 memory_optimize_pass.cc:223] Cluster name : reshape2_2.tmp_0 size: 16
I0806 15:37:18.277505 213749 memory_optimize_pass.cc:223] Cluster name : image size: 12
I0806 15:37:18.277509 213749 memory_optimize_pass.cc:223] Cluster name : batch_norm_21.tmp_1 size: 384
I0806 15:37:18.277513 213749 memory_optimize_pass.cc:223] Cluster name : batch_norm_30.tmp_0 size: 384
I0806 15:37:18.277516 213749 memory_optimize_pass.cc:223] Cluster name : reshape2_3.tmp_0 size: 8
I0806 15:37:18.277520 213749 memory_optimize_pass.cc:223] Cluster name : batch_norm_15.tmp_3 size: 384
I0806 15:37:18.277523 213749 memory_optimize_pass.cc:223] Cluster name : elementwise_add_6.tmp_1 size: 384
I0806 15:37:18.277527 213749 memory_optimize_pass.cc:223] Cluster name : reshape2_4.tmp_0 size: 16
I0806 15:37:18.277530 213749 memory_optimize_pass.cc:223] Cluster name : reshape2_5.tmp_0 size: 16
I0806 15:37:18.299327 213749 analysis_predictor.cc:462] ======= optimize end =======
W0806 15:37:18.300521 213749 infer.h:487] Succ load common model[0x671f800], path[serving_server].
W0806 15:37:18.300546 213749 infer.h:185] Succ load model_data_pathserving_server
W0806 15:37:18.300556 213749 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 15:37:18.300562 213749 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 15:37:18.300570 213749 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 15:37:18.300642 213749 kv_manager.h:70] general_infer_0:
W0806 15:37:18.300649 213749 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
I0806 15:37:18.300865 213749 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0806 15:37:18.300875 213749 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0806 15:37:18.300879 213749 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0806 15:37:18.300894 213749 dag.cpp:158] DAG: workflow1
I0806 15:37:18.300899 213749 dag.cpp:159] , Op Num: 3
I0806 15:37:18.300902 213749 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0806 15:37:18.300906 213749 dag.cpp:164] depends: 0
I0806 15:37:18.300910 213749 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0806 15:37:18.300913 213749 dag.cpp:164] depends: 1
I0806 15:37:18.300917 213749 dag.cpp:168] general_reader_0 0
I0806 15:37:18.300921 213749 dag.cpp:162] , OP-3-general_response_0-GeneralResponseOp
I0806 15:37:18.300925 213749 dag.cpp:164] depends: 1
I0806 15:37:18.300930 213749 dag.cpp:168] general_infer_0 0
I0806 15:37:18.300932 213749 dag.cpp:171]
I0806 15:37:18.300938 213749 manager.h:86] Succ init item:workflow1 from conf:workdir/workflow.prototxt, at:0!
W0806 15:37:18.300992 213749 service.cpp:49] Succ get merger: default for service: GeneralModelService
I0806 15:37:18.301010 213749 service.cpp:61] service[GeneralModelService], enable_map_request_to_workflow[0].
I0806 15:37:18.301023 213749 predictor_metric.h:170] try to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 15:37:18.301297 213749 predictor_metric.h:175] succ to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 15:37:18.301318 213749 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 15:37:18.301348 213749 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 15:37:18.301357 213749 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 15:37:18.301385 213749 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 15:37:18.301395 213749 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 15:37:18.301421 213749 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 15:37:18.301429 213749 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 15:37:18.301456 213749 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 15:37:18.301465 213749 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 15:37:18.301491 213749 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 15:37:18.301497 213749 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 15:37:18.301524 213749 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 15:37:18.301533 213749 service.cpp:126] Succ load infer_service: GeneralModelService!
I0806 15:37:18.301542 213749 manager.h:184] Succ init item:GeneralModelService from conf:workdir/infer_service.prototxt, at:0!
I0806 15:37:18.301775 213817 server.cpp:147] Entrence reload worker, interval_s: 10
I0806 15:37:18.302067 213817 server.cpp:150] Begin reload framework...
W0806 15:37:18.302085 213817 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:37:18.302099 213817 manager.h:131] Finish reload 1 workflow(s)
W0806 15:37:18.304368 213818 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.304457 213818 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.304514 213818 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.304553 213818 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.306993 213818 infer.h:524] td_core[0x7f6e6c004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.307034 213818 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.307044 213818 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.307054 213818 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e6c067570
W0806 15:37:18.307114 213819 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.307148 213819 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.307169 213819 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.307193 213819 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.308980 213819 infer.h:524] td_core[0x7f6e60004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.309002 213819 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.309010 213819 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.309020 213819 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e60067570
W0806 15:37:18.309060 213820 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.309077 213820 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.309096 213820 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.309680 213820 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.311779 213820 infer.h:524] td_core[0x7f6e54004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.311816 213820 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.311836 213820 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.311852 213820 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e54067570
I0806 15:37:18.311910 213749 server.cpp:1037] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is serving on port=12005.
W0806 15:37:18.311955 213821 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.312002 213821 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.312032 213821 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.312079 213821 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 15:37:18.312316 213749 server.cpp:1040] Check out http://yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com:12005 in web browser.
W0806 15:37:18.313676 213821 infer.h:524] td_core[0x7f6e4c004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.313716 213821 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.313725 213821 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.313742 213821 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e4c06b140
W0806 15:37:18.313823 213822 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.313860 213822 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.313896 213822 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.313930 213822 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.315584 213822 infer.h:524] td_core[0x7f6e40004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.315616 213822 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.315624 213822 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.315632 213822 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e4006b140
W0806 15:37:18.315724 213823 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.315748 213823 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.315805 213823 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.315858 213823 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.317441 213823 infer.h:524] td_core[0x7f6e38004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.317476 213823 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.317484 213823 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.317493 213823 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e3806b140
W0806 15:37:18.317553 213824 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.317576 213824 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.317597 213824 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.317618 213824 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.319192 213824 infer.h:524] td_core[0x7f6e0c004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.319228 213824 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.319237 213824 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.319247 213824 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e0c06b140
W0806 15:37:18.319326 213825 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.319352 213825 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.319375 213825 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.319397 213825 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.320974 213825 infer.h:524] td_core[0x7f6e00004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.320998 213825 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.321008 213825 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.321018 213825 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e0006b140
W0806 15:37:18.321060 213826 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.321091 213826 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.321113 213826 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.321135 213826 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.322616 213826 infer.h:524] td_core[0x7f6e2c004a20] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.322638 213826 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.322646 213826 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.322655 213826 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e2c06b140
W0806 15:37:18.322692 213827 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.322721 213827 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.322743 213827 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.322767 213827 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.324208 213827 infer.h:524] td_core[0x7f6e24004a20] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.324225 213827 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.324234 213827 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.324242 213827 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e2406b140
W0806 15:37:18.324287 213828 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.324309 213828 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.324332 213828 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 15:37:18.324353 213828 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 15:37:18.325800 213828 infer.h:524] td_core[0x7f6e18004a20] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.325819 213828 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.325829 213828 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 15:37:18.325837 213828 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f6e1806b140
I0806 15:37:21.712553 213823 general_model_service.pb.cc:2975] remote_side=[127.0.0.1:53476]
I0806 15:37:21.712646 213823 general_model_service.pb.cc:2976] local_side=[127.0.0.1:12005]
I0806 15:37:21.712654 213823 general_model_service.pb.cc:2977] service_name=[GeneralModelService]
I0806 15:37:21.712661 213823 general_model_service.pb.cc:2978] log_id=[0]
I0806 15:37:21.712674 213823 service.cpp:173] enable map request == False
I0806 15:37:21.717833 213823 op.cpp:159] general_reader_0_time=[4002]
I0806 15:37:22.793880 213823 op.cpp:159] general_infer_0_time=[1075995]
I0806 15:37:22.794189 213823 op.cpp:159] general_response_0_time=[47]
I0806 15:37:22.794234 213823 service.cpp:238] workflow total time: 1081558
I0806 15:37:22.794991 213823 general_model_service.pb.cc:2989] tc=[1082446]
I0806 15:37:28.302170 213817 server.cpp:150] Begin reload framework...
W0806 15:37:28.303360 213817 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 15:37:28.303452 213817 manager.h:131] Finish reload 1 workflow(s)
I0806 15:37:29.856223 213749 server.cpp:1095] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is going to quit
I0806 15:37:38.303527 213817 server.cpp:162] Exit reload worker!
W0806 15:37:38.303831 213749 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 15:37:38.303936 213749 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 15:37:38.303953 213749 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-143558.119594 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:35:58
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 14:35:58.982995 119594 resource.cpp:110] Successfully proc initialized mempool wrapper
W0806 14:35:59.226161 119594 infer.h:487] Succ load common model[0x73e1800], path[serving_server].
W0806 14:35:59.226184 119594 infer.h:185] Succ load model_data_pathserving_server
W0806 14:35:59.226194 119594 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 14:35:59.226202 119594 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 14:35:59.226208 119594 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 14:35:59.226281 119594 kv_manager.h:70] general_infer_0:
W0806 14:35:59.226287 119594 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
W0806 14:35:59.226617 119594 service.cpp:49] Succ get merger: default for service: GeneralModelService
W0806 14:35:59.227495 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:35:59.229777 119910 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.229818 119910 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.229908 119910 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.232357 119910 infer.h:524] td_core[0x7ff410004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.232388 119910 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.232398 119910 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.232452 119911 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.232484 119911 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.232506 119911 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.234267 119911 infer.h:524] td_core[0x7ff404004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.234309 119911 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.234318 119911 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.234372 119912 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.234406 119912 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.234468 119912 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.237015 119912 infer.h:524] td_core[0x7ff3fc004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.237056 119912 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.237073 119912 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.237166 119913 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.237293 119913 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.237341 119913 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.238987 119913 infer.h:524] td_core[0x7ff3f0004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.239040 119913 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.239051 119913 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.239130 119914 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.239158 119914 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.239181 119914 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.240805 119914 infer.h:524] td_core[0x7ff3e8004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.240855 119914 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.240876 119914 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.240947 119915 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.240974 119915 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.241281 119915 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.243010 119915 infer.h:524] td_core[0x7ff3dc004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.243083 119915 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.243093 119915 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.243155 119916 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.243180 119916 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.243204 119916 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.244889 119916 infer.h:524] td_core[0x7ff3d0004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.244930 119916 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.244951 119916 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.245100 119917 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.245141 119917 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.245163 119917 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.246835 119917 infer.h:524] td_core[0x7ff3ac004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.246866 119917 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.246876 119917 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.246949 119918 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.246975 119918 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.246999 119918 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.248579 119918 infer.h:524] td_core[0x7ff398004a00] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.248601 119918 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.248610 119918 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.248651 119919 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.248677 119919 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.248698 119919 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.250190 119919 infer.h:524] td_core[0x7ff3cc004a20] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.250210 119919 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.250218 119919 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:35:59.250274 119920 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.250298 119920 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:35:59.250317 119920 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:35:59.251790 119920 infer.h:524] td_core[0x7ff3d4004a20] clone model from pd_core[0x73e1800] succ, cur_idx[0].
W0806 14:35:59.251823 119920 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:35:59.251832 119920 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:36:09.228847 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:36:19.229439 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:36:29.229853 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:36:39.230340 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:36:49.230597 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:36:59.230760 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:37:09.232548 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:37:19.233659 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:37:29.234233 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:37:39.235018 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:37:49.235304 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:37:59.235473 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:38:09.236246 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:38:19.237109 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:38:29.239338 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:38:39.240639 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:38:49.240865 119909 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:38:59.241040 119909 infer.h:673] Succ reload version engine: 18446744073709551615
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-145210.106942 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:52:10
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 14:52:10.966982 106942 resource.cpp:110] Successfully proc initialized mempool wrapper
W0806 14:52:11.271471 106942 infer.h:487] Succ load common model[0x6ccb800], path[serving_server].
W0806 14:52:11.271499 106942 infer.h:185] Succ load model_data_pathserving_server
W0806 14:52:11.271510 106942 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 14:52:11.271518 106942 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 14:52:11.271525 106942 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 14:52:11.271597 106942 kv_manager.h:70] general_infer_0:
W0806 14:52:11.271605 106942 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
W0806 14:52:11.271955 106942 service.cpp:49] Succ get merger: default for service: GeneralModelService
W0806 14:52:11.272738 107002 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:52:11.275002 107003 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.275043 107003 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.275321 107003 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.277890 107003 infer.h:524] td_core[0x7f6a04004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.277915 107003 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.277923 107003 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:52:11.278015 107004 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.278060 107004 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.278085 107004 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.280226 107004 infer.h:524] td_core[0x7f69f8004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.280256 107004 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.280266 107004 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:52:11.280328 107005 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.280501 107005 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.280968 107005 memory.cpp:73] Succ thread initialize mempool wrapper
E0806 14:52:11.281495 106942 server.cpp:929] Fail to listen 0.0.0.0:12005
E0806 14:52:11.286175 106942 server.cpp:95] Failed to start Paddle Inference Server
E0806 14:52:11.286290 106942 pdserving.cpp:221] Failed start server and wait!
W0806 14:52:11.287925 107005 infer.h:524] td_core[0x7f69f0004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.288049 107005 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.288060 107005 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:52:11.288179 107006 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.288208 107006 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:52:11.288231 107006 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:52:11.289176 106942 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 14:52:11.289906 107006 infer.h:524] td_core[0x7f69e4004a00] clone model from pd_core[0x6ccb800] succ, cur_idx[0].
W0806 14:52:11.289921 106942 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 14:52:11.289939 107006 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:52:11.290014 106942 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-152639.78753 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 15:26:39
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 15:26:39.811251 78753 resource.cpp:110] Successfully proc initialized mempool wrapper
W0806 15:26:40.066874 78753 infer.h:487] Succ load common model[0x72be800], path[serving_server].
W0806 15:26:40.066896 78753 infer.h:185] Succ load model_data_pathserving_server
W0806 15:26:40.066906 78753 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 15:26:40.066913 78753 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 15:26:40.066920 78753 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 15:26:40.066992 78753 kv_manager.h:70] general_infer_0:
W0806 15:26:40.066998 78753 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
W0806 15:26:40.067344 78753 service.cpp:49] Succ get merger: default for service: GeneralModelService
W0806 15:26:40.068145 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:26:40.070395 78840 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.070421 78840 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.070459 78840 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.071964 78840 infer.h:524] td_core[0x7ff80c004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.071995 78840 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.072003 78840 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.072075 78841 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.072121 78841 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.072146 78841 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.074611 78841 infer.h:524] td_core[0x7ff800004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.074635 78841 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.074642 78841 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.074693 78842 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.074712 78842 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.074733 78842 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.077550 78842 infer.h:524] td_core[0x7ff7f4004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.077597 78842 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.077608 78842 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.077713 78843 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.077751 78843 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.077783 78843 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.079548 78843 infer.h:524] td_core[0x7ff7ec004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.079599 78843 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.079619 78843 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.079739 78845 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.079782 78845 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.079810 78845 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.082089 78845 infer.h:524] td_core[0x7ff7e0004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.082123 78845 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.082132 78845 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.082198 78846 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.082222 78846 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.082243 78846 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.084091 78846 infer.h:524] td_core[0x7ff7d4004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.084132 78846 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.084142 78846 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.084208 78847 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.084230 78847 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.084256 78847 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.085944 78847 infer.h:524] td_core[0x7ff7a8004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.085985 78847 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.085994 78847 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.086084 78848 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.086325 78848 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.086367 78848 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.088397 78848 infer.h:524] td_core[0x7ff79c004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.088433 78848 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.088443 78848 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.088598 78844 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.088953 78844 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.088991 78844 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.090581 78844 infer.h:524] td_core[0x7ff7d0004a20] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.090620 78844 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.090628 78844 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.090682 78849 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.090716 78849 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.090740 78849 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.092309 78849 infer.h:524] td_core[0x7ff7d8004a20] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.092658 78849 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.092681 78849 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:40.092747 78850 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.092779 78850 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:26:40.092801 78850 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:26:40.094321 78850 infer.h:524] td_core[0x7ff7c0004a00] clone model from pd_core[0x72be800] succ, cur_idx[0].
W0806 15:26:40.099390 78850 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:26:40.099424 78850 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:26:50.068300 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:27:00.068467 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:27:10.069015 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:27:20.069417 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:27:30.070196 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:27:40.070731 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:27:50.071149 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:28:00.071322 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:28:10.071635 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:28:20.072158 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:28:30.072932 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:28:40.073549 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:28:50.073853 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:29:00.074016 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:29:10.074385 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:29:20.075325 78839 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:29:30.076113 78753 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 15:29:30.076478 78753 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 15:29:30.076723 78753 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-153534.188891 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 15:35:34
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 15:35:34.886662 188891 resource.cpp:110] Successfully proc initialized mempool wrapper
W0806 15:35:35.142822 188891 infer.h:487] Succ load common model[0x6266800], path[serving_server].
W0806 15:35:35.142841 188891 infer.h:185] Succ load model_data_pathserving_server
W0806 15:35:35.142851 188891 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 15:35:35.142858 188891 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 15:35:35.142864 188891 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 15:35:35.142933 188891 kv_manager.h:70] general_infer_0:
W0806 15:35:35.142940 188891 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
W0806 15:35:35.143271 188891 service.cpp:49] Succ get merger: default for service: GeneralModelService
W0806 15:35:35.144469 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:35:35.146505 189151 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.146545 189151 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.146737 189151 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.148248 189151 infer.h:524] td_core[0x7fade4004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.148283 189151 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.148290 189151 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.148363 189153 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.148396 189153 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.148418 189153 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.149902 189153 infer.h:524] td_core[0x7fadd8004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.150717 189153 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.150882 189153 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.150938 189155 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.150974 189155 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.151016 189155 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.153961 189155 infer.h:524] td_core[0x7fadd0004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.154050 189155 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.154072 189155 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.154227 189156 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.154254 189156 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.154325 189156 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.156725 189156 infer.h:524] td_core[0x7fadc4004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.156760 189156 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.156776 189156 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.157027 189157 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.157063 189157 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.157083 189157 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.159118 189157 infer.h:524] td_core[0x7fadb8004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.159153 189157 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.159162 189157 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.159222 189158 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.159246 189158 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.159302 189158 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.160917 189158 infer.h:524] td_core[0x7fad8c004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.160979 189158 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.161000 189158 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.161080 189159 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.161113 189159 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.161147 189159 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.162650 189159 infer.h:524] td_core[0x7fadbc004a20] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.162685 189159 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.162694 189159 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.162760 189160 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.162794 189160 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.162815 189160 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.164260 189160 infer.h:524] td_core[0x7fadb4004a20] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.164294 189160 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.164322 189160 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.164376 189161 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.164397 189161 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.164417 189161 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.165877 189161 infer.h:524] td_core[0x7fada0004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.165907 189161 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.165916 189161 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.165971 189162 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.166005 189162 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.166025 189162 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.167418 189162 infer.h:524] td_core[0x7fada4004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.167449 189162 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.167469 189162 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:35.167515 189163 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.167543 189163 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:35:35.167572 189163 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:35:35.169037 189163 infer.h:524] td_core[0x7fada8004a00] clone model from pd_core[0x6266800] succ, cur_idx[0].
W0806 15:35:35.169055 189163 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:35:35.169064 189163 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:35:45.144615 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:35:55.144759 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:36:05.144901 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:36:15.145774 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:36:25.146376 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:36:35.146873 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:36:45.147060 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:36:55.147209 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:37:05.147361 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:37:15.147891 189150 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:37:25.149278 188891 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 15:37:25.149458 188891 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 15:37:25.149477 188891 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-153718.213749 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 15:37:18
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 15:37:18.051189 213749 resource.cpp:110] Successfully proc initialized mempool wrapper
W0806 15:37:18.300521 213749 infer.h:487] Succ load common model[0x671f800], path[serving_server].
W0806 15:37:18.300546 213749 infer.h:185] Succ load model_data_pathserving_server
W0806 15:37:18.300556 213749 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 15:37:18.300562 213749 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 15:37:18.300570 213749 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 15:37:18.300642 213749 kv_manager.h:70] general_infer_0:
W0806 15:37:18.300649 213749 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
W0806 15:37:18.300992 213749 service.cpp:49] Succ get merger: default for service: GeneralModelService
W0806 15:37:18.302085 213817 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:37:18.304368 213818 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.304457 213818 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.304514 213818 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.306993 213818 infer.h:524] td_core[0x7f6e6c004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.307034 213818 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.307044 213818 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.307114 213819 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.307148 213819 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.307169 213819 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.308980 213819 infer.h:524] td_core[0x7f6e60004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.309002 213819 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.309010 213819 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.309060 213820 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.309077 213820 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.309096 213820 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.311779 213820 infer.h:524] td_core[0x7f6e54004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.311816 213820 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.311836 213820 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.311955 213821 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.312002 213821 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.312032 213821 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.313676 213821 infer.h:524] td_core[0x7f6e4c004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.313716 213821 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.313725 213821 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.313823 213822 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.313860 213822 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.313896 213822 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.315584 213822 infer.h:524] td_core[0x7f6e40004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.315616 213822 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.315624 213822 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.315724 213823 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.315748 213823 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.315805 213823 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.317441 213823 infer.h:524] td_core[0x7f6e38004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.317476 213823 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.317484 213823 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.317553 213824 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.317576 213824 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.317597 213824 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.319192 213824 infer.h:524] td_core[0x7f6e0c004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.319228 213824 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.319237 213824 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.319326 213825 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.319352 213825 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.319375 213825 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.320974 213825 infer.h:524] td_core[0x7f6e00004a00] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.320998 213825 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.321008 213825 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.321060 213826 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.321091 213826 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.321113 213826 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.322616 213826 infer.h:524] td_core[0x7f6e2c004a20] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.322638 213826 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.322646 213826 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.322692 213827 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.322721 213827 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.322743 213827 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.324208 213827 infer.h:524] td_core[0x7f6e24004a20] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.324225 213827 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.324234 213827 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:18.324287 213828 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.324309 213828 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 15:37:18.324332 213828 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 15:37:18.325800 213828 infer.h:524] td_core[0x7f6e18004a20] clone model from pd_core[0x671f800] succ, cur_idx[0].
W0806 15:37:18.325819 213828 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 15:37:18.325829 213828 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 15:37:28.303360 213817 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 15:37:38.303831 213749 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 15:37:38.303936 213749 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 15:37:38.303953 213749 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/blazeface/serving_client/serving_client_conf.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
feed_var {
name: "image"
alias_name: "image"
is_lod_tensor: false
feed_type: 1
shape: 3
}
fetch_var {
name: "detection_output_0.tmp_0"
alias_name: "detection_output_0.tmp_0"
is_lod_tensor: true
fetch_type: 1
shape: -1
}
python/examples/grpc_impl_example/blazeface/serving_server/serving_server_conf.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
feed_var {
name: "image"
alias_name: "image"
is_lod_tensor: false
feed_type: 1
shape: 3
}
fetch_var {
name: "detection_output_0.tmp_0"
alias_name: "detection_output_0.tmp_0"
is_lod_tensor: true
fetch_type: 1
shape: -1
}
python/examples/grpc_impl_example/blazeface/test_client.py 0 → 100644
浏览文件 @ 3bc25b2a
# Copyright (c) 2020 PaddlePaddle Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
from paddle_serving_client import Client
from paddle_serving_app.reader import *
import sys
import numpy as np
preprocess = Sequential([
File2Image(),
Normalize([104, 117, 123], [127.502231, 127.502231, 127.502231], False)
])
postprocess = BlazeFacePostprocess("label_list.txt", "output")
client = Client()
client.load_client_config(sys.argv[1])
client.connect(['127.0.0.1:9494'])
im_0 = preprocess(sys.argv[2])
tmp = Transpose((2, 0, 1))
im = tmp(im_0)
fetch_map = client.predict(
feed={"image": im}, fetch=["detection_output_0.tmp_0"])
fetch_map["image"] = sys.argv[2]
fetch_map["im_shape"] = im_0.shape
postprocess(fetch_map)
python/examples/grpc_impl_example/blazeface/workdir/general_model.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
feed_var {
name: "image"
alias_name: "image"
is_lod_tensor: false
feed_type: 1
shape: 3
}
fetch_var {
name: "detection_output_0.tmp_0"
alias_name: "detection_output_0.tmp_0"
is_lod_tensor: true
fetch_type: 1
shape: -1
}
python/examples/grpc_impl_example/blazeface/workdir/infer_service.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
port: 12005
services {
name: "GeneralModelService"
workflows: "workflow1"
}
python/examples/grpc_impl_example/blazeface/workdir/model_toolkit.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
engines {
name: "general_infer_0"
type: "FLUID_CPU_ANALYSIS_DIR"
reloadable_meta: "serving_server/fluid_time_file"
reloadable_type: "timestamp_ne"
model_data_path: "serving_server"
runtime_thread_num: 0
batch_infer_size: 0
enable_batch_align: 0
enable_memory_optimization: true
static_optimization: false
force_update_static_cache: false
enable_ir_optimization: false
}
python/examples/grpc_impl_example/blazeface/workdir/resource.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
model_toolkit_path: "workdir"
model_toolkit_file: "model_toolkit.prototxt"
general_model_path: "workdir"
general_model_file: "general_model.prototxt"
python/examples/grpc_impl_example/blazeface/workdir/workflow.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
workflows {
name: "workflow1"
workflow_type: "Sequence"
nodes {
name: "general_reader_0"
type: "GeneralReaderOp"
}
nodes {
name: "general_infer_0"
type: "GeneralInferOp"
dependencies {
name: "general_reader_0"
mode: "RO"
}
}
nodes {
name: "general_response_0"
type: "GeneralResponseOp"
dependencies {
name: "general_infer_0"
mode: "RO"
}
}
}
python/examples/grpc_impl_example/ocr_detection/log/serving.INFO 0 → 120000
浏览文件 @ 3bc25b2a
serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-142405.198445
\ No newline at end of file
python/examples/grpc_impl_example/ocr_detection/log/serving.WARNING 0 → 120000
浏览文件 @ 3bc25b2a
serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-142405.198445
\ No newline at end of file
python/examples/grpc_impl_example/ocr_detection/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-140237.156478 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:02:37
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 14:02:37.103036 156478 resource.cpp:110] Successfully proc initialized mempool wrapper
I0806 14:02:37.103628 156478 infer.h:782] model_toolkit_conf.engines(0).name: general_infer_0
I0806 14:02:37.103651 156478 infer.h:74] InferEngineCreationParams: model_path = ocr_det_model/, enable_memory_optimization = 1, enable_ir_optimization = 0, static_optimization = 0, force_update_static_cache = 0
I0806 14:02:37.103706 156478 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 14:02:37.116084 156478 analysis_predictor.cc:833] MODEL VERSION: 1.8.1
I0806 14:02:37.116107 156478 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.2
I0806 14:02:37.116448 156478 analysis_predictor.cc:440] ir_optim is turned off, no IR pass will be executed
I0806 14:02:37.370463 156478 memory_optimize_pass.cc:223] Cluster name : conv2d_48.tmp_0 size: 153600
I0806 14:02:37.370486 156478 memory_optimize_pass.cc:223] Cluster name : elementwise_add_7 size: 358400
I0806 14:02:37.370491 156478 memory_optimize_pass.cc:223] Cluster name : nearest_interp_3.tmp_0 size: 2457600
I0806 14:02:37.370496 156478 memory_optimize_pass.cc:223] Cluster name : hard_swish_0.tmp_0 size: 3276800
I0806 14:02:37.370498 156478 memory_optimize_pass.cc:223] Cluster name : image size: 4915200
I0806 14:02:37.370502 156478 memory_optimize_pass.cc:223] Cluster name : elementwise_add_12 size: 9830400
I0806 14:02:37.370507 156478 memory_optimize_pass.cc:223] Cluster name : elementwise_add_10 size: 614400
I0806 14:02:37.370509 156478 memory_optimize_pass.cc:223] Cluster name : batch_norm_4.tmp_2 size: 13107200
I0806 14:02:37.370513 156478 memory_optimize_pass.cc:223] Cluster name : relu_2.tmp_0 size: 13107200
I0806 14:02:37.404268 156478 analysis_predictor.cc:462] ======= optimize end =======
W0806 14:02:37.406005 156478 infer.h:487] Succ load common model[0x5ff1800], path[ocr_det_model/].
W0806 14:02:37.406028 156478 infer.h:185] Succ load model_data_pathocr_det_model/
W0806 14:02:37.406038 156478 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 14:02:37.406044 156478 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 14:02:37.406051 156478 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 14:02:37.406121 156478 kv_manager.h:70] general_infer_0:
W0806 14:02:37.406127 156478 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
I0806 14:02:37.406301 156478 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0806 14:02:37.406311 156478 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0806 14:02:37.406316 156478 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0806 14:02:37.406332 156478 dag.cpp:158] DAG: workflow1
I0806 14:02:37.406335 156478 dag.cpp:159] , Op Num: 3
I0806 14:02:37.406339 156478 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0806 14:02:37.406343 156478 dag.cpp:164] depends: 0
I0806 14:02:37.406347 156478 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0806 14:02:37.406352 156478 dag.cpp:164] depends: 1
I0806 14:02:37.406354 156478 dag.cpp:168] general_reader_0 0
I0806 14:02:37.406358 156478 dag.cpp:162] , OP-3-general_response_0-GeneralResponseOp
I0806 14:02:37.406363 156478 dag.cpp:164] depends: 1
I0806 14:02:37.406366 156478 dag.cpp:168] general_infer_0 0
I0806 14:02:37.406369 156478 dag.cpp:171]
I0806 14:02:37.406374 156478 manager.h:86] Succ init item:workflow1 from conf:workdir/workflow.prototxt, at:0!
W0806 14:02:37.406426 156478 service.cpp:49] Succ get merger: default for service: GeneralModelService
I0806 14:02:37.406443 156478 service.cpp:61] service[GeneralModelService], enable_map_request_to_workflow[0].
I0806 14:02:37.406457 156478 predictor_metric.h:170] try to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 14:02:37.406505 156478 predictor_metric.h:175] succ to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 14:02:37.406721 156478 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 14:02:37.406778 156478 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 14:02:37.406790 156478 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 14:02:37.406819 156478 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 14:02:37.406829 156478 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 14:02:37.406855 156478 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 14:02:37.406863 156478 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 14:02:37.406890 156478 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 14:02:37.406898 156478 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 14:02:37.406922 156478 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 14:02:37.406929 156478 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 14:02:37.406955 156478 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 14:02:37.406962 156478 service.cpp:126] Succ load infer_service: GeneralModelService!
I0806 14:02:37.406970 156478 manager.h:184] Succ init item:GeneralModelService from conf:workdir/infer_service.prototxt, at:0!
I0806 14:02:37.407202 156536 server.cpp:147] Entrence reload worker, interval_s: 10
I0806 14:02:37.407418 156536 server.cpp:150] Begin reload framework...
W0806 14:02:37.407435 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:02:37.407445 156536 manager.h:131] Finish reload 1 workflow(s)
W0806 14:02:37.409699 156537 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.409718 156537 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.409761 156537 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:02:37.409811 156537 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:02:37.412027 156537 infer.h:524] td_core[0x7efcb4004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.412057 156537 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.412066 156537 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:02:37.412073 156537 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7efcb40a10f0
W0806 14:02:37.412127 156538 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.412160 156538 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.412186 156538 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:02:37.412209 156538 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:02:37.414376 156538 infer.h:524] td_core[0x7efca8004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.414394 156538 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.414402 156538 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:02:37.414409 156538 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7efca80a10f0
W0806 14:02:37.414448 156539 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.414461 156539 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.414481 156539 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:02:37.414505 156539 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 14:02:37.416344 156478 server.cpp:1037] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is serving on port=12005.
W0806 14:02:37.417438 156539 infer.h:524] td_core[0x7efc9c004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.417472 156539 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.417488 156539 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:02:37.417497 156539 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7efc9c0050b0
W0806 14:02:37.417553 156540 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.417704 156540 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.417757 156540 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:02:37.417793 156540 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 14:02:37.417870 156478 server.cpp:1040] Check out http://yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com:12005 in web browser.
W0806 14:02:37.419915 156540 infer.h:524] td_core[0x7efc94004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.419946 156540 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.419955 156540 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:02:37.419962 156540 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7efc940050b0
W0806 14:02:37.420040 156541 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.420064 156541 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.420115 156541 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:02:37.420142 156541 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:02:37.422400 156541 infer.h:524] td_core[0x7efc88004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.422433 156541 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.422442 156541 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:02:37.422449 156541 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7efc880050b0
W0806 14:02:37.422505 156542 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.422526 156542 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.422749 156542 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:02:37.422780 156542 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:02:37.425043 156542 infer.h:524] td_core[0x7efc7c004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.425079 156542 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.425088 156542 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:02:37.425097 156542 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7efc7c0050b0
W0806 14:02:37.425153 156543 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.425176 156543 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.425199 156543 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:02:37.425220 156543 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:02:37.427461 156543 infer.h:524] td_core[0x7efc50004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.427484 156543 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.427491 156543 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:02:37.427500 156543 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7efc500050b0
W0806 14:02:37.427541 156544 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.427567 156544 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.427613 156544 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:02:37.427654 156544 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:02:37.429817 156544 infer.h:524] td_core[0x7efc80004a20] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.429838 156544 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.429847 156544 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:02:37.429855 156544 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7efc800050d0
W0806 14:02:37.429898 156545 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.429919 156545 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.429941 156545 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:02:37.429965 156545 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:02:37.432090 156545 infer.h:524] td_core[0x7efc78004a20] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.432108 156545 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.432117 156545 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:02:37.432126 156545 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7efc780050d0
W0806 14:02:37.432155 156546 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.432178 156546 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.432199 156546 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:02:37.432220 156546 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:02:37.434355 156546 infer.h:524] td_core[0x7efc68004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.434373 156546 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.434382 156546 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:02:37.434391 156546 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7efc680050b0
W0806 14:02:37.434429 156547 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.434451 156547 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.434473 156547 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:02:37.434494 156547 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:02:37.436630 156547 infer.h:524] td_core[0x7efc64004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.436662 156547 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.436671 156547 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:02:37.436702 156547 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7efc640050b0
I0806 14:02:47.407516 156536 server.cpp:150] Begin reload framework...
W0806 14:02:47.407585 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:02:47.407603 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:02:57.407671 156536 server.cpp:150] Begin reload framework...
W0806 14:02:57.407722 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:02:57.407739 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:03:07.407783 156536 server.cpp:150] Begin reload framework...
W0806 14:03:07.408761 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:03:07.408960 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:03:17.409039 156536 server.cpp:150] Begin reload framework...
W0806 14:03:17.409281 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:03:17.409462 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:03:27.409544 156536 server.cpp:150] Begin reload framework...
W0806 14:03:27.410604 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:03:27.410805 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:03:37.410890 156536 server.cpp:150] Begin reload framework...
W0806 14:03:37.415237 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:03:37.415333 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:03:47.415410 156536 server.cpp:150] Begin reload framework...
W0806 14:03:47.415473 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:03:47.415491 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:03:57.415565 156536 server.cpp:150] Begin reload framework...
W0806 14:03:57.415637 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:03:57.415654 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:04:07.415737 156536 server.cpp:150] Begin reload framework...
W0806 14:04:07.416664 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:04:07.416908 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:04:17.416985 156536 server.cpp:150] Begin reload framework...
W0806 14:04:17.418031 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:04:17.418262 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:04:27.418344 156536 server.cpp:150] Begin reload framework...
W0806 14:04:27.418583 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:04:27.418908 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:04:37.418995 156536 server.cpp:150] Begin reload framework...
W0806 14:04:37.419210 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:04:37.419287 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:04:47.419365 156536 server.cpp:150] Begin reload framework...
W0806 14:04:47.419431 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:04:47.419450 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:04:57.419520 156536 server.cpp:150] Begin reload framework...
W0806 14:04:57.419589 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:04:57.419606 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:05:07.419679 156536 server.cpp:150] Begin reload framework...
W0806 14:05:07.419908 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:05:07.420078 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:05:17.420157 156536 server.cpp:150] Begin reload framework...
W0806 14:05:17.420564 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:05:17.420625 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:05:27.420699 156536 server.cpp:150] Begin reload framework...
W0806 14:05:27.421170 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:05:27.421254 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:05:37.421339 156536 server.cpp:150] Begin reload framework...
W0806 14:05:37.421972 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:05:37.422061 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:05:47.422142 156536 server.cpp:150] Begin reload framework...
W0806 14:05:47.422217 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:05:47.422236 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:05:57.422305 156536 server.cpp:150] Begin reload framework...
W0806 14:05:57.422369 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:05:57.422384 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:06:07.422466 156536 server.cpp:150] Begin reload framework...
W0806 14:06:07.422853 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:06:07.423043 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:06:17.423123 156536 server.cpp:150] Begin reload framework...
W0806 14:06:17.423410 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:06:17.423642 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:06:27.423735 156536 server.cpp:150] Begin reload framework...
W0806 14:06:27.423972 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:06:27.424049 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:06:37.424125 156536 server.cpp:150] Begin reload framework...
W0806 14:06:37.424383 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:06:37.424482 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:06:47.424564 156536 server.cpp:150] Begin reload framework...
W0806 14:06:47.424626 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:06:47.424646 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:06:57.424721 156536 server.cpp:150] Begin reload framework...
W0806 14:06:57.424785 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:06:57.424804 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:07:07.424881 156536 server.cpp:150] Begin reload framework...
W0806 14:07:07.425130 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:07:07.425333 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:07:17.425410 156536 server.cpp:150] Begin reload framework...
W0806 14:07:17.425923 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:07:17.426025 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:07:27.426110 156536 server.cpp:150] Begin reload framework...
W0806 14:07:27.426560 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:07:27.426640 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:07:37.426710 156536 server.cpp:150] Begin reload framework...
W0806 14:07:37.427246 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:07:37.427347 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:07:47.427429 156536 server.cpp:150] Begin reload framework...
W0806 14:07:47.427496 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:07:47.427513 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:07:57.427587 156536 server.cpp:150] Begin reload framework...
W0806 14:07:57.427654 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:07:57.427671 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:08:07.427743 156536 server.cpp:150] Begin reload framework...
W0806 14:08:07.428156 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:08:07.428344 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:08:17.428423 156536 server.cpp:150] Begin reload framework...
W0806 14:08:17.428987 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:08:17.429075 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:08:27.429160 156536 server.cpp:150] Begin reload framework...
W0806 14:08:27.429641 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:08:27.429723 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:08:37.429783 156536 server.cpp:150] Begin reload framework...
W0806 14:08:37.430028 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:08:37.430132 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:08:47.430217 156536 server.cpp:150] Begin reload framework...
W0806 14:08:47.430279 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:08:47.430296 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:08:57.430371 156536 server.cpp:150] Begin reload framework...
W0806 14:08:57.430434 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:08:57.430454 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:09:07.430531 156536 server.cpp:150] Begin reload framework...
W0806 14:09:07.430938 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:09:07.431118 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:09:17.431196 156536 server.cpp:150] Begin reload framework...
W0806 14:09:17.432104 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:09:17.432193 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:09:27.432276 156536 server.cpp:150] Begin reload framework...
W0806 14:09:27.432746 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:09:27.432915 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:09:37.432993 156536 server.cpp:150] Begin reload framework...
W0806 14:09:37.433378 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:09:37.433470 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:09:47.433545 156536 server.cpp:150] Begin reload framework...
W0806 14:09:47.433604 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:09:47.433622 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:09:57.433691 156536 server.cpp:150] Begin reload framework...
W0806 14:09:57.433737 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:09:57.433753 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:10:07.433781 156536 server.cpp:150] Begin reload framework...
W0806 14:10:07.434521 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:10:07.434710 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:10:17.434782 156536 server.cpp:150] Begin reload framework...
W0806 14:10:17.435451 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:10:17.435637 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:10:27.435860 156536 server.cpp:150] Begin reload framework...
W0806 14:10:27.435983 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:10:27.436175 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:10:37.436255 156536 server.cpp:150] Begin reload framework...
W0806 14:10:37.436888 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:10:37.436970 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:10:47.437044 156536 server.cpp:150] Begin reload framework...
W0806 14:10:47.437104 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:10:47.437124 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:10:57.437196 156536 server.cpp:150] Begin reload framework...
W0806 14:10:57.437255 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:10:57.437273 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:11:07.437345 156536 server.cpp:150] Begin reload framework...
W0806 14:11:07.437703 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:11:07.437903 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:11:17.437988 156536 server.cpp:150] Begin reload framework...
W0806 14:11:17.438475 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:11:17.438674 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:11:27.438756 156536 server.cpp:150] Begin reload framework...
W0806 14:11:27.439246 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:11:27.439465 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:11:37.439550 156536 server.cpp:150] Begin reload framework...
W0806 14:11:37.440121 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:11:37.440225 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:11:47.440304 156536 server.cpp:150] Begin reload framework...
W0806 14:11:47.440408 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:11:47.440426 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:11:57.440498 156536 server.cpp:150] Begin reload framework...
W0806 14:11:57.440562 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:11:57.440577 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:12:07.440647 156536 server.cpp:150] Begin reload framework...
W0806 14:12:07.441253 156536 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:12:07.441473 156536 manager.h:131] Finish reload 1 workflow(s)
I0806 14:12:16.926959 156541 general_model_service.pb.cc:2975] remote_side=[127.0.0.1:30563]
I0806 14:12:16.927906 156541 general_model_service.pb.cc:2976] local_side=[127.0.0.1:12005]
I0806 14:12:16.928133 156541 general_model_service.pb.cc:2977] service_name=[GeneralModelService]
I0806 14:12:16.928154 156541 general_model_service.pb.cc:2978] log_id=[0]
I0806 14:12:16.928179 156541 service.cpp:173] enable map request == False
I0806 14:12:16.931885 156541 op.cpp:159] general_reader_0_time=[2612]
python/examples/grpc_impl_example/ocr_detection/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-142133.169394 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:21:33
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 14:21:33.561388 169394 resource.cpp:110] Successfully proc initialized mempool wrapper
I0806 14:21:33.565100 169394 infer.h:782] model_toolkit_conf.engines(0).name: general_infer_0
I0806 14:21:33.565120 169394 infer.h:74] InferEngineCreationParams: model_path = ocr_det_model/, enable_memory_optimization = 1, enable_ir_optimization = 0, static_optimization = 0, force_update_static_cache = 0
I0806 14:21:33.565174 169394 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 14:21:33.577550 169394 analysis_predictor.cc:833] MODEL VERSION: 1.8.1
I0806 14:21:33.577572 169394 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.2
I0806 14:21:33.577934 169394 analysis_predictor.cc:440] ir_optim is turned off, no IR pass will be executed
I0806 14:21:33.892273 169394 memory_optimize_pass.cc:223] Cluster name : conv2d_48.tmp_0 size: 153600
I0806 14:21:33.892299 169394 memory_optimize_pass.cc:223] Cluster name : elementwise_add_7 size: 358400
I0806 14:21:33.892304 169394 memory_optimize_pass.cc:223] Cluster name : nearest_interp_3.tmp_0 size: 2457600
I0806 14:21:33.892308 169394 memory_optimize_pass.cc:223] Cluster name : hard_swish_0.tmp_0 size: 3276800
I0806 14:21:33.892313 169394 memory_optimize_pass.cc:223] Cluster name : image size: 4915200
I0806 14:21:33.892315 169394 memory_optimize_pass.cc:223] Cluster name : elementwise_add_12 size: 9830400
I0806 14:21:33.892319 169394 memory_optimize_pass.cc:223] Cluster name : elementwise_add_10 size: 614400
I0806 14:21:33.892323 169394 memory_optimize_pass.cc:223] Cluster name : batch_norm_4.tmp_2 size: 13107200
I0806 14:21:33.892326 169394 memory_optimize_pass.cc:223] Cluster name : relu_2.tmp_0 size: 13107200
I0806 14:21:33.926489 169394 analysis_predictor.cc:462] ======= optimize end =======
W0806 14:21:33.928277 169394 infer.h:487] Succ load common model[0x5c11800], path[ocr_det_model/].
W0806 14:21:33.928301 169394 infer.h:185] Succ load model_data_pathocr_det_model/
W0806 14:21:33.928310 169394 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 14:21:33.928318 169394 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 14:21:33.928324 169394 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 14:21:33.928396 169394 kv_manager.h:70] general_infer_0:
W0806 14:21:33.928403 169394 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
I0806 14:21:33.928584 169394 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0806 14:21:33.928593 169394 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0806 14:21:33.928598 169394 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0806 14:21:33.928613 169394 dag.cpp:158] DAG: workflow1
I0806 14:21:33.928618 169394 dag.cpp:159] , Op Num: 3
I0806 14:21:33.928622 169394 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0806 14:21:33.928625 169394 dag.cpp:164] depends: 0
I0806 14:21:33.928629 169394 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0806 14:21:33.928633 169394 dag.cpp:164] depends: 1
I0806 14:21:33.928637 169394 dag.cpp:168] general_reader_0 0
I0806 14:21:33.928642 169394 dag.cpp:162] , OP-3-general_response_0-GeneralResponseOp
I0806 14:21:33.928644 169394 dag.cpp:164] depends: 1
I0806 14:21:33.928648 169394 dag.cpp:168] general_infer_0 0
I0806 14:21:33.928653 169394 dag.cpp:171]
I0806 14:21:33.928658 169394 manager.h:86] Succ init item:workflow1 from conf:workdir/workflow.prototxt, at:0!
W0806 14:21:33.928709 169394 service.cpp:49] Succ get merger: default for service: GeneralModelService
I0806 14:21:33.928728 169394 service.cpp:61] service[GeneralModelService], enable_map_request_to_workflow[0].
I0806 14:21:33.928741 169394 predictor_metric.h:170] try to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 14:21:33.928797 169394 predictor_metric.h:175] succ to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 14:21:33.928915 169394 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 14:21:33.928959 169394 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 14:21:33.928968 169394 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 14:21:33.928997 169394 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 14:21:33.929005 169394 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 14:21:33.929033 169394 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 14:21:33.929039 169394 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 14:21:33.929066 169394 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 14:21:33.929075 169394 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 14:21:33.929101 169394 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 14:21:33.929108 169394 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 14:21:33.929136 169394 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 14:21:33.929142 169394 service.cpp:126] Succ load infer_service: GeneralModelService!
I0806 14:21:33.929150 169394 manager.h:184] Succ init item:GeneralModelService from conf:workdir/infer_service.prototxt, at:0!
I0806 14:21:33.929378 169517 server.cpp:147] Entrence reload worker, interval_s: 10
I0806 14:21:33.929669 169517 server.cpp:150] Begin reload framework...
W0806 14:21:33.929687 169517 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:21:33.929698 169517 manager.h:131] Finish reload 1 workflow(s)
W0806 14:21:33.931915 169518 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.931936 169518 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.931969 169518 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:21:33.932003 169518 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:21:33.934149 169518 infer.h:524] td_core[0x7faa7c004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.934178 169518 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.934187 169518 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:21:33.934195 169518 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7faa7c0a10f0
W0806 14:21:33.934263 169519 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.934316 169519 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.934339 169519 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:21:33.934365 169519 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:21:33.938033 169519 infer.h:524] td_core[0x7faa70004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.938055 169519 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.938064 169519 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:21:33.938072 169519 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7faa700a10f0
W0806 14:21:33.938112 169520 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.938140 169520 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.938160 169520 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:21:33.938686 169520 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 14:21:33.940042 169394 server.cpp:1037] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is serving on port=12005.
W0806 14:21:33.941699 169520 infer.h:524] td_core[0x7faa64004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.941747 169520 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.941757 169520 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:21:33.941774 169520 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7faa640050b0
W0806 14:21:33.941841 169521 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.942000 169521 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.942067 169521 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:21:33.942111 169521 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 14:21:33.942171 169394 server.cpp:1040] Check out http://yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com:12005 in web browser.
W0806 14:21:33.944629 169521 infer.h:524] td_core[0x7faa5c004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.944667 169521 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.944676 169521 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:21:33.944692 169521 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7faa5c0050b0
W0806 14:21:33.944751 169522 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.944778 169522 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.944841 169522 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:21:33.944869 169522 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:21:33.947472 169522 infer.h:524] td_core[0x7faa50004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.947507 169522 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.947515 169522 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:21:33.947523 169522 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7faa500050b0
W0806 14:21:33.947585 169523 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.947607 169523 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.947682 169523 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:21:33.947717 169523 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:21:33.950073 169523 infer.h:524] td_core[0x7faa44004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.950104 169523 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.950114 169523 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:21:33.950122 169523 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7faa440050b0
W0806 14:21:33.950197 169524 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.950220 169524 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.950242 169524 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:21:33.950263 169524 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:21:33.952616 169524 infer.h:524] td_core[0x7faa10004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.952636 169524 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.952646 169524 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:21:33.952654 169524 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7faa100050b0
W0806 14:21:33.952703 169525 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.952728 169525 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.952780 169525 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:21:33.952813 169525 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:21:33.955030 169525 infer.h:524] td_core[0x7faa40004a20] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.955049 169525 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.955057 169525 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:21:33.955066 169525 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7faa400050d0
W0806 14:21:33.955103 169526 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.955125 169526 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.955147 169526 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:21:33.955168 169526 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:21:33.957363 169526 infer.h:524] td_core[0x7faa48004a20] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.957391 169526 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.957401 169526 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:21:33.957409 169526 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7faa480050d0
W0806 14:21:33.957448 169527 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.957470 169527 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.957490 169527 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:21:33.957511 169527 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:21:33.959684 169527 infer.h:524] td_core[0x7faa28004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.959703 169527 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.959712 169527 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:21:33.959720 169527 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7faa280050b0
W0806 14:21:33.959769 169528 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.959795 169528 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.959815 169528 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:21:33.959836 169528 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:21:33.962010 169528 infer.h:524] td_core[0x7faa2c004a20] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.962029 169528 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.962038 169528 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:21:33.962047 169528 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7faa2c0050d0
I0806 14:21:41.554998 169527 general_model_service.pb.cc:2975] remote_side=[127.0.0.1:38891]
I0806 14:21:41.555081 169527 general_model_service.pb.cc:2976] local_side=[127.0.0.1:12005]
I0806 14:21:41.555091 169527 general_model_service.pb.cc:2977] service_name=[GeneralModelService]
I0806 14:21:41.555097 169527 general_model_service.pb.cc:2978] log_id=[0]
I0806 14:21:41.555112 169527 service.cpp:173] enable map request == False
I0806 14:21:41.559579 169527 op.cpp:159] general_reader_0_time=[3267]
I0806 14:21:42.274166 169527 op.cpp:159] general_infer_0_time=[714541]
I0806 14:21:42.278558 169527 op.cpp:159] general_response_0_time=[4299]
I0806 14:21:42.282722 169527 service.cpp:238] workflow total time: 727600
I0806 14:21:42.284122 169527 general_model_service.pb.cc:2989] tc=[729132]
I0806 14:21:43.929775 169517 server.cpp:150] Begin reload framework...
W0806 14:21:43.929842 169517 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:21:43.929860 169517 manager.h:131] Finish reload 1 workflow(s)
I0806 14:21:53.929966 169517 server.cpp:150] Begin reload framework...
W0806 14:21:53.930084 169517 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:21:53.930104 169517 manager.h:131] Finish reload 1 workflow(s)
I0806 14:22:03.930176 169517 server.cpp:150] Begin reload framework...
W0806 14:22:03.930234 169517 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:22:03.930253 169517 manager.h:131] Finish reload 1 workflow(s)
I0806 14:22:13.930325 169517 server.cpp:150] Begin reload framework...
W0806 14:22:13.931341 169517 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:22:13.931527 169517 manager.h:131] Finish reload 1 workflow(s)
I0806 14:22:16.326835 169394 server.cpp:1095] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is going to quit
I0806 14:22:23.931602 169517 server.cpp:162] Exit reload worker!
W0806 14:22:23.932060 169394 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 14:22:23.932267 169394 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 14:22:23.932287 169394 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/ocr_detection/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.INFO.20200806-142405.198445 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:24:05
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 14:24:05.644876 198445 resource.cpp:110] Successfully proc initialized mempool wrapper
I0806 14:24:05.645656 198445 infer.h:782] model_toolkit_conf.engines(0).name: general_infer_0
I0806 14:24:05.645678 198445 infer.h:74] InferEngineCreationParams: model_path = ocr_det_model/, enable_memory_optimization = 1, enable_ir_optimization = 0, static_optimization = 0, force_update_static_cache = 0
I0806 14:24:05.645731 198445 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 14:24:05.658001 198445 analysis_predictor.cc:833] MODEL VERSION: 1.8.1
I0806 14:24:05.658022 198445 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.2
I0806 14:24:05.658363 198445 analysis_predictor.cc:440] ir_optim is turned off, no IR pass will be executed
I0806 14:24:05.914120 198445 memory_optimize_pass.cc:223] Cluster name : conv2d_48.tmp_0 size: 153600
I0806 14:24:05.914149 198445 memory_optimize_pass.cc:223] Cluster name : elementwise_add_7 size: 358400
I0806 14:24:05.914153 198445 memory_optimize_pass.cc:223] Cluster name : nearest_interp_3.tmp_0 size: 2457600
I0806 14:24:05.914157 198445 memory_optimize_pass.cc:223] Cluster name : hard_swish_0.tmp_0 size: 3276800
I0806 14:24:05.914161 198445 memory_optimize_pass.cc:223] Cluster name : image size: 4915200
I0806 14:24:05.914165 198445 memory_optimize_pass.cc:223] Cluster name : elementwise_add_12 size: 9830400
I0806 14:24:05.914168 198445 memory_optimize_pass.cc:223] Cluster name : elementwise_add_10 size: 614400
I0806 14:24:05.914172 198445 memory_optimize_pass.cc:223] Cluster name : batch_norm_4.tmp_2 size: 13107200
I0806 14:24:05.914175 198445 memory_optimize_pass.cc:223] Cluster name : relu_2.tmp_0 size: 13107200
I0806 14:24:05.948047 198445 analysis_predictor.cc:462] ======= optimize end =======
W0806 14:24:05.949836 198445 infer.h:487] Succ load common model[0x7057800], path[ocr_det_model/].
W0806 14:24:05.949858 198445 infer.h:185] Succ load model_data_pathocr_det_model/
W0806 14:24:05.949868 198445 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 14:24:05.949874 198445 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 14:24:05.949882 198445 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 14:24:05.949959 198445 kv_manager.h:70] general_infer_0:
W0806 14:24:05.949965 198445 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
I0806 14:24:05.950152 198445 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0806 14:24:05.950162 198445 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0806 14:24:05.950166 198445 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0806 14:24:05.950182 198445 dag.cpp:158] DAG: workflow1
I0806 14:24:05.950186 198445 dag.cpp:159] , Op Num: 3
I0806 14:24:05.950191 198445 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0806 14:24:05.950194 198445 dag.cpp:164] depends: 0
I0806 14:24:05.950198 198445 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0806 14:24:05.950202 198445 dag.cpp:164] depends: 1
I0806 14:24:05.950206 198445 dag.cpp:168] general_reader_0 0
I0806 14:24:05.950209 198445 dag.cpp:162] , OP-3-general_response_0-GeneralResponseOp
I0806 14:24:05.950213 198445 dag.cpp:164] depends: 1
I0806 14:24:05.950217 198445 dag.cpp:168] general_infer_0 0
I0806 14:24:05.950220 198445 dag.cpp:171]
I0806 14:24:05.950225 198445 manager.h:86] Succ init item:workflow1 from conf:workdir/workflow.prototxt, at:0!
W0806 14:24:05.950281 198445 service.cpp:49] Succ get merger: default for service: GeneralModelService
I0806 14:24:05.950299 198445 service.cpp:61] service[GeneralModelService], enable_map_request_to_workflow[0].
I0806 14:24:05.950312 198445 predictor_metric.h:170] try to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 14:24:05.950366 198445 predictor_metric.h:175] succ to regist latency metric[workflow_GeneralModelService_workflow1].
I0806 14:24:05.950460 198445 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 14:24:05.950492 198445 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_0].
I0806 14:24:05.950500 198445 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 14:24:05.950527 198445 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0806 14:24:05.950536 198445 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 14:24:05.950562 198445 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_1].
I0806 14:24:05.950567 198445 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 14:24:05.950594 198445 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0806 14:24:05.950601 198445 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 14:24:05.950626 198445 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_2].
I0806 14:24:05.950632 198445 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 14:24:05.950659 198445 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0806 14:24:05.950664 198445 service.cpp:126] Succ load infer_service: GeneralModelService!
I0806 14:24:05.950671 198445 manager.h:184] Succ init item:GeneralModelService from conf:workdir/infer_service.prototxt, at:0!
I0806 14:24:05.950911 198513 server.cpp:147] Entrence reload worker, interval_s: 10
I0806 14:24:05.951179 198513 server.cpp:150] Begin reload framework...
W0806 14:24:05.951198 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:24:05.951211 198513 manager.h:131] Finish reload 1 workflow(s)
W0806 14:24:05.953459 198514 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.953542 198514 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.953588 198514 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:24:05.953640 198514 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:24:05.957310 198514 infer.h:524] td_core[0x7fb028004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.957342 198514 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.957352 198514 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:24:05.957360 198514 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fb0280a10f0
W0806 14:24:05.957420 198515 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.957453 198515 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.957475 198515 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:24:05.957499 198515 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:24:05.960199 198515 infer.h:524] td_core[0x7fb01c004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.960220 198515 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.960229 198515 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:24:05.960237 198515 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fb01c0a10f0
W0806 14:24:05.960278 198516 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.960292 198516 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.960310 198516 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:24:05.960330 198516 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 14:24:05.962174 198445 server.cpp:1037] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is serving on port=12005.
W0806 14:24:05.963593 198516 infer.h:524] td_core[0x7fb014004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.963636 198516 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.963654 198516 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:24:05.963665 198516 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fb0140050b0
W0806 14:24:05.963747 198517 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.963912 198517 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.963973 198517 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:24:05.963996 198517 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0806 14:24:05.964088 198445 server.cpp:1040] Check out http://yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com:12005 in web browser.
W0806 14:24:05.966516 198517 infer.h:524] td_core[0x7fb008004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.966554 198517 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.966563 198517 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:24:05.966580 198517 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fb0080050b0
W0806 14:24:05.966651 198518 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.966675 198518 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.966732 198518 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:24:05.966766 198518 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:24:05.969388 198518 infer.h:524] td_core[0x7fb000004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.969422 198518 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.969430 198518 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:24:05.969439 198518 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fb0000050b0
W0806 14:24:05.969485 198519 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.969504 198519 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.969548 198519 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:24:05.969581 198519 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:24:05.972041 198519 infer.h:524] td_core[0x7faff0004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.972076 198519 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.972086 198519 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:24:05.972095 198519 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7faff00050b0
W0806 14:24:05.972159 198520 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.972182 198520 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.972204 198520 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:24:05.972225 198520 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:24:05.974644 198520 infer.h:524] td_core[0x7fafc8004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.974678 198520 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.974689 198520 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:24:05.974696 198520 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fafc80050b0
W0806 14:24:05.974726 198521 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.974750 198521 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.974798 198521 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:24:05.974831 198521 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:24:05.977105 198521 infer.h:524] td_core[0x7faff4004a20] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.977124 198521 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.977133 198521 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:24:05.977142 198521 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7faff40050d0
W0806 14:24:05.977171 198522 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.977195 198522 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.977216 198522 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:24:05.977237 198522 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:24:05.979465 198522 infer.h:524] td_core[0x7fafec004a20] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.979485 198522 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.979493 198522 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:24:05.979501 198522 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fafec0050d0
W0806 14:24:05.979530 198523 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.979553 198523 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.979573 198523 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:24:05.979594 198523 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:24:05.981830 198523 infer.h:524] td_core[0x7fafd4004a20] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.981849 198523 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.981858 198523 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:24:05.981866 198523 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fafd40050d0
W0806 14:24:05.981906 198524 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.981928 198524 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.981950 198524 memory.cpp:73] Succ thread initialize mempool wrapper
I0806 14:24:05.981969 198524 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0806 14:24:05.984169 198524 infer.h:524] td_core[0x7fafe4004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.984189 198524 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.984197 198524 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0806 14:24:05.984206 198524 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7fafe40050b0
I0806 14:24:15.035326 198518 general_model_service.pb.cc:2975] remote_side=[127.0.0.1:40931]
I0806 14:24:15.035548 198518 general_model_service.pb.cc:2976] local_side=[127.0.0.1:12005]
I0806 14:24:15.035559 198518 general_model_service.pb.cc:2977] service_name=[GeneralModelService]
I0806 14:24:15.035567 198518 general_model_service.pb.cc:2978] log_id=[0]
I0806 14:24:15.035579 198518 service.cpp:173] enable map request == False
I0806 14:24:15.040182 198518 op.cpp:159] general_reader_0_time=[3547]
I0806 14:24:15.805876 198518 op.cpp:159] general_infer_0_time=[765621]
I0806 14:24:15.810362 198518 op.cpp:159] general_response_0_time=[4397]
I0806 14:24:15.814441 198518 service.cpp:238] workflow total time: 778851
I0806 14:24:15.816313 198518 general_model_service.pb.cc:2989] tc=[780993]
I0806 14:24:15.951282 198513 server.cpp:150] Begin reload framework...
W0806 14:24:15.952162 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:24:15.952359 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:24:25.952456 198513 server.cpp:150] Begin reload framework...
W0806 14:24:25.952745 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:24:25.952962 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:24:35.953038 198513 server.cpp:150] Begin reload framework...
W0806 14:24:35.953555 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:24:35.953747 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:24:45.953836 198513 server.cpp:150] Begin reload framework...
W0806 14:24:45.955035 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:24:45.955348 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:24:55.955622 198513 server.cpp:150] Begin reload framework...
W0806 14:24:55.955703 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:24:55.955720 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:25:05.955783 198513 server.cpp:150] Begin reload framework...
W0806 14:25:05.955845 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:25:05.955864 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:25:15.955938 198513 server.cpp:150] Begin reload framework...
W0806 14:25:15.957168 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:25:15.957366 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:25:25.957442 198513 server.cpp:150] Begin reload framework...
W0806 14:25:25.957669 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:25:25.957871 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:25:35.957952 198513 server.cpp:150] Begin reload framework...
W0806 14:25:35.959995 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:25:35.960585 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:25:45.960738 198513 server.cpp:150] Begin reload framework...
W0806 14:25:45.960815 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:25:45.960837 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:25:49.479151 198515 general_model_service.pb.cc:2975] remote_side=[127.0.0.1:42392]
I0806 14:25:49.479259 198515 general_model_service.pb.cc:2976] local_side=[127.0.0.1:12005]
I0806 14:25:49.479269 198515 general_model_service.pb.cc:2977] service_name=[GeneralModelService]
I0806 14:25:49.479275 198515 general_model_service.pb.cc:2978] log_id=[0]
I0806 14:25:49.479285 198515 service.cpp:173] enable map request == False
I0806 14:25:49.480275 198515 op.cpp:159] general_reader_0_time=[941]
I0806 14:25:50.139209 198515 op.cpp:159] general_infer_0_time=[658907]
I0806 14:25:50.143543 198515 op.cpp:159] general_response_0_time=[4227]
I0806 14:25:50.147944 198515 service.cpp:238] workflow total time: 668652
I0806 14:25:50.147997 198515 general_model_service.pb.cc:2989] tc=[668856]
I0806 14:25:55.960907 198513 server.cpp:150] Begin reload framework...
W0806 14:25:55.960981 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:25:55.960999 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:26:05.961071 198513 server.cpp:150] Begin reload framework...
W0806 14:26:05.961141 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:26:05.961159 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:26:15.961232 198513 server.cpp:150] Begin reload framework...
W0806 14:26:15.962246 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:26:15.962424 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:26:25.962500 198513 server.cpp:150] Begin reload framework...
W0806 14:26:25.962945 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:26:25.963145 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:26:35.963685 198513 server.cpp:150] Begin reload framework...
W0806 14:26:35.964130 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:26:35.964304 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:26:45.964615 198513 server.cpp:150] Begin reload framework...
W0806 14:26:45.964679 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:26:45.964699 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:26:55.964777 198513 server.cpp:150] Begin reload framework...
W0806 14:26:55.964860 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:26:55.964881 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:27:05.964956 198513 server.cpp:150] Begin reload framework...
W0806 14:27:05.965042 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:27:05.965059 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:27:15.965133 198513 server.cpp:150] Begin reload framework...
W0806 14:27:15.965865 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:27:15.965962 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:27:25.966430 198513 server.cpp:150] Begin reload framework...
W0806 14:27:25.966964 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:27:25.967144 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:27:35.967221 198513 server.cpp:150] Begin reload framework...
W0806 14:27:35.968348 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:27:35.968575 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:27:45.968648 198513 server.cpp:150] Begin reload framework...
W0806 14:27:45.968715 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:27:45.968732 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:27:55.968776 198513 server.cpp:150] Begin reload framework...
W0806 14:27:55.971711 198513 infer.h:673] Succ reload version engine: 18446744073709551615
I0806 14:27:55.971742 198513 manager.h:131] Finish reload 1 workflow(s)
I0806 14:28:03.190059 198445 server.cpp:1095] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is going to quit
I0806 14:28:05.971779 198513 server.cpp:162] Exit reload worker!
W0806 14:28:05.972167 198445 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 14:28:05.972218 198445 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 14:28:05.972232 198445 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/ocr_detection/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-140237.156478 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:02:37
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 14:02:37.103036 156478 resource.cpp:110] Successfully proc initialized mempool wrapper
W0806 14:02:37.406005 156478 infer.h:487] Succ load common model[0x5ff1800], path[ocr_det_model/].
W0806 14:02:37.406028 156478 infer.h:185] Succ load model_data_pathocr_det_model/
W0806 14:02:37.406038 156478 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 14:02:37.406044 156478 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 14:02:37.406051 156478 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 14:02:37.406121 156478 kv_manager.h:70] general_infer_0:
W0806 14:02:37.406127 156478 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
W0806 14:02:37.406426 156478 service.cpp:49] Succ get merger: default for service: GeneralModelService
W0806 14:02:37.407435 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:02:37.409699 156537 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.409718 156537 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.409761 156537 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.412027 156537 infer.h:524] td_core[0x7efcb4004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.412057 156537 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.412066 156537 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:02:37.412127 156538 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.412160 156538 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.412186 156538 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.414376 156538 infer.h:524] td_core[0x7efca8004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.414394 156538 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.414402 156538 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:02:37.414448 156539 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.414461 156539 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.414481 156539 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.417438 156539 infer.h:524] td_core[0x7efc9c004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.417472 156539 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.417488 156539 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:02:37.417553 156540 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.417704 156540 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.417757 156540 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.419915 156540 infer.h:524] td_core[0x7efc94004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.419946 156540 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.419955 156540 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:02:37.420040 156541 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.420064 156541 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.420115 156541 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.422400 156541 infer.h:524] td_core[0x7efc88004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.422433 156541 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.422442 156541 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:02:37.422505 156542 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.422526 156542 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.422749 156542 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.425043 156542 infer.h:524] td_core[0x7efc7c004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.425079 156542 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.425088 156542 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:02:37.425153 156543 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.425176 156543 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.425199 156543 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.427461 156543 infer.h:524] td_core[0x7efc50004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.427484 156543 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.427491 156543 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:02:37.427541 156544 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.427567 156544 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.427613 156544 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.429817 156544 infer.h:524] td_core[0x7efc80004a20] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.429838 156544 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.429847 156544 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:02:37.429898 156545 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.429919 156545 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.429941 156545 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.432090 156545 infer.h:524] td_core[0x7efc78004a20] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.432108 156545 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.432117 156545 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:02:37.432155 156546 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.432178 156546 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.432199 156546 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.434355 156546 infer.h:524] td_core[0x7efc68004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.434373 156546 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.434382 156546 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:02:37.434429 156547 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.434451 156547 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:02:37.434473 156547 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:02:37.436630 156547 infer.h:524] td_core[0x7efc64004a00] clone model from pd_core[0x5ff1800] succ, cur_idx[0].
W0806 14:02:37.436662 156547 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:02:37.436671 156547 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:02:47.407585 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:02:57.407722 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:03:07.408761 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:03:17.409281 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:03:27.410604 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:03:37.415237 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:03:47.415473 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:03:57.415637 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:04:07.416664 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:04:17.418031 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:04:27.418583 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:04:37.419210 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:04:47.419431 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:04:57.419589 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:05:07.419908 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:05:17.420564 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:05:27.421170 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:05:37.421972 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:05:47.422217 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:05:57.422369 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:06:07.422853 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:06:17.423410 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:06:27.423972 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:06:37.424383 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:06:47.424626 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:06:57.424785 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:07:07.425130 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:07:17.425923 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:07:27.426560 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:07:37.427246 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:07:47.427496 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:07:57.427654 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:08:07.428156 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:08:17.428987 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:08:27.429641 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:08:37.430028 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:08:47.430279 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:08:57.430434 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:09:07.430938 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:09:17.432104 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:09:27.432746 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:09:37.433378 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:09:47.433604 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:09:57.433737 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:10:07.434521 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:10:17.435451 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:10:27.435983 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:10:37.436888 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:10:47.437104 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:10:57.437255 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:11:07.437703 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:11:17.438475 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:11:27.439246 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:11:37.440121 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:11:47.440408 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:11:57.440562 156536 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:12:07.441253 156536 infer.h:673] Succ reload version engine: 18446744073709551615
python/examples/grpc_impl_example/ocr_detection/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-142133.169394 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:21:33
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 14:21:33.561388 169394 resource.cpp:110] Successfully proc initialized mempool wrapper
W0806 14:21:33.928277 169394 infer.h:487] Succ load common model[0x5c11800], path[ocr_det_model/].
W0806 14:21:33.928301 169394 infer.h:185] Succ load model_data_pathocr_det_model/
W0806 14:21:33.928310 169394 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 14:21:33.928318 169394 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 14:21:33.928324 169394 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 14:21:33.928396 169394 kv_manager.h:70] general_infer_0:
W0806 14:21:33.928403 169394 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
W0806 14:21:33.928709 169394 service.cpp:49] Succ get merger: default for service: GeneralModelService
W0806 14:21:33.929687 169517 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:21:33.931915 169518 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.931936 169518 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.931969 169518 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.934149 169518 infer.h:524] td_core[0x7faa7c004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.934178 169518 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.934187 169518 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:21:33.934263 169519 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.934316 169519 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.934339 169519 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.938033 169519 infer.h:524] td_core[0x7faa70004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.938055 169519 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.938064 169519 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:21:33.938112 169520 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.938140 169520 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.938160 169520 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.941699 169520 infer.h:524] td_core[0x7faa64004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.941747 169520 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.941757 169520 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:21:33.941841 169521 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.942000 169521 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.942067 169521 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.944629 169521 infer.h:524] td_core[0x7faa5c004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.944667 169521 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.944676 169521 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:21:33.944751 169522 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.944778 169522 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.944841 169522 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.947472 169522 infer.h:524] td_core[0x7faa50004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.947507 169522 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.947515 169522 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:21:33.947585 169523 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.947607 169523 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.947682 169523 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.950073 169523 infer.h:524] td_core[0x7faa44004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.950104 169523 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.950114 169523 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:21:33.950197 169524 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.950220 169524 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.950242 169524 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.952616 169524 infer.h:524] td_core[0x7faa10004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.952636 169524 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.952646 169524 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:21:33.952703 169525 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.952728 169525 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.952780 169525 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.955030 169525 infer.h:524] td_core[0x7faa40004a20] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.955049 169525 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.955057 169525 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:21:33.955103 169526 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.955125 169526 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.955147 169526 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.957363 169526 infer.h:524] td_core[0x7faa48004a20] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.957391 169526 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.957401 169526 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:21:33.957448 169527 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.957470 169527 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.957490 169527 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.959684 169527 infer.h:524] td_core[0x7faa28004a00] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.959703 169527 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.959712 169527 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:21:33.959769 169528 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.959795 169528 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:21:33.959815 169528 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:21:33.962010 169528 infer.h:524] td_core[0x7faa2c004a20] clone model from pd_core[0x5c11800] succ, cur_idx[0].
W0806 14:21:33.962029 169528 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:21:33.962038 169528 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:21:43.929842 169517 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:21:53.930084 169517 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:22:03.930234 169517 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:22:13.931341 169517 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:22:23.932060 169394 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 14:22:23.932267 169394 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 14:22:23.932287 169394 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/ocr_detection/log/serving.yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com.wangjiawei04.log.WARNING.20200806-142405.198445 0 → 100644
浏览文件 @ 3bc25b2a
Log file created at: 2020/08/06 14:24:05
Running on machine: yq01-sys-hic-v100-box-a225-0264.yq01.baidu.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0806 14:24:05.644876 198445 resource.cpp:110] Successfully proc initialized mempool wrapper
W0806 14:24:05.949836 198445 infer.h:487] Succ load common model[0x7057800], path[ocr_det_model/].
W0806 14:24:05.949858 198445 infer.h:185] Succ load model_data_pathocr_det_model/
W0806 14:24:05.949868 198445 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0806 14:24:05.949874 198445 infer.h:594] Succ proc initialize engine: general_infer_0
W0806 14:24:05.949882 198445 infer.h:799] Succ proc initialize engine: general_infer_0
W0806 14:24:05.949959 198445 kv_manager.h:70] general_infer_0:
W0806 14:24:05.949965 198445 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
W0806 14:24:05.950281 198445 service.cpp:49] Succ get merger: default for service: GeneralModelService
W0806 14:24:05.951198 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:24:05.953459 198514 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.953542 198514 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.953588 198514 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.957310 198514 infer.h:524] td_core[0x7fb028004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.957342 198514 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.957352 198514 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:24:05.957420 198515 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.957453 198515 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.957475 198515 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.960199 198515 infer.h:524] td_core[0x7fb01c004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.960220 198515 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.960229 198515 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:24:05.960278 198516 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.960292 198516 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.960310 198516 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.963593 198516 infer.h:524] td_core[0x7fb014004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.963636 198516 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.963654 198516 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:24:05.963747 198517 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.963912 198517 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.963973 198517 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.966516 198517 infer.h:524] td_core[0x7fb008004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.966554 198517 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.966563 198517 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:24:05.966651 198518 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.966675 198518 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.966732 198518 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.969388 198518 infer.h:524] td_core[0x7fb000004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.969422 198518 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.969430 198518 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:24:05.969485 198519 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.969504 198519 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.969548 198519 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.972041 198519 infer.h:524] td_core[0x7faff0004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.972076 198519 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.972086 198519 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:24:05.972159 198520 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.972182 198520 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.972204 198520 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.974644 198520 infer.h:524] td_core[0x7fafc8004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.974678 198520 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.974689 198520 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:24:05.974726 198521 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.974750 198521 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.974798 198521 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.977105 198521 infer.h:524] td_core[0x7faff4004a20] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.977124 198521 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.977133 198521 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:24:05.977171 198522 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.977195 198522 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.977216 198522 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.979465 198522 infer.h:524] td_core[0x7fafec004a20] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.979485 198522 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.979493 198522 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:24:05.979530 198523 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.979553 198523 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.979573 198523 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.981830 198523 infer.h:524] td_core[0x7fafd4004a20] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.981849 198523 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.981858 198523 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:24:05.981906 198524 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.981928 198524 resource.cpp:279] Successfully thread initialized mempool wrapper
W0806 14:24:05.981950 198524 memory.cpp:73] Succ thread initialize mempool wrapper
W0806 14:24:05.984169 198524 infer.h:524] td_core[0x7fafe4004a00] clone model from pd_core[0x7057800] succ, cur_idx[0].
W0806 14:24:05.984189 198524 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0806 14:24:05.984197 198524 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0806 14:24:15.952162 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:24:25.952745 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:24:35.953555 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:24:45.955035 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:24:55.955703 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:25:05.955845 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:25:15.957168 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:25:25.957669 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:25:35.959995 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:25:45.960815 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:25:55.960981 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:26:05.961141 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:26:15.962246 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:26:25.962945 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:26:35.964130 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:26:45.964679 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:26:55.964860 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:27:05.965042 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:27:15.965865 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:27:25.966964 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:27:35.968348 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:27:45.968715 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:27:55.971711 198513 infer.h:673] Succ reload version engine: 18446744073709551615
W0806 14:28:05.972167 198445 infer.h:630] Succ proc finalize version engine: 18446744073709551615
W0806 14:28:05.972218 198445 infer.h:852] Succ proc finalize engine, name: general_infer_0
W0806 14:28:05.972232 198445 cube_api.cpp:111] Destroy, cube meta is null
python/examples/grpc_impl_example/ocr_detection/ocr_det_client/serving_client_conf.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
feed_var {
name: "image"
alias_name: "image"
is_lod_tensor: false
feed_type: 1
shape: 3
shape: 640
shape: 640
}
fetch_var {
name: "concat_1.tmp_0"
alias_name: "concat_1.tmp_0"
is_lod_tensor: false
fetch_type: 1
shape: 3
shape: 640
shape: 640
}
python/examples/grpc_impl_example/ocr_detection/ocr_det_model/serving_server_conf.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
feed_var {
name: "image"
alias_name: "image"
is_lod_tensor: false
feed_type: 1
shape: 3
shape: 640
shape: 640
}
fetch_var {
name: "concat_1.tmp_0"
alias_name: "concat_1.tmp_0"
is_lod_tensor: false
fetch_type: 1
shape: 3
shape: 640
shape: 640
}
python/examples/grpc_impl_example/ocr_detection/text_det_client.py 0 → 100644
浏览文件 @ 3bc25b2a
import os
from paddle_serving_client import MultiLangClient as Client
from paddle_serving_app.reader import Sequential, File2Image, ResizeByFactor
from paddle_serving_app.reader import Div, Normalize, Transpose
from paddle_serving_app.reader import DBPostProcess, FilterBoxes
client = Client()
client.connect(["127.0.0.1:9393"])
read_image_file = File2Image()
preprocess = Sequential(
[ResizeByFactor(32, 960), Div(255),
Normalize([0.485, 0.456, 0.406], [0.229, 0.224, 0.225]),
Transpose((2, 0, 1))])
post_func = DBPostProcess(
{"thresh": 0.3, "box_thresh": 0.5,
"max_candidates": 1000, "unclip_ratio": 1.5,
"min_size": 3})
filter_func = FilterBoxes(10, 10)
name = "7.jpg"
img = read_image_file(name)
ori_h, ori_w, _ = img.shape
img = preprocess(img)
new_h, new_w, _ = img.shape
ratio_list = [float(new_h) / ori_h, float(new_w) / ori_w]
outputs = client.predict(feed={"image": img}, fetch=["concat_1.tmp_0"], batch=True)
dt_boxes_list = post_func(outputs["concat_1.tmp_0"], [ratio_list])
dt_boxes = filter_func(dt_boxes_list[0], [ori_h, ori_w])
python/examples/grpc_impl_example/ocr_detection/workdir/general_model.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
feed_var {
name: "image"
alias_name: "image"
is_lod_tensor: false
feed_type: 1
shape: 3
shape: 640
shape: 640
}
fetch_var {
name: "concat_1.tmp_0"
alias_name: "concat_1.tmp_0"
is_lod_tensor: false
fetch_type: 1
shape: 3
shape: 640
shape: 640
}
python/examples/grpc_impl_example/ocr_detection/workdir/infer_service.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
port: 12005
services {
name: "GeneralModelService"
workflows: "workflow1"
}
python/examples/grpc_impl_example/ocr_detection/workdir/model_toolkit.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
engines {
name: "general_infer_0"
type: "FLUID_CPU_ANALYSIS_DIR"
reloadable_meta: "ocr_det_model//fluid_time_file"
reloadable_type: "timestamp_ne"
model_data_path: "ocr_det_model/"
runtime_thread_num: 0
batch_infer_size: 0
enable_batch_align: 0
enable_memory_optimization: true
static_optimization: false
force_update_static_cache: false
enable_ir_optimization: false
}
python/examples/grpc_impl_example/ocr_detection/workdir/resource.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
model_toolkit_path: "workdir"
model_toolkit_file: "model_toolkit.prototxt"
general_model_path: "workdir"
general_model_file: "general_model.prototxt"
python/examples/grpc_impl_example/ocr_detection/workdir/workflow.prototxt 0 → 100644
浏览文件 @ 3bc25b2a
workflows {
name: "workflow1"
workflow_type: "Sequence"
nodes {
name: "general_reader_0"
type: "GeneralReaderOp"
}
nodes {
name: "general_infer_0"
type: "GeneralInferOp"
dependencies {
name: "general_reader_0"
mode: "RO"
}
}
nodes {
name: "general_response_0"
type: "GeneralResponseOp"
dependencies {
name: "general_infer_0"
mode: "RO"
}
}
}
Markdown is supported
0% 或 .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑！
想要评论请 注册 或