From c64db3749513723382337aff15ec6e69ae8cbdd3 Mon Sep 17 00:00:00 2001 From: TeslaZhao Date: Wed, 19 May 2021 17:24:28 +0800 Subject: [PATCH] Update BENCHMARKING_GPU.md --- doc/BENCHMARKING_GPU.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/doc/BENCHMARKING_GPU.md b/doc/BENCHMARKING_GPU.md index ad9e343d..81c6cac4 100755 --- a/doc/BENCHMARKING_GPU.md +++ b/doc/BENCHMARKING_GPU.md @@ -11,7 +11,7 @@ 模型：ResNet_v2_50 -## 2. PaddleServing-PipeLine(python)方式 +## 2. PaddleServing-PipeLine(python) |model_name |thread_num |batch_size |CPU_util(%) |GPU_memory(mb) |GPU_util(%) |qps(samples/s) |total count |mean(ms) |median(ms) |80 percent(ms) |90 percent(ms) |99 percent(ms) |total cost(s) |each cost(s)| |:--|:--|:--|:--|:--|:--|:--|:--|:--|:--|:--|:--|:--|:--|:-- |ResNet_v2_50 |1 |1 |2.2 |3327 |17.25 |17.633658869240787 |355 |56.428481238996476 |38.646728515625 |39.496826171875 |39.98369140625 |1273.1911083984373 |20.131953477859497 |20.033540725708008| @@ -45,7 +45,7 @@ |ResNet_v2_50 |16 |16 |3.5 |6567 |77.8706 |186.56600081516 |248 |1332.1007946383568 |1365.2745361328125 |1399.212255859375 |1432.4037353515625 |1771.4374853515626 |21.26861262321472 |20.64799252152443| |ResNet_v2_50 |16 |32 |4.3 |6567 |83.6371 |201.1293408638195 |140 |2419.3400198800223 |2561.09228515625 |2616.081103515625 |2642.0835205078124 |2883.8197412109366 |22.274224042892456 |21.169659316539764| -## 3. 竞品TensorFlow-Serving方式(C++) +## 3. 竞品TensorFlow-Serving(C++) model_name|thread_num|batch_size|CPU_util(%)|GPU_memory(mb)|GPU_util(%)|qps(samples/s)|total count|mean(ms)|median(ms)|80 percent(ms)|90 percent(ms)|99 percent(ms)|total cost(s)|each cost(s)| |:--|:--|:--|:--|:--|:--|:--|:--|:--|:--|:--|:--|:--|:--|:--| |ResNet_v2_50|1|1|2.1|6315|54|43.75570770301271|NaN|15.5063232421875|15.239013671875|15.387646484374999|15.971313476562498|19.846301269531253|0.22854161262512207|0.15510153770446777| -- GitLab