From 91e42d66e1a22c9514cad1715342903f1ab7c4f2 Mon Sep 17 00:00:00 2001 From: TeslaZhao Date: Wed, 9 Mar 2022 21:55:06 +0800 Subject: [PATCH] Update doc --- doc/Offical_Docs/1-2Benchmark.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/doc/Offical_Docs/1-2Benchmark.md b/doc/Offical_Docs/1-2Benchmark.md index d8362eb3..10577387 100644 --- a/doc/Offical_Docs/1-2Benchmark.md +++ b/doc/Offical_Docs/1-2Benchmark.md @@ -20,6 +20,7 @@ - 异步模式:异步线程处理方式,保证显存占用相同,最大批量为32,异步线程数为2 **三.同步模式** + 结论:同步模型默认参数配置情况下,C++ Serving 吞吐和平均时延指标均优于 Tensorflow Serving。

@@ -38,6 +39,7 @@ |150 |pd-serving |239.114 |627.279 |tf-serving |86.312 |1737.848| **四.异步模式** + 结论:client数据较少时,Tensorflow Serving 性能略优于 C++ Serving ,但当 client 并发数超过70后,Tensorflow Serving 服务出现大量超时,而 C++ Serving 仍能正常运行

-- GitLab