Distribute Serving for Foundation Models

d1da04bc · TeslaZhao · 25ca1469 · d1da04bc
显示空白变更内容
内联并排

Showing with 1 addition and 1 deletion

paddle_inference/paddle/include/paddle_engine.h paddle_inference/paddle/include/paddle_engine.h +1 -1

未找到文件。
--- a/paddle_inference/paddle/include/paddle_engine.h
+++ b/paddle_inference/paddle/include/paddle_engine.h
@@ -268,7 +268,7 @@ class PaddleInferenceEngine : public EngineCore {
          config.EnableGpuMultiStream();
        }
      }
-      config.EnableTensorRtEngine(1 << 20,
+      config.EnableTensorRtEngine(1 << 25,
                                  max_batch,
                                  min_subgraph_size,
                                  precision_type,