未验证 提交 37bda166 编写于 作者: H Haohongxiang 提交者: GitHub

add assert overlap (#54559)

上级 4df89e94
......@@ -84,6 +84,10 @@ class PipelineParallel(MetaParallelBase):
"pp_configs"
].enable_timer
assert (
not self._dp_comm_overlap and not self._sharding_comm_overlap
), "Comm overlap is not supported now."
if self._dp_comm_overlap:
assert self.use_data_parallel and self.num_stages > 1
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册