fix bug of p2p (#48045)

cb087beb · ShenLiang · GitHub · c20eb7a6 · cb087beb
隐藏空白更改
内联并排

Showing with 5 addition and 1 deletion

python/paddle/distributed/fleet/meta_parallel/pp_utils/p2p_communication.py ...ributed/fleet/meta_parallel/pp_utils/p2p_communication.py +5 -1

未找到文件。
--- a/python/paddle/distributed/fleet/meta_parallel/pp_utils/p2p_communication.py
+++ b/python/paddle/distributed/fleet/meta_parallel/pp_utils/p2p_communication.py
@@ -164,7 +164,11 @@ class SendRecvMeta:
                [d.shape for d in tensor if not d.stop_gradient]
            )
            self.send_dtype_message = tuple(
-                [paddle_2_number(d.dtype) for d in tensor]
+                [
+                    paddle_2_number(d.dtype)
+                    for d in tensor
+                    if not d.stop_gradient
+                ]
            )