run recompute's real backward with amp disabled (#40042)

28795771 · Leo Chen · GitHub · 1c4e3e5d · 28795771
显示空白变更内容
内联并排

Showing with 4 addition and 3 deletion

python/paddle/distributed/fleet/utils/recompute.py python/paddle/distributed/fleet/utils/recompute.py +4 -3

未找到文件。
--- a/python/paddle/distributed/fleet/utils/recompute.py
+++ b/python/paddle/distributed/fleet/utils/recompute.py
@@ -183,6 +183,7 @@ class RecomputeFunction(PyLayer):
                )

            # actually backward
+            with paddle.amp.auto_cast(enable=False):
                paddle.autograd.backward(forward_outputs_with_grad,
                                         backward_inputs_with_grad)