You need to sign in or sign up before continuing.
Created by: wangxicoding
PR types
Others
PR changes
Others
Describe
Refine amp&dgc&recompute, make them can be an inner_opt of other meta optimizer. For example
import paddle.distributed.fleet as fleet
strategy = fleet.DistributedStrategy()
# combine dgc & recompute
strategy.dgc = True
strategy.recompute = True