Created by: wangxicoding

PR types

Others

PR changes

Others

Describe

Refine amp&dgc&recompute, make them can be an inner_opt of other meta optimizer. For example

import paddle.distributed.fleet as fleet
strategy = fleet.DistributedStrategy()

# combine dgc & recompute
strategy.dgc = True 
strategy.recompute = True