• Z
    [AutoParallel] recompute tuning (#48608) · 170a31f9
    zhaoyingli 提交于
    * [AutoParallel] recompute tuning
    
    * fix conflict
    
    * update comment
    
    * bug fix
    
    * update rc algo
    
    * tiny fix
    
    * fix clear process_group
    
    * remove comment
    
    * update segment print
    
    * fix import OpRole
    
    * adapt amp pass and grad_clip pass for opt_tuner
    
    * update tuning config
    
    * fix import
    
    * annotate recompute info on ops and upgrade recompute pass
    
    * add op_namescope for seed op
    
    * record reserved vars
    
    * fix recompute var's dist_attr
    
    * fix strategy unittest
    
    * adapt for fp16
    
    * update unittest
    
    * revert copy opt
    
    * update unittest
    
    * rename set_recompute_segments
    
    * fix unittest
    170a31f9
auto_parallel_gradient_merge.py 12.0 KB