• Y
    [Auto Parallel] Add miscellaneous improvements (#43108) · 010aba33
    Yulong Ao 提交于
    * [Auto Parallel] Add the parallel tuner
    
    * [Auto Parallel] Improve the parallel tuner and fix some bugs
    
    * upodate cost model
    
    * update import Resharder by dist op
    
    * update cost model
    
    * fix comp cost bug
    
    * update cost model
    
    * [Auto Parallel] Amend the dist attr for #processses=1
    
    * update cost model and tuner
    
    * update cost model and tuner
    
    * update cost model and tuner
    
    * update cluster
    
    * update reshard
    
    * [Auto Parallel] Add the estimation from the cost model
    
    * [Auto Parallel] Reimplement the backup and restore functions
    
    * [Auto Parallel] Fix the bugs of the parallel tuner
    
    * [Auto Parallel] Update the engine api and dist context
    
    * [Auto Parallel] Work around the high order grad problem
    
    * [Auto Parallel] Add some miscellaneous improvements
    
    * [Auto Parallel] Add a unittest for DistributedContext
    Co-authored-by: Ncaozhou <caozhou@radi.ac.cn>
    010aba33
dist_default.py 23.8 KB