• Y
    [Auto Parallel] Improve the interface and the underlying mechanisms (#36617) · a02532b5
    Yulong Ao 提交于
    * default dist op
    
    * add dist_attr for dist op
    
    * add unitest
    
    * update inputname
    
    * update function name
    
    * add unitest
    
    * update CMakeLists.txt for CI
    
    * fix dis_matmul
    
    * fix compile error
    
    * update matmul to matmul_v2
    
    * unify api
    
    * unify api
    
    * todo
    
    * update distop forward func
    
    * update distop forward func
    
    * auto parallel backward
    
    * update dist op
    
    * autoparallel backward
    
    * add backward for embedding
    
    * temp1
    
    * temp2
    
    * temp3
    
    * temp4
    
    * backward done1
    
    * backward done2
    
    * backward done3
    
    * dist embedding remove mp mode
    
    * dist matmul remove mp mode
    
    * update dist embedding
    『
    
    * dist op init1
    
    * dist op init 2
    
    * update unitest
    
    * context remove parallel mode
    
    * partitioner remove parallel mode
    
    * update unitest
    
    * a more general method to support varying mesh in pipeline parallel
    
    * support varying mesh in pipeline parallel
    
    * embedding support varying mesh in pipeline parallel
    
    * matmul support varying mesh in pipeline parallel
    
    * default dist op support varying mesh in pipeline parallel
    
    * dist attribute for startup program
    
    * default dist op support varying mesh in pipeline parallel 2
    
    * partitoner support varying mesh in pipeline parallel
    
    * revise logic for auto compeletion
    
    * revise framework.py
    
    * revise reshard unitest
    
    * revise unitest for parallelize
    
    * chmod
    
    * fixed bug for dist embedding name mapping
    
    * Improve the interface and the underlying mechanisms of auto parallel
    
    * revise completion for backward
    
    * revise completion for update
    
    * revise completion for update
    
    * update unitest
    
    * chmod
    
    * bugfix for grad_op output var's mesh
    
    * Modify codes for pr 36744
    
    * Remove unnecessary comments in framework.py
    
    * Remove unnecessary comments in completion.py
    Co-authored-by: NJZ-LIANG <jianzhongliang10@gmail.com>
    Co-authored-by: Nzhaoyingli <zhaoyingli@baidu.com>
    Co-authored-by: NJZ-LIANG <38102074+JZ-LIANG@users.noreply.github.com>
    a02532b5
dist_embedding.py 14.2 KB