• J
    [Auto Parallel] Generalization for Partition and Completion (#35735) · 797bd40d
    JZ-LIANG 提交于
    * default dist op
    
    * add dist_attr for dist op
    
    * add unitest
    
    * update inputname
    
    * update function name
    
    * add unitest
    
    * update CMakeLists.txt for CI
    
    * fix dis_matmul
    
    * fix compile error
    
    * update matmul to matmul_v2
    
    * unify api
    
    * unify api
    
    * todo
    
    * update distop forward func
    
    * update distop forward func
    
    * auto parallel backward
    
    * update dist op
    
    * autoparallel backward
    
    * add backward for embedding
    
    * temp1
    
    * temp2
    
    * temp3
    
    * temp4
    
    * backward done1
    
    * backward done2
    
    * backward done3
    
    * dist embedding remove mp mode
    
    * dist matmul remove mp mode
    
    * update dist embedding
    『
    
    * dist op init1
    
    * dist op init 2
    
    * update unitest
    
    * context remove parallel mode
    
    * partitioner remove parallel mode
    
    * update unitest
    
    * a more general method to support varying mesh in pipeline parallel
    
    * support varying mesh in pipeline parallel
    
    * embedding support varying mesh in pipeline parallel
    
    * matmul support varying mesh in pipeline parallel
    
    * default dist op support varying mesh in pipeline parallel
    
    * dist attribute for startup program
    
    * default dist op support varying mesh in pipeline parallel 2
    
    * partitoner support varying mesh in pipeline parallel
    
    * revise logic for auto compeletion
    
    * revise framework.py
    
    * revise reshard unitest
    
    * revise unitest for parallelize
    
    * chmod
    
    * fixed bug for dist embedding name mapping
    Co-authored-by: Nzhaoyingli <zhaoyingli@baidu.com>
    797bd40d
dist_embedding.py 14.2 KB