• J
    [Auto Parallel] Logical Partition & Dist Op (#35117) · a622b701
    JZ-LIANG 提交于
    * support shard reader
    
    * support shard reader
    
    * add parallel mode
    
    * update process mesh
    
    * add method to compute comm_group
    
    * implement dist_embedding forward func
    
    * implement dist matmul forward func
    
    * implement dist reshape forward func
    
    * add transpiler framework
    
    * add transpiler forward
    
    * implement transpiler forward
    
    * implement transpiler backward & update
    
    * add process
    
    * add unitest
    
    * chmod
    
    * chmod
    
    * chmod
    
    * update unitest
    
    * add unitest for gpt
    
    * remove unused print
    
    * rename transpiler --> partitioner
    
    * rename transpiler --> partitioner
    
    * chmod
    
    * chmod
    
    * bug fixed
    
    * remove amp function
    
    * update case for dp mode
    
    * update case for dp mode
    a622b701
dist_embedding.py 8.5 KB