• D
    add more settings for distributed strategy (#25685) · 920d998f
    Dong Daxiang 提交于
    * add more settings for distributed strategy
    Basically, DistributedStrategy has several parts of configurations:
    - BuildStrategy: the same as paddle.fluid.BuildStrategy, but the distributed arguments are moved out of BuildStrategy
    - ExecutionStrategy: the same as paddle.fluid.ExecutionStrategy
    - collective communication configs: nccl_comm_num, hierarchical allreduce and so on
    - distributed algorithms: async_update(mainly used in PS), lars, lamb and so on
    920d998f
distributed_strategy.py 19.8 KB