1. 09 2月, 2023 1 次提交
    • Z
      remove paddle.fluid.dygraph.parallel.ParallelEnv (#50157) · 9dd1f4bf
      zqw_1997 提交于
      * remove dygraph.parallel.ParallelEnv
      
      * logger.py error: AttributeError: module 'paddle' has no attribute 'distributed'
      
      * move the implenmentation to the root folder
      
      * logger.py import ParallelEnv from paddle.parallel to avoid circular import
      
      * add the comment of why import ParallelEnv from paddle.parallel in logger.py and remove the api interface in the paddle/parallel.py
      
      * outdated Env and note removed
      
      * decouple the logger.py and ParallelEnv
      
      * remove another ref of parallel in init.py
      9dd1f4bf
  2. 04 1月, 2023 1 次提交
    • J
      [Auto Parallel-Performance] Sharding Comm Optimization (#48604) · 5592f8ad
      JZ-LIANG 提交于
      * remove deps and prior comm
      
      * grad comm fuse
      
      * add deps for amp&global norm
      
      * stage2 broadcast prior deps
      
      * stage2 grad overlap
      
      * stream_analyzer bugfix
      
      * overlap enable
      
      * dep op namescope
      
      * depend support multiple inputs
      
      * check finite deps
      
      * stage2 param comm overlap
      
      * Set kD2HStream
      
      * grad comm hierarchical
      
      * grad comm hierarchical
      
      * new unitest
      Co-authored-by: Nchenruibiao <chenruibiao@baidu.com>
      5592f8ad