提交 · 92568edbf7a6023f897b8d7e5f9f1ea985f28fa2 · PaddlePaddle / Paddle

02 6月, 2022 1 次提交

add federated learning parameter server(fl-ps) mode (#42682) · d999049f

由 ziyoujiyi 提交于 6月 02, 2022

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* fl-ps v1.0

* .

* support N + N mode

* .

* .

* .

* .

* delete print

* .

* .

* .

* .

d999049f

30 5月, 2022 1 次提交
- Z
  [AutoParallel] use original id in grad_op_id_to_op_id (#42992) · 17b8446d
  由 zhaoyingli 提交于 5月 30, 2022
```
* use original id in dist_op_context.grad_op_id_to_op_id

* del assert

* remove redundant map
```
  17b8446d
26 5月, 2022 1 次提交
- D
  
  [GPUPS]fix dymf gpups pscore (#42991) · 8f7f3ac9
  由 danleifeng 提交于 5月 26, 2022
  
  8f7f3ac9
25 5月, 2022 1 次提交
- D
  
  [GPUPS]fix gpups pscore (#42967) · 45d7a3ea
  由 danleifeng 提交于 5月 25, 2022
  
  45d7a3ea
12 5月, 2022 2 次提交
- S
  
  Fix some typos in paddle/. (#42408) · 2012672c
  由 Shuangchi He 提交于 5月 12, 2022
  
  2012672c
- S
  Add cinn pass to program (#42623) · 9ac736c2
  由 sneaxiy 提交于 5月 12, 2022
```
* add cinn pass to program

* remove build_cinn_pass ut

* polish ut, add ut

* guard ut with is_compiled_with_cinn

* enable ut test_build_cinn_pass_resnet
```
  9ac736c2
07 5月, 2022 1 次提交

[Auto Parallel] Improve the codes of the completion and distributed context (#40671) · bed9aaea

由 Yulong Ao 提交于 5月 07, 2022

* [Auto Parallel] Replace the old planner by the new partition tuner

* [Auto Parallel] Improve the completion and distributed context

* [Auto Parallel] Fix some bugs of the compatible check of some dist ops

* [Auto Parallel] Fix some bugs

bed9aaea

18 4月, 2022 1 次提交

[Auto parallel] Transformer MHA & FFN Fused Dist op (#41163) · ceef73c9

由 JZ-LIANG 提交于 4月 18, 2022

* adapot dist op

* [Auto Parallel] Support the auto completion of while_op

* add dist_fill_constant_batch_size_like

* align infer  accuracy

ceef73c9

02 4月, 2022 1 次提交
- L
  
  make variable 'gradient_merge_cond' local (#41262) · 0fe2001a
  由 Leo Chen 提交于 4月 02, 2022
  
  0fe2001a
30 3月, 2022 1 次提交

delete ps env (#41079) · a0e961c0

由 ziyoujiyi 提交于 3月 30, 2022

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* correct pass not regisiter

* back

* back

* .

* .

a0e961c0

28 3月, 2022 1 次提交
- J
  [Auto parallel] Mixed Precision FP16 Pass (#40615) · b99c1d07
  由 JZ-LIANG 提交于 3月 28, 2022
```
*  add FP16 Pass 

* Support the auto completion of while_op

*  acc aligned
```
  b99c1d07
24 3月, 2022 1 次提交
- X
  [Auto Parallel] Gradient merge pass support dist attribute (#40737) · 0443c6f4
  由 xiayanming 提交于 3月 24, 2022
```
* [Auto Parallel] gradient merge pass support dist attribute
```
  0443c6f4
23 3月, 2022 1 次提交

two-phase training for ps (#40762) · b1a4668c

由 zhaocaibei123 提交于 3月 23, 2022

* fix benchmark and communicator config

* fix bugs of the_one_ps

* multi program and fix bug in optimizer

* multi program in the_one_ps

* public commcontext

* ps optimizer multi programs

* cvm & datanorm backend

* fix dim

* fix unittest

* fix

* the one ps merge

* remove comm

* add DownpourLiteWorker

* all

* fix

* fix

* device worker downpour lite

* fix

* fix bug in global shuffle

* save inference model

* fix & add log

* fix

* remove log

* fix

* fix save summary

* fix

* fix pscore

* fix

* fix

* fix

* fix

* fix

* remove logs

* fix

* fix

* fix

* fix

* fix

* add some comments

* fix
Co-authored-by: Nesythan <esythan@126.com>

b1a4668c

05 3月, 2022 1 次提交

Ps optimizer multi programs (#39883) · bcaf88d2

由 wangguanqun 提交于 3月 05, 2022

* fix benchmark and communicator config

* fix bugs of the_one_ps

* multi program and fix bug in optimizer

* multi program in the_one_ps

* public commcontext

* ps optimizer multi programs

* the one ps merge

* fix bug in test

bcaf88d2

22 2月, 2022 1 次提交

fix bug in new the_one_ps (#39505) · d56a0a1b

由 wangguanqun 提交于 2月 22, 2022

* fix benchmark and communicator config

* fix bugs of the_one_ps

* multi program and fix bug in optimizer

* multi program in the_one_ps

* public commcontext

d56a0a1b

18 2月, 2022 1 次提交
- Z
  
  bug fix (#39630) · bbf31a4e
  由 zhaoyingli 提交于 2月 18, 2022
  
  bbf31a4e
16 2月, 2022 1 次提交

sync/geo test ok & fix heter_worker program ok (#39511) · b2986bab

由 ziyoujiyi 提交于 2月 16, 2022

* delete gloo connect retry

* the_one_ps dirs reconstruct

* .

* .

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* refactor ps optimize

* refactor ps optimize

* refactor ps optimize

* .

* .

* .

* .

* .

* .

* refactor theoneps

* the_one_ps

* add ps pass unittest

* add ps pass unittest

* ps unitest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* ps unittest ready

* ps unittest ready

* solve dist_pass init conflict

* solve import CommContext error

* unittest ok

* implement AllocateFrom

* solve setup.py.in conflict

* solve conflict

* solve conflict

* solve conflict

* .

* .

* cpu-async-ps minimize test ok & gpu minimize test ok

* add heter 2stage unittest

* add heter 2stage unittest

* add heter 2stage unittest

* sync/geo test ok & fix heter_worker program ok

* .
Co-authored-by: Nzkh2016 <zhangkaihuo@baidu.com>

b2986bab

14 2月, 2022 2 次提交

Add Inplace addto pass and unittest. (#39433) · 52af0a60

由 hlygit66666 提交于 2月 14, 2022

* add fuse_relu_depthwise_conv_pass unittest

* fix atol and rtol

* fix according to review

* Update test_dist_fuse_relu_depthwise_conv_pass.py

* add inplace_addto pass and unittest

52af0a60

统一ps：heter ps 二阶段单测通过 (#39468) · 765a2ada

由 ziyoujiyi 提交于 2月 14, 2022

* delete gloo connect retry

* the_one_ps dirs reconstruct

* .

* .

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* refactor ps optimize

* refactor ps optimize

* refactor ps optimize

* .

* .

* .

* .

* .

* .

* refactor theoneps

* the_one_ps

* add ps pass unittest

* add ps pass unittest

* ps unitest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* ps unittest ready

* ps unittest ready

* solve dist_pass init conflict

* solve import CommContext error

* unittest ok

* implement AllocateFrom

* solve setup.py.in conflict

* solve conflict

* solve conflict

* solve conflict

* .

* .

* cpu-async-ps minimize test ok & gpu minimize test ok

* add heter 2stage unittest

* add heter 2stage unittest

* add heter 2stage unittest
Co-authored-by: Nzkh2016 <zhangkaihuo@baidu.com>

765a2ada

11 2月, 2022 1 次提交

统一 ps 开发 - python (#39431) · 22c67d14

由 ziyoujiyi 提交于 2月 11, 2022

* delete gloo connect retry

* the_one_ps dirs reconstruct

* .

* .

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* refactor ps optimize

* refactor ps optimize

* refactor ps optimize

* .

* .

* .

* .

* .

* .

* refactor theoneps

* the_one_ps

* add ps pass unittest

* add ps pass unittest

* ps unitest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* ps unittest ready

* ps unittest ready

* solve dist_pass init conflict

* solve import CommContext error

* unittest ok

* implement AllocateFrom

* solve setup.py.in conflict

* solve conflict

* solve conflict

* solve conflict

* .

* .

* cpu-async-ps minimize test ok & gpu minimize test ok
Co-authored-by: Nzkh2016 <zhangkaihuo@baidu.com>

22c67d14

08 2月, 2022 2 次提交

Add FuseOptimizerPass and test_dist_fuse_adam_pass unittest. (#39208) · ccdcfa2d

由 hlygit66666 提交于 2月 08, 2022

* add fuse_relu_depthwise_conv_pass unittest

* fix atol and rtol

* fix according to review

* Add FuseOptimizerPass and fuse_adam_pass unittest

* add sgd and momentum unittest

* add fuse_optimizer_pass

* close amp

* close amp

* update

* fix run on two cards

* Update test_dist_fuse_adam_pass.py

* Update test_dist_fuse_momentum_pass.py

* Update test_dist_fuse_sgd_pass.py

* Create test_dist_fuse_sgd_pass.py

* Create test_dist_fuse_sgd_pass.py

* Create test_dist_fuse_sgd_pass.py

* Update test_dist_fuse_adam_pass.py

* Update test_dist_fuse_momentum_pass.py

* Update test_dist_fuse_sgd_pass.py

ccdcfa2d

ps optimize refactor (#38982) · 196dbfc2

由 ziyoujiyi 提交于 2月 08, 2022

* delete gloo connect retry

* the_one_ps dirs reconstruct

* .

* .

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* refactor ps optimize

* refactor ps optimize

* refactor ps optimize

* .

* .

* .

* .

* .

* .

* refactor theoneps

* the_one_ps

* add ps pass unittest

* add ps pass unittest

* ps unitest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* ps unittest ready

* ps unittest ready

* solve dist_pass init conflict

* solve import CommContext error

* unittest ok

* implement AllocateFrom

* solve setup.py.in conflict

* solve conflict

* solve conflict

* solve conflict

* .

* .
Co-authored-by: Nzkh2016 <zhangkaihuo@baidu.com>

196dbfc2

29 1月, 2022 1 次提交

Add FuseReluDepthwiseConvPass and unittest (#39105) · 9d6e8202

由 hlygit66666 提交于 1月 29, 2022

* add fuse_relu_depthwise_conv_pass unittest

* fix atol and rtol

* fix according to review

* Update test_dist_fuse_relu_depthwise_conv_pass.py

9d6e8202

26 1月, 2022 1 次提交

Add FuseBatchNormAddActPass and unittest. (#39178) · 801159ce

由 hlygit66666 提交于 1月 26, 2022

* add fuse_relu_depthwise_conv_pass unittest

* fix atol and rtol

* fix according to review

* add FuseBatchNormAddActPass and unittest

* Update test_dist_fuse_bn_add_act_pass.py

* solve conflict

801159ce

25 1月, 2022 1 次提交

Add FuseBatchNormActPass and unittest. (#39176) · 09104d02

由 hlygit66666 提交于 1月 25, 2022

* add fuse_relu_depthwise_conv_pass unittest

* fix atol and rtol

* fix according to review

* Add fuse_bn_act_pass unittest

* rm others

* add fuse_bn_act_pass

09104d02

18 1月, 2022 1 次提交
- Z
  [AutoParallel] Recompute Pass (#38920) · 30845734
  由 zhaoyingli 提交于 1月 18, 2022
```
* [AutoParallel] Recompute Pass

* update unittest

* reshard for amp

* add comment
```
  30845734
12 1月, 2022 1 次提交

[Dist Pass] Amp Pass (#38764) · cc24427e

由 JZ-LIANG 提交于 1月 12, 2022

* auto parallel sharding base

* chmod

* add unitest

* set unitest cmake dist label

* revise code according to rewiew

* chmod

* bugfix for grad_clip and param broadcast

* chmod

* update unitest

* chmod

* add clip

* chmod

* add amp pass

* chmod

* add unitest

* remove grad update

* fixed bug

* fixed bug

* fixed typose

* fixed typoes

cc24427e

06 1月, 2022 1 次提交
- J
  
  [Auto Parallel] Pass bugfix (#38741) · 747000dd
  由 JZ-LIANG 提交于 1月 06, 2022
  
  747000dd
31 12月, 2021 1 次提交

[Auto Parallel] Add general gradient merge pass to support auto parallel (#38259) · 89ce6db8

由 xiayanming 提交于 12月 31, 2021

* [Auto Parallel] add gradient merge pass

* fix ci issue

* fix ci issue

* fix ci issue

* fix ci issue

* fix ci issue

* fix ci issue

* fix ci issue

* fix ci issue

* fix ci issue

* fix pr review

* fix pr review

* fix pr review

* fix pr review

* fix pr review

* fix pr review

89ce6db8

29 12月, 2021 1 次提交

[Auto Parallel] Sharding Pass (#38502) · e3faf345

由 JZ-LIANG 提交于 12月 29, 2021

* auto parallel sharding base

* chmod

* add unitest

* set unitest cmake dist label

* revise code according to rewiew

* chmod

e3faf345

20 12月, 2021 1 次提交
- S
  
  add check pass conflict tools (#38276) · 0d12aa64
  由 sneaxiy 提交于 12月 20, 2021
  
  0d12aa64
14 12月, 2021 1 次提交

Add white list for dist passes (#37831) · 003e3dab

由 sneaxiy 提交于 12月 14, 2021

* add white list for dist passes

* update comment

* follow zhiqiu's comment

* fix PassContext attrs type

003e3dab

16 11月, 2021 1 次提交
- Z
  
  refine pass by removing CommOpt, CalcOpt, ParallelOpt (#37206) · 4c160be2
  由 Zeng Jinle 提交于 11月 16, 2021
  
  4c160be2
15 11月, 2021 1 次提交

Add distributed pass framework: including PassBase/PassTest/PassUtils (#36643) · 12339fa0

由 Zeng Jinle 提交于 11月 15, 2021

* add split_program

* make ut faster

* increase ut timeout

* make result deterministic

* add fuse_all_reduce pass

* add ut framework, update

* fix ut framework

* remove useless code

* add coverage support

* update

* fix CI

* fix some bugs and fix ci coverage

* fix conflict

12339fa0

PaddlePaddle / Paddle 大约 1 年 前同步成功

PaddlePaddle / Paddle
大约 1 年前同步成功