提交 · 11e62d681a882a7fc4abb7ac515dc12a24ad6b81 · PaddlePaddle / Paddle

31 8月, 2022 1 次提交
- Z
  [AutoParallel] add grad_clip pass (#45513) · 11e62d68
  由 zhaoyingli 提交于 8月 31, 2022
```
* add grad_clip pass

* add unittest

* add notes

* update func

* add dist_attr for new op
```
  11e62d68
25 8月, 2022 1 次提交
- J
  [Auto Parallel] Support High Order Differential with Data Parallel Calc-Comm Overlaping (#45388) · bdd0b0f1
  由 JZ-LIANG 提交于 8月 25, 2022
```
* support high order differential with data parallel overlap

* update unitest
```
  bdd0b0f1
23 8月, 2022 2 次提交
- Z
  [AutoParallel] Add Quant Pass (#44877) · 61bc016c
  由 zhaoyingli 提交于 8月 23, 2022
```
* add quant pass
```
  61bc016c
- J
  [Auto Parallel] Data Parallel Comm & Calc Overlap Optimization (#45173) · 229befc8
  由 JZ-LIANG 提交于 8月 23, 2022
```
* bugfix

* remove scaling

* support rescale_grad opt

* add unitest
```
  229befc8
18 8月, 2022 1 次提交
- J
  
  bugfix for paddlescience (#45222) · 30391828
  由 JZ-LIANG 提交于 8月 18, 2022
  
  30391828
16 8月, 2022 1 次提交
- J
  [AutoParallel] Prune D2H memcpy for fp16 pass (#45159) · e2b924bf
  由 JZ-LIANG 提交于 8月 16, 2022
```
* prune d2h memcpy for fp16 pass
```
  e2b924bf
13 8月, 2022 1 次提交

fl-ps: support split sparse params in local & remote (#44864) · 3f5c405f

由 ziyoujiyi 提交于 8月 13, 2022

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* fl-ps v1.0

* .

* support N + N mode

* .

* .

* .

* .

* delete print

* .

* .

* .

* .

* fix bug

* .

* .

* fl-ps with coordinator ready

* merge dev

* update message parse only

* update fl client scheduler

* fix bug

* update multithreads sync

* fix ci errors

* update role_maker.py

* update role_maker.py

* fix ci error: windows py import error

* fix ci error: windows py import error

* fix windows ci pylib import error

* add dump fields & params

* try to fix windows import fleet error

* fix ps FLAGS error

* fix logging risk

* fix logging possible risk

* write trainer_desc file

* support split sparse params in local & remote

* fix import paddle.fluid.core.PSGPU

* fix import paddle.fluid.core.PSGPU

* add remote_sparse & local_sparse config

* fix unittest

* fix test_dist_fleet_geo table error

* fix PADDLE_ENFORCE error

* fix other's pr conflict

3f5c405f

12 8月, 2022 2 次提交
- C
  [Auto Parallel] Update reshard for auto search (#45002) · 8624f3b1
  由 caozhou 提交于 8月 12, 2022
```
* update reshard for auto search

* fix unittest bug

* update dist tensor

* update reshard output

* fix unittests bug

* merge develop
```
  8624f3b1
- J
  [Auto Parallel] Data Parallel Optimization Pass 1 (#44882) · 7aeec4ed
  由 JZ-LIANG 提交于 8月 12, 2022
```
* bugfix

* remove scaling

* support rescale_grad opt
```
  7aeec4ed
29 7月, 2022 1 次提交

[Auto parallel] Optimization Tuning (#43782) · 72f2ed43

由 JZ-LIANG 提交于 7月 29, 2022

* fixed bug for pass & engine

* fixed bug for benchmark GPT-3

* add tuner & profiler

* add algorithms & config

72f2ed43

21 7月, 2022 1 次提交
- Z
  add slot attr for push sparse op (#44422) · 85c6937b
  由 zhaocaibei123 提交于 7月 21, 2022
```
* add slot attr for push sparse op

* add pybind

* remove fleet

* add unittest

* fix
```
  85c6937b
13 7月, 2022 1 次提交
- J
  [Auto parallel] Accelerate procedure of partitioning and generating dist graphs (#44224) · 07f33da9
  由 JZ-LIANG 提交于 7月 13, 2022
```
* avoid sync with cpp in partition op

* delay eval & predict mode

* bugfix for gradient merge pass
```
  07f33da9
07 7月, 2022 1 次提交
- Z
  [AutoParallel] fix 'op_role' for gradient merge & recompute (#44138) · db2c71a4
  由 zhaoyingli 提交于 7月 07, 2022
```
* fix op_role

* fix engine

* update op_role
```
  db2c71a4
29 6月, 2022 1 次提交
- J
  [Auto parallel] Bug fixed for GPT3 benchmark (#43793) · 74c9b57b
  由 JZ-LIANG 提交于 6月 29, 2022
```
* fixed bug for pass & engine

* fixed bug for benchmark GPT-3
```
  74c9b57b
20 6月, 2022 1 次提交

add dymf to gpups in python (#43497) · a4cfa5ae

由 wangguanqun 提交于 6月 20, 2022

* gpups default config and dataset

* codestyle

* add unittest

* code style

* add dymf to gpups

* codestyle

* add static.nn.cvm import

* PSERVER_DEBUG

* add fs config to worker desc

* update unittest

* unittest

* remove gpups unittest

* remove gpups unittest

* static check

a4cfa5ae

17 6月, 2022 1 次提交

bug fix (#43526) · 4d649893

由 ziyoujiyi 提交于 6月 17, 2022

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* fl-ps v1.0

* .

* support N + N mode

* .

* .

* .

* .

* delete print

* .

* .

* .

* .

* fix bug

* .

* .

4d649893

06 6月, 2022 1 次提交
- Z
  [AutoParallel] fix gradient merge optimize parse (#43169) · c22e1123
  由 zhaoyingli 提交于 6月 06, 2022
```
* fix gradient merge

* bug fix

* update annotation
```
  c22e1123
05 6月, 2022 1 次提交

【code format check upgrade】 step2：yapf (#42944) · a072fca8

由 Sing_chan 提交于 6月 05, 2022

* use yapf to format all python file

* yapf exclude two unittests file for they rely on writing and reading file, and format will break them

* disable diff_py_file because too many diff files cause command following failed

a072fca8

02 6月, 2022 1 次提交

add federated learning parameter server(fl-ps) mode (#42682) · d999049f

由 ziyoujiyi 提交于 6月 02, 2022

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* fl-ps v1.0

* .

* support N + N mode

* .

* .

* .

* .

* delete print

* .

* .

* .

* .

d999049f

30 5月, 2022 1 次提交
- Z
  [AutoParallel] use original id in grad_op_id_to_op_id (#42992) · 17b8446d
  由 zhaoyingli 提交于 5月 30, 2022
```
* use original id in dist_op_context.grad_op_id_to_op_id

* del assert

* remove redundant map
```
  17b8446d
26 5月, 2022 1 次提交
- D
  
  [GPUPS]fix dymf gpups pscore (#42991) · 8f7f3ac9
  由 danleifeng 提交于 5月 26, 2022
  
  8f7f3ac9
25 5月, 2022 1 次提交
- D
  
  [GPUPS]fix gpups pscore (#42967) · 45d7a3ea
  由 danleifeng 提交于 5月 25, 2022
  
  45d7a3ea
12 5月, 2022 2 次提交
- S
  
  Fix some typos in paddle/. (#42408) · 2012672c
  由 Shuangchi He 提交于 5月 12, 2022
  
  2012672c
- S
  Add cinn pass to program (#42623) · 9ac736c2
  由 sneaxiy 提交于 5月 12, 2022
```
* add cinn pass to program

* remove build_cinn_pass ut

* polish ut, add ut

* guard ut with is_compiled_with_cinn

* enable ut test_build_cinn_pass_resnet
```
  9ac736c2
07 5月, 2022 1 次提交

[Auto Parallel] Improve the codes of the completion and distributed context (#40671) · bed9aaea

由 Yulong Ao 提交于 5月 07, 2022

* [Auto Parallel] Replace the old planner by the new partition tuner

* [Auto Parallel] Improve the completion and distributed context

* [Auto Parallel] Fix some bugs of the compatible check of some dist ops

* [Auto Parallel] Fix some bugs

bed9aaea

18 4月, 2022 1 次提交

[Auto parallel] Transformer MHA & FFN Fused Dist op (#41163) · ceef73c9

由 JZ-LIANG 提交于 4月 18, 2022

* adapot dist op

* [Auto Parallel] Support the auto completion of while_op

* add dist_fill_constant_batch_size_like

* align infer  accuracy

ceef73c9

02 4月, 2022 1 次提交
- L
  
  make variable 'gradient_merge_cond' local (#41262) · 0fe2001a
  由 Leo Chen 提交于 4月 02, 2022
  
  0fe2001a
30 3月, 2022 1 次提交

delete ps env (#41079) · a0e961c0

由 ziyoujiyi 提交于 3月 30, 2022

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* correct pass not regisiter

* back

* back

* .

* .

a0e961c0

28 3月, 2022 1 次提交
- J
  [Auto parallel] Mixed Precision FP16 Pass (#40615) · b99c1d07
  由 JZ-LIANG 提交于 3月 28, 2022
```
*  add FP16 Pass 

* Support the auto completion of while_op

*  acc aligned
```
  b99c1d07
24 3月, 2022 1 次提交
- X
  [Auto Parallel] Gradient merge pass support dist attribute (#40737) · 0443c6f4
  由 xiayanming 提交于 3月 24, 2022
```
* [Auto Parallel] gradient merge pass support dist attribute
```
  0443c6f4
23 3月, 2022 1 次提交

two-phase training for ps (#40762) · b1a4668c

由 zhaocaibei123 提交于 3月 23, 2022

* fix benchmark and communicator config

* fix bugs of the_one_ps

* multi program and fix bug in optimizer

* multi program in the_one_ps

* public commcontext

* ps optimizer multi programs

* cvm & datanorm backend

* fix dim

* fix unittest

* fix

* the one ps merge

* remove comm

* add DownpourLiteWorker

* all

* fix

* fix

* device worker downpour lite

* fix

* fix bug in global shuffle

* save inference model

* fix & add log

* fix

* remove log

* fix

* fix save summary

* fix

* fix pscore

* fix

* fix

* fix

* fix

* fix

* remove logs

* fix

* fix

* fix

* fix

* fix

* add some comments

* fix
Co-authored-by: Nesythan <esythan@126.com>

b1a4668c

05 3月, 2022 1 次提交

Ps optimizer multi programs (#39883) · bcaf88d2

由 wangguanqun 提交于 3月 05, 2022

* fix benchmark and communicator config

* fix bugs of the_one_ps

* multi program and fix bug in optimizer

* multi program in the_one_ps

* public commcontext

* ps optimizer multi programs

* the one ps merge

* fix bug in test

bcaf88d2

22 2月, 2022 1 次提交

fix bug in new the_one_ps (#39505) · d56a0a1b

由 wangguanqun 提交于 2月 22, 2022

* fix benchmark and communicator config

* fix bugs of the_one_ps

* multi program and fix bug in optimizer

* multi program in the_one_ps

* public commcontext

d56a0a1b

18 2月, 2022 1 次提交
- Z
  
  bug fix (#39630) · bbf31a4e
  由 zhaoyingli 提交于 2月 18, 2022
  
  bbf31a4e
16 2月, 2022 1 次提交

sync/geo test ok & fix heter_worker program ok (#39511) · b2986bab

由 ziyoujiyi 提交于 2月 16, 2022

* delete gloo connect retry

* the_one_ps dirs reconstruct

* .

* .

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* refactor ps optimize

* refactor ps optimize

* refactor ps optimize

* .

* .

* .

* .

* .

* .

* refactor theoneps

* the_one_ps

* add ps pass unittest

* add ps pass unittest

* ps unitest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* ps unittest ready

* ps unittest ready

* solve dist_pass init conflict

* solve import CommContext error

* unittest ok

* implement AllocateFrom

* solve setup.py.in conflict

* solve conflict

* solve conflict

* solve conflict

* .

* .

* cpu-async-ps minimize test ok & gpu minimize test ok

* add heter 2stage unittest

* add heter 2stage unittest

* add heter 2stage unittest

* sync/geo test ok & fix heter_worker program ok

* .
Co-authored-by: Nzkh2016 <zhangkaihuo@baidu.com>

b2986bab

14 2月, 2022 2 次提交

Add Inplace addto pass and unittest. (#39433) · 52af0a60

由 hlygit66666 提交于 2月 14, 2022

* add fuse_relu_depthwise_conv_pass unittest

* fix atol and rtol

* fix according to review

* Update test_dist_fuse_relu_depthwise_conv_pass.py

* add inplace_addto pass and unittest

52af0a60

统一ps：heter ps 二阶段单测通过 (#39468) · 765a2ada

由 ziyoujiyi 提交于 2月 14, 2022

* delete gloo connect retry

* the_one_ps dirs reconstruct

* .

* .

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* refactor ps optimize

* refactor ps optimize

* refactor ps optimize

* .

* .

* .

* .

* .

* .

* refactor theoneps

* the_one_ps

* add ps pass unittest

* add ps pass unittest

* ps unitest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* ps unittest ready

* ps unittest ready

* solve dist_pass init conflict

* solve import CommContext error

* unittest ok

* implement AllocateFrom

* solve setup.py.in conflict

* solve conflict

* solve conflict

* solve conflict

* .

* .

* cpu-async-ps minimize test ok & gpu minimize test ok

* add heter 2stage unittest

* add heter 2stage unittest

* add heter 2stage unittest
Co-authored-by: Nzkh2016 <zhangkaihuo@baidu.com>

765a2ada

11 2月, 2022 1 次提交

统一 ps 开发 - python (#39431) · 22c67d14

由 ziyoujiyi 提交于 2月 11, 2022

* delete gloo connect retry

* the_one_ps dirs reconstruct

* .

* .

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* refactor ps optimize

* refactor ps optimize

* refactor ps optimize

* .

* .

* .

* .

* .

* .

* refactor theoneps

* the_one_ps

* add ps pass unittest

* add ps pass unittest

* ps unitest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* ps unittest ready

* ps unittest ready

* solve dist_pass init conflict

* solve import CommContext error

* unittest ok

* implement AllocateFrom

* solve setup.py.in conflict

* solve conflict

* solve conflict

* solve conflict

* .

* .

* cpu-async-ps minimize test ok & gpu minimize test ok
Co-authored-by: Nzkh2016 <zhangkaihuo@baidu.com>

22c67d14

08 2月, 2022 2 次提交

Add FuseOptimizerPass and test_dist_fuse_adam_pass unittest. (#39208) · ccdcfa2d

由 hlygit66666 提交于 2月 08, 2022

* add fuse_relu_depthwise_conv_pass unittest

* fix atol and rtol

* fix according to review

* Add FuseOptimizerPass and fuse_adam_pass unittest

* add sgd and momentum unittest

* add fuse_optimizer_pass

* close amp

* close amp

* update

* fix run on two cards

* Update test_dist_fuse_adam_pass.py

* Update test_dist_fuse_momentum_pass.py

* Update test_dist_fuse_sgd_pass.py

* Create test_dist_fuse_sgd_pass.py

* Create test_dist_fuse_sgd_pass.py

* Create test_dist_fuse_sgd_pass.py

* Update test_dist_fuse_adam_pass.py

* Update test_dist_fuse_momentum_pass.py

* Update test_dist_fuse_sgd_pass.py

ccdcfa2d

ps optimize refactor (#38982) · 196dbfc2

由 ziyoujiyi 提交于 2月 08, 2022

* delete gloo connect retry

* the_one_ps dirs reconstruct

* .

* .

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* refactor ps optimize

* refactor ps optimize

* refactor ps optimize

* .

* .

* .

* .

* .

* .

* refactor theoneps

* the_one_ps

* add ps pass unittest

* add ps pass unittest

* ps unitest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* ps unittest ready

* ps unittest ready

* solve dist_pass init conflict

* solve import CommContext error

* unittest ok

* implement AllocateFrom

* solve setup.py.in conflict

* solve conflict

* solve conflict

* solve conflict

* .

* .
Co-authored-by: Nzkh2016 <zhangkaihuo@baidu.com>

196dbfc2

PaddlePaddle / Paddle 大约 1 年 前同步成功

PaddlePaddle / Paddle
大约 1 年前同步成功