提交 · 2f64215995cf557736fca9746c262f8a6331b587 · 机器未来 / Paddle

11 2月, 2022 1 次提交

由 ziyoujiyi 提交于 2月 11, 2022

* delete gloo connect retry

* the_one_ps dirs reconstruct

* .

* .

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* refactor ps optimize

* refactor ps optimize

* refactor ps optimize

* .

* .

* .

* .

* .

* .

* refactor theoneps

* the_one_ps

* add ps pass unittest

* add ps pass unittest

* ps unitest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* ps unittest ready

* ps unittest ready

* solve dist_pass init conflict

* solve import CommContext error

* unittest ok

* implement AllocateFrom

* solve setup.py.in conflict

* solve conflict

* solve conflict

* solve conflict

* .

* .

* cpu-async-ps minimize test ok & gpu minimize test ok
Co-authored-by: Nzkh2016 <zhangkaihuo@baidu.com>

22c67d14

09 2月, 2022 1 次提交
- B
  
  optimize sharding stage3 offload (#39397) · b292dfb8
  由 Baibaifan 提交于 2月 09, 2022
  
  b292dfb8
08 2月, 2022 3 次提交

Add FuseOptimizerPass and test_dist_fuse_adam_pass unittest. (#39208) · ccdcfa2d

由 hlygit66666 提交于 2月 08, 2022

* add fuse_relu_depthwise_conv_pass unittest

* fix atol and rtol

* fix according to review

* Add FuseOptimizerPass and fuse_adam_pass unittest

* add sgd and momentum unittest

* add fuse_optimizer_pass

* close amp

* close amp

* update

* fix run on two cards

* Update test_dist_fuse_adam_pass.py

* Update test_dist_fuse_momentum_pass.py

* Update test_dist_fuse_sgd_pass.py

* Create test_dist_fuse_sgd_pass.py

* Create test_dist_fuse_sgd_pass.py

* Create test_dist_fuse_sgd_pass.py

* Update test_dist_fuse_adam_pass.py

* Update test_dist_fuse_momentum_pass.py

* Update test_dist_fuse_sgd_pass.py

ccdcfa2d

ps optimize refactor (#38982) · 196dbfc2

由 ziyoujiyi 提交于 2月 08, 2022

* delete gloo connect retry

* the_one_ps dirs reconstruct

* .

* .

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* refactor ps optimize

* refactor ps optimize

* refactor ps optimize

* .

* .

* .

* .

* .

* .

* refactor theoneps

* the_one_ps

* add ps pass unittest

* add ps pass unittest

* ps unitest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* ps unittest frame

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* add cpu_async_ps_mode test

* ps unittest ready

* ps unittest ready

* solve dist_pass init conflict

* solve import CommContext error

* unittest ok

* implement AllocateFrom

* solve setup.py.in conflict

* solve conflict

* solve conflict

* solve conflict

* .

* .
Co-authored-by: Nzkh2016 <zhangkaihuo@baidu.com>

196dbfc2

B

optimize sharding stage3 (#39334) · 23d559dd
由 Baibaifan 提交于 2月 08, 2022

23d559dd

30 1月, 2022 1 次提交
- Z
  geo memory sparse table (#39250) · 9b3b53ba
  由 zhaocaibei123 提交于 1月 30, 2022
```
* geo depends

* add memory geo table

* fix
```
  9b3b53ba
29 1月, 2022 2 次提交

Auto parallel/qkv fuse (#39080) · fdedf909

由 JZ-LIANG 提交于 1月 29, 2022

* support qkv fuse

* support qkv fuse

* update completion

* update completion

* update dist_split

* rerun ci

* is_auto_compatible added

* is_auto_compatible added

fdedf909

Add FuseReluDepthwiseConvPass and unittest (#39105) · 9d6e8202

由 hlygit66666 提交于 1月 29, 2022

* add fuse_relu_depthwise_conv_pass unittest

* fix atol and rtol

* fix according to review

* Update test_dist_fuse_relu_depthwise_conv_pass.py

9d6e8202

28 1月, 2022 2 次提交

[PSLIB] Add Metrics Module, Support User-defined Add Metric (#38789) · 2e6be886

由 Fan Zhang 提交于 1月 28, 2022

* [PSLIB] Add Metrics Module, Support User-defined Add Metric

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI Coverage

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI

* [PSLIB] Modify According to CI Coverage

* [PSLIB] Modify According to CI Coverage

* [PSLIB] Modify According to CI Coverage

* modify role_maker

* update CMakeLists.txt

2e6be886

B

fix_stage2_minimize (#39285) · 90f44c6f
由 Baibaifan 提交于 1月 28, 2022

90f44c6f

27 1月, 2022 2 次提交
- C
  【Auto Parallel】Update Planner (#39201) · f2226441
  由 caozhou 提交于 1月 27, 2022
```
* update planner

* update unitest

* update dist matmul

* update auto converter
```
  f2226441
- C
  【Auto Parallel】update dist param grad for pass (#38941) · cac6f408
  由 caozhou 提交于 1月 27, 2022
```
* update dist param grad for pass

* update unitest

* update unitests

* fix conflict
```
  cac6f408
26 1月, 2022 1 次提交

Add FuseBatchNormAddActPass and unittest. (#39178) · 801159ce

由 hlygit66666 提交于 1月 26, 2022

* add fuse_relu_depthwise_conv_pass unittest

* fix atol and rtol

* fix according to review

* add FuseBatchNormAddActPass and unittest

* Update test_dist_fuse_bn_add_act_pass.py

* solve conflict

801159ce

25 1月, 2022 5 次提交
- H
  Add FuseBatchNormActPass and unittest. (#39176) · 09104d02
  由 hlygit66666 提交于 1月 25, 2022
```
* add fuse_relu_depthwise_conv_pass unittest

* fix atol and rtol

* fix according to review

* Add fuse_bn_act_pass unittest

* rm others

* add fuse_bn_act_pass
```
  09104d02
- B
  
  fix_stage3_fp16 (#39171) · 8bb509d5
  由 Baibaifan 提交于 1月 25, 2022
  
  8bb509d5
- H
  [Dygraph] Support param groups in grad_clip (#39175) · b0cca48e
  由 Haohongxiang 提交于 1月 25, 2022
```
* support param groups in grad_clip

* update

* modify for review
```
  b0cca48e
- K
  
  restore gloo (#39163) · faf517b2
  由 kuizhiqing 提交于 1月 25, 2022
  
  faf517b2
- C
  【Auto Parallel】Update reshard for complete (#39073) · 529f1425
  由 caozhou 提交于 1月 25, 2022
```
* update reshard for newest completion

* update unitest

* merge newest
```
  529f1425
24 1月, 2022 2 次提交
- B
  
  Add sharding stage3 offload (#38989) · 46823104
  由 Baibaifan 提交于 1月 24, 2022
  
  46823104
- B
  
  fix sharding stage2 unittest (#39112) · f4623876
  由 Baibaifan 提交于 1月 24, 2022
  
  f4623876
21 1月, 2022 1 次提交

[Auto Parallel] Use the new completion algorithm (#39086) · e5cda6fa

由 Yulong Ao 提交于 1月 21, 2022

* Add the backward support for QR

* Remove unnecessary comments

* [Auto Parallel] Improve the dist op interface and compatible computation

* Remove unnecessary modification

* Recover some modifications

* Add lost files

* Fix a minor bug

* Fix the bug of the planner

* Fix the format problem

* [Auto Parallel] Update the completion algorithm

* Fix the bug of auto_searcher unittest

e5cda6fa

20 1月, 2022 1 次提交

[Auto Parallel] Improve the dist op interface and the compatible computation (#39014) · 9acc26ca

由 Yulong Ao 提交于 1月 20, 2022

* Add the backward support for QR

* Remove unnecessary comments

* [Auto Parallel] Improve the dist op interface and compatible computation

* Remove unnecessary modification

* Recover some modifications

* Add lost files

* Fix a minor bug

* Fix the bug of the planner

* Fix the format problem

9acc26ca

18 1月, 2022 2 次提交
- K
  
  fix http gloo bug (#39017) · a998c077
  由 kuizhiqing 提交于 1月 18, 2022
  
  a998c077
- Z
  [AutoParallel] Recompute Pass (#38920) · 30845734
  由 zhaoyingli 提交于 1月 18, 2022
```
* [AutoParallel] Recompute Pass

* update unittest

* reshard for amp

* add comment
```
  30845734
17 1月, 2022 2 次提交
- W
  
  fix benchmark in paddlerec (#38278) · 1dbc8632
  由 wangguanqun 提交于 1月 17, 2022
  
  1dbc8632
- S
  Add NoReduce mode for ParallelExecutor (#38969) · e50d883e
  由 sneaxiy 提交于 1月 17, 2022
```
* add no reduce mode for pe

* add NoReduce ut
```
  e50d883e
14 1月, 2022 1 次提交
- B
  
  Add dygraph sharding stage3 (#38052) · 4c77a908
  由 Baibaifan 提交于 1月 14, 2022
  
  4c77a908
13 1月, 2022 1 次提交
- J
  
  [Dist Pass] AMP pass add dist_update_loss_scaling op (#38902) · 53783e1e
  由 JZ-LIANG 提交于 1月 13, 2022
  
  53783e1e
12 1月, 2022 2 次提交

the_one_ps dirs reconstruct (#38804) · 50609214

由 ziyoujiyi 提交于 1月 12, 2022

* delete gloo connect retry

* the_one_ps dirs reconstruct

* .

* .

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* create the_one_ps dirs

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

* the one ps dirs modify

50609214

[Dist Pass] Amp Pass (#38764) · cc24427e

由 JZ-LIANG 提交于 1月 12, 2022

* auto parallel sharding base

* chmod

* add unitest

* set unitest cmake dist label

* revise code according to rewiew

* chmod

* bugfix for grad_clip and param broadcast

* chmod

* update unitest

* chmod

* add clip

* chmod

* add amp pass

* chmod

* add unitest

* remove grad update

* fixed bug

* fixed bug

* fixed typose

* fixed typoes

cc24427e

11 1月, 2022 1 次提交

【Auto Parallel】New local tensor (#38747) · d3ba1895

由 caozhou 提交于 1月 11, 2022

* update dist tensor

* add unitest

* update unitest

* refactor dist tensor

* update dist tensor and unitest

d3ba1895

06 1月, 2022 3 次提交
- J
  
  [Auto Parallel] Pass bugfix (#38741) · 747000dd
  由 JZ-LIANG 提交于 1月 06, 2022
  
  747000dd
- M
  
  [Paddle-ASP]Asp sharding (#37725) · aec6e8a9
  由 minghaoBD 提交于 1月 06, 2022
  
  aec6e8a9
- R
  
  fix bugs: output of splited fc is wrong (#38724) · 35213c64
  由 Roc 提交于 1月 06, 2022
  
  35213c64
31 12月, 2021 1 次提交

[Auto Parallel] Add general gradient merge pass to support auto parallel (#38259) · 89ce6db8

由 xiayanming 提交于 12月 31, 2021

* [Auto Parallel] add gradient merge pass

* fix ci issue

* fix ci issue

* fix ci issue

* fix ci issue

* fix ci issue

* fix ci issue

* fix ci issue

* fix ci issue

* fix ci issue

* fix pr review

* fix pr review

* fix pr review

* fix pr review

* fix pr review

* fix pr review

89ce6db8

30 12月, 2021 2 次提交
- Y
  [Auto parallel] Make sure the id semantics of every var and op unique (#38132) · 5620214e
  由 Yulong Ao 提交于 12月 30, 2021
```
* [Auto parallel] Make the id of var and op unique

* [Auto Parallel] Rename back dist_context to distop_context
```
  5620214e
- Z
  
  [PSCore]Fix test fleet base 2 (#38588) · 04496d89
  由 zmxdream 提交于 12月 30, 2021
  
  04496d89
29 12月, 2021 1 次提交

[Auto Parallel] Sharding Pass (#38502) · e3faf345

由 JZ-LIANG 提交于 12月 29, 2021

* auto parallel sharding base

* chmod

* add unitest

* set unitest cmake dist label

* revise code according to rewiew

* chmod

e3faf345

24 12月, 2021 1 次提交
- J
  
  [Auto Paralle] partitioner refactor (#37853) · c4fdb057
  由 JZ-LIANG 提交于 12月 24, 2021
  
  c4fdb057
22 12月, 2021 1 次提交
- Z
  
  Replaced core.ops with _C_ops (#38337) · 242ef2b9
  由 Zhanlue Yang 提交于 12月 22, 2021
  
  242ef2b9

机器未来 / Paddle 与 Fork 源项目一致

机器未来 / Paddle
与 Fork 源项目一致