提交 · 762819a8edcb886a4b5f2045c58a5f542f023c73 · BaiXuePrincess / Paddle

17 11月, 2021 1 次提交
- W
  
  [npu][hybrid] support offload (#37224) · 762819a8
  由 WangXi 提交于 11月 17, 2021
  
  762819a8
15 11月, 2021 1 次提交

Add distributed pass framework: including PassBase/PassTest/PassUtils (#36643) · 12339fa0

由 Zeng Jinle 提交于 11月 15, 2021

* add split_program

* make ut faster

* increase ut timeout

* make result deterministic

* add fuse_all_reduce pass

* add ut framework, update

* fix ut framework

* remove useless code

* add coverage support

* update

* fix CI

* fix some bugs and fix ci coverage

* fix conflict

12339fa0

11 11月, 2021 1 次提交

[Heterps]Refactor Heter Pipeline Parameter Server (#36845) · a2da1efa

由 zmx 提交于 11月 11, 2021

* change username

* fix

* fix

* fix

* fix

* fix

* update

* update

* update unittests

* fix

* update

* fix

* update

* fix

* fix

* fix

* update

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update send_and_recv op. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix ut. test=develop

* fix unit. notest,test=coverage

* fix ut. notest, test=coverage

* update. notest,test=coverage

* fix ut. notest, test=coverage

* fix ut. notest, test=coverage

* fix. notest, test=coverage

* fix. notest, test=coverage

* fix ut. notest, test=coverage

* fix ut. notest, test=coverage

* fix ut. notest, test=coverage

* fix ut. notest, test=coverage

* add func. notest, test=coverage

* fix ut. notest, test=coverage

* fix. test=develop

* fix. test=develop

a2da1efa

20 10月, 2021 1 次提交
- H
  fix bugs of ClipGradByGlobalNorm in HybridParallel (#36555) · 6a3941e3
  由 Haohongxiang 提交于 10月 20, 2021
```
* fix bugs of ClipGradByGlobalNorm

* add unittests

* add unittests
```
  6a3941e3
15 10月, 2021 1 次提交
- D
  
  fix opt-offload save bug (#36433) · e703a2ed
  由 duanboqiang 提交于 10月 15, 2021
  
  e703a2ed
14 10月, 2021 2 次提交
- D
  
  optimize-offload support adamw op type (#36432) · 66c58fa3
  由 duanboqiang 提交于 10月 14, 2021
  
  66c58fa3
- Y
  
  [hybrid enhance] add flag to control the avg position for grad merge under pipeline mode (#36384) · 03d8304f
  由 Yuang Liu 提交于 10月 14, 2021
  
  03d8304f
12 10月, 2021 1 次提交

fix bugs in mp_layers、pp_layers and HybridParallelClipGrad (#36144) · d247cf17

由 Haohongxiang 提交于 10月 12, 2021

* fix calling bug of HybridParallelClipGrad

* fix bugs of HybridParallelClipGrad

* add unittest of pp with HybridParallelClipGrad

* fix bugs in mp_layers.py

* update

* fix bugs in pp_layers.py

* update

d247cf17

09 10月, 2021 1 次提交
- Z
  support ClipGradByGlobalNorm in sharding (#36012) · 623df429
  由 zhaoyingli 提交于 10月 09, 2021
```
* support ClipGradByGlobalNorm in sharding

* support ClipGradByGlobalNorm in sharding

* test=allcase
```
  623df429
07 10月, 2021 1 次提交
- H
  fix bugs in HybridParallelClipGrad of hybrid_parallel_optimizer (#36237) · 730dcaf4
  由 Haohongxiang 提交于 10月 07, 2021
```
* fix bugs in HybridParallelClipGrad of hybrid_parallel_optimizer

* update

* update
```
  730dcaf4
30 9月, 2021 1 次提交

李

Fix raw optim (#36176) · 5e0f199a

由李季提交于 9月 30, 2021

* fix raw optim

* pre-commit test file
Co-authored-by: Nsneaxiy <sneaxiy@126.com>

5e0f199a

29 9月, 2021 1 次提交
- W
  
  [hybrid] Fix model parallel non-distributed param broadcast (#36186) · bec9fc9a
  由 WangXi 提交于 9月 29, 2021
  
  bec9fc9a
28 9月, 2021 1 次提交
- W
  
  [hybrid] optimizer sharding support optimize cast (#35878) · eef0a943
  由 WangXi 提交于 9月 28, 2021
  
  eef0a943
18 9月, 2021 1 次提交
- W
  
  [hybird] fix pipeline section program Parameter (#35847) · 67c63639
  由 WangXi 提交于 9月 18, 2021
  
  67c63639
16 9月, 2021 2 次提交
- Y
  
  [hybrid] Fix mp multi gradient clip prob (#35713) · a4eadd15
  由 Yuang Liu 提交于 9月 16, 2021
  
  a4eadd15
- W
  
  [hybrid] remove scale op in insert_scale_loss_grad_ops (#35775) · 02b0be08
  由 WangXi 提交于 9月 16, 2021
  
  02b0be08
15 9月, 2021 1 次提交
- W
  
  [hybrid] out data parallel as optimizer sharding parallel (#35593) · 78465703
  由 WangXi 提交于 9月 15, 2021
  
  78465703
14 9月, 2021 1 次提交
- Z
  Fix RawProgramOptimizer bug (#35704) · 0f741880
  由 Zeng Jinle 提交于 9月 14, 2021
```
* fix raw optimizer gm

* update

* update ut
```
  0f741880
13 9月, 2021 1 次提交
- S
  [HybridParallel]Fix scaler bug in pipeline_parallel/model_parallel (#35556) · 2bb44317
  由 ShenLiang 提交于 9月 13, 2021
```
* support grad group

* fix single card condition
```
  2bb44317
10 9月, 2021 1 次提交
- J
  [Dygraph 4D Parallel] Sharding Support MP-PP-DP Parallelism (#35580) · 2c922d63
  由 JZ-LIANG 提交于 9月 10, 2021
```
* sharding support dp

* sharding support mp

* sharding support pp
```
  2c922d63
08 9月, 2021 1 次提交

Enable program passes on Fleet APIs (#34955) · 5f369881

由 Zeng Jinle 提交于 9月 08, 2021

* add fleet api for program pass

* turn on apply pass for CI test

* fix disable fuse_all_optimizer bug

* try to test ci

* fix CI

* fill unspecified op role

* fix fuse_allreduce

* add ut to improve coverage

* remove useless change

* improve c++ coverage

* follow some comments

* test ir pass pipeline

* update doc

* reduce ut time again

5f369881

01 9月, 2021 1 次提交
- J
  
  bugfix for mp accuracy (#35326) · 7f17f9a0
  由 JZ-LIANG 提交于 9月 01, 2021
  
  7f17f9a0
25 8月, 2021 1 次提交
- W
  
  [hybrid npu] fix npu found_finite in hybrid (#35134) · f609ca37
  由 WangXi 提交于 8月 25, 2021
  
  f609ca37
20 8月, 2021 1 次提交
- Y
  
  [hybrid performance] Grad fuse for gradient merge under pipeline mode (#35004) · 4d9b2d6d
  由 Yuang Liu 提交于 8月 20, 2021
  
  4d9b2d6d
18 8月, 2021 1 次提交
- W
  [Hybrid Performance] Move the cast op of AMP which cast fp32 param to fp16... · a9673b44
  由 WangXi 提交于 8月 18, 2021
```
[Hybrid Performance] Move the cast op of AMP which cast fp32 param to fp16 param to the optimizer (#34965)
```
  a9673b44
17 8月, 2021 1 次提交
- R
  
  [NPU]Adamw skip update for npu (#34897) · b4474fb4
  由 Roc 提交于 8月 17, 2021
  
  b4474fb4
11 8月, 2021 2 次提交
- W
  
  [hybrid] pp+dp support fp16 allreduce (#34762) · 4d7af372
  由 WangXi 提交于 8月 11, 2021
  
  4d7af372
- Y
  
  Optimize fused allreduce in raw program (#34509) · 4d2994cb
  由 Yuang Liu 提交于 8月 11, 2021
  
  4d2994cb
10 8月, 2021 1 次提交
- W
  
  [hybrid] refine sharding code (#34678) · a1603797
  由 WangXi 提交于 8月 10, 2021
  
  a1603797
06 8月, 2021 1 次提交
- B
  
  del wait in sharding for npu (#34637) · ce733495
  由 Baibaifan 提交于 8月 06, 2021
  
  ce733495
03 8月, 2021 1 次提交
- W
  
  [hybrid] remove the using of global ring in hybrid parallel (#34525) · 56b7ebbc
  由 WangXi 提交于 8月 03, 2021
  
  56b7ebbc
02 8月, 2021 1 次提交
- W
  
  [NPU] fix npu pipeline comm init (#34466) · 41e2d413
  由 WangXi 提交于 8月 02, 2021
  
  41e2d413
30 7月, 2021 1 次提交
- Y
  
  all reduce fusion for shardinug, test=develop (#34480) · 423ea978
  由 Yuang Liu 提交于 7月 30, 2021
  
  423ea978
29 7月, 2021 1 次提交
- Y
  
  fix the allreduce fused bug, test=develop (#34446) · b56dbe08
  由 Yuang Liu 提交于 7月 29, 2021
  
  b56dbe08
16 7月, 2021 1 次提交
- B
  
  mode_npu_gather_v2 (#34194) · 8b59f5e0
  由 Baibaifan 提交于 7月 16, 2021
  
  8b59f5e0
15 7月, 2021 1 次提交
- W
  cache core.ops (#34058) · f05098b5
  由 wanghuancoder 提交于 7月 15, 2021
```
* cache core.ops, test=develop

* refine, test=develop
```
  f05098b5
14 7月, 2021 1 次提交
- W
  
  [hybrid fix] fix pp+dp hang (#34142) · cb6510ff
  由 WangXi 提交于 7月 14, 2021
  
  cb6510ff
13 7月, 2021 1 次提交
- W
  
  [hybrid performance] Optimize tensor parallel plus pipeline parallel send recv size (#34110) · 348d043e
  由 WangXi 提交于 7月 13, 2021
  
  348d043e
08 7月, 2021 1 次提交
- M
  
  Distributed Automatic SParsity with Fleet (#33558) · 86cb3fb8
  由 Ming-Xu Huang 提交于 7月 08, 2021
  
  86cb3fb8
05 7月, 2021 1 次提交
- S
  [HybridParallel] Add amp support for pipeline_parallel (#33951) · 0b911330
  由 ShenLiang 提交于 7月 05, 2021
```
* add amp support for pp

* add amp untest
```
  0b911330

BaiXuePrincess / Paddle 与 Fork 源项目一致

BaiXuePrincess / Paddle
与 Fork 源项目一致