提交 · 5efc4146d3d3db1a7789364d1d04d444cabf5368 · Crayon鑫 / Paddle

20 5月, 2022 1 次提交
- Y
  merge dymf branch (#42714) · 3f619290
  由 yaoxuefeng 提交于 5月 20, 2022
```
merge dymf branch
```
  3f619290
17 4月, 2022 1 次提交

由 Fan Zhang 提交于 4月 17, 2022

* Adapt XPUPS - 1st version - 3.24

* Adapt XPUPS - update XPU PushSparse -  2nd version - 3.24

* Adapt XPUPS - add XPU PullSparseOp - 3nd version - 3.25

* refactor heter comm kernel

* update. test=develop

* Adapt XPUPS - modify by compilation - 4th version - 3.27

* update calc_shard_offset. test=develop

* update xpu kernel. test=develop

* update args of calc_shard_offset

* update. test=develop

* remove customGradMerger

* update. test=develop

* heter_comm update

* heter_comm update

* update calc_shard_offset. test=develop

* heter_comm update

* update args of calc_shard_offset

* update. test=develop

* remove customGradMerger

* update. test=develop

* fix. test=develop

* update. test=develop

* update. test=develop

* update optimizer kernel

* Adapt XPUPS - use WITH_XPU_KP and modify wrapper kernel function - 5th version - 3.30

* update. test=develop

* update pslib.cmake

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* Adapt XPUPS - modify by kp compilation  - 6th version - 3.30

* update. test=develop

* update. test=develop

* update. test=develop

* update optimizer kernel

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* fix. test=develop

* fix. test=develop

* used by minxu

* update heter_comm_inl

* fix. test=develop

* Adapt XPUPS - modify by kp compilation  - 7th version - 3.30

* fix. test=develop

* add optimizer kernel. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 3.31 update

* Adapt XPUPS - update kp compilation path  - 8th version - 3.31

* add optimizer kernel. test=develop

* fix kunlun not support size_t. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix kunlun not support size_t. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update heter_comm_kernel.kps 3.31

* fix. test=develop

* fix. test=develop

* update heter_comm_kernel.kps 3.31

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update heter_comm.h 3.31

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update hashtable. test=develop

* update. test=develop

* Adapt XPUPS - update by kp compilation  - 9th version - 4.1

* update hashtable. test=develop

* fix. test=develop

* update hashtable 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 10th version - 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update. test=develop

* modify by compilation 4.1

* update. test=develop

* update. test=develop

* fix. test=develop

* modify by compilation 4.1

* update. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* modify by compilation 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* modify by compilation 4.1 19:30

* fix. test=develop

* update ps_gpu_wrapper.kps 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 11th version - 4.1

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 12nd version - 4.2

* fix. test=develop

* fix. test=develop

* modify by compilation 4.2

* 4.2 update

* fix. test=develop

* template init. test=develop

* update 4.6

* fix. test=develop

* template init. test=develop

* 4.6 modify by compilation

* hashtable template init. test=develop

* hashtable template init. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=devlop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=devlop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 13nd version - 4.7

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 4.11 update

* fix. test=develop

* fix. test=develop

* 4.11 update

* update by pre-commit

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 4.12 update

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 14th version - 4.13

* 4.13 update

* 4.14 update

* 4.14 update

* 4.14 update

* 4.14 modify by merged latest compilation

* retry CI 4.14

* 4.15 pass static check

* 4.15 modify by gpups CI

* 3.16 update by gpups CI - modify ps_gpu_wrapper.h

* 4.16 update

* 4.16 pass xpu compile

* 4.16 retry CI

* 4.16 update
Co-authored-by: Nzmxdream <zhangminxu01@baidu.com>

0ef3ef28

15 4月, 2022 1 次提交
- D
  【GPUPS】add afsclient and gpupsutil (#41324) · 30a1213b
  由 danleifeng 提交于 4月 15, 2022
```
* add gpupsutil and afsclient; test=develop
```
  30a1213b
13 4月, 2022 2 次提交
- Z
  [XPUPS]add support for kunlun2 (#40985) · c9c03e7b
  由 zmxdream 提交于 4月 13, 2022
```
[XPUPS]add support for kunlun2
Co-authored-by: NWorgenZhang <frank08081993@gmail.com>
```
  c9c03e7b
- T
  optimize hbm (#41623) · d95280c7
  由 Thunderbrook 提交于 4月 13, 2022
```
* optimize hbm

* format

* format
```
  d95280c7
07 4月, 2022 1 次提交
- T
  [GPUPS] bind afs wrpper (#41227) · b3bcebbe
  由 Thunderbrook 提交于 4月 07, 2022
```
* afs wrapper

* format

* format

* macro
```
  b3bcebbe
28 3月, 2022 2 次提交
- W
  delete commonsparsetable and communicator from gpups (#40973) · 630f5b89
  由 wangguanqun 提交于 3月 28, 2022
```
* trainer and worker

* delete commonsparsetable from gpups

* delete vlog

* codestyle

* delete communicator from gpups
```
  630f5b89
- T
  [HeterPS] So Parser (#40750) · cadc4e6a
  由 Thunderbrook 提交于 3月 28, 2022
```
* So Parser

* add macro

* add macro

* slotrecord

* add macro

* code format
```
  cadc4e6a
25 1月, 2022 1 次提交
- Y
  
  reconstruct directory of ps (#39191) · 2bf9b844
  由 yaoxuefeng 提交于 1月 25, 2022
  
  2bf9b844
18 1月, 2022 1 次提交
- Z
  [GPUPS]Fix ps_gpu_wrapper (#38993) · 4aa91fd6
  由 zmxdream 提交于 1月 18, 2022
```
* update

* fix ps_gpu_wrapper. test=develop

* fix ps_gpu_wrapper. test=develop
```
  4aa91fd6
04 1月, 2022 1 次提交
- Y
  heter context support dynamic mf dim (#38487) · 59888bba
  由 yaoxuefeng 提交于 1月 04, 2022
```
heter context support dynamic mf dim
```
  59888bba
29 12月, 2021 1 次提交
- Y
  add dynamic mf size api (#38436) · 7411dab5
  由 yaoxuefeng 提交于 12月 29, 2021
```
add dynamic mf size api
```
  7411dab5
03 12月, 2021 1 次提交
- R
  refine structure for cuda and rocm (#37202) · a6d2fddb
  由 ronnywang 提交于 12月 03, 2021
```
* refine structure for cuda and rocm

* update

* update

* update

* update
```
  a6d2fddb
16 11月, 2021 1 次提交
- D
  
  [psgpu]fix pipe bug:save and pull overlap; test=develop (#37233) · 62ec644f
  由 danleifeng 提交于 11月 16, 2021
  
  62ec644f
20 10月, 2021 1 次提交

[heterps]fix heterps pipeline training (#36512) · ded3e705

由 danleifeng 提交于 10月 20, 2021

* split into PreBuildTask and BuildPull; slove endpass bug;test=develop

* change buildcpu into prebuild and buildcpu into build;test=develop

ded3e705

19 10月, 2021 1 次提交
- D
  
  [heterps]edit shrink and unseenday logit for pslib (#36194) · 9e494472
  由 danleifeng 提交于 10月 19, 2021
  
  9e494472
11 10月, 2021 1 次提交
- Y
  
  fix multi-node (#36329) · 7a724ddb
  由 yaoxuefeng 提交于 10月 11, 2021
  
  7a724ddb
15 7月, 2021 1 次提交
- D
  
  psgpu:optimize build_cpu hashset; test=develop (#34175) · 4e5cb7d8
  由 danleifeng 提交于 7月 15, 2021
  
  4e5cb7d8
06 7月, 2021 1 次提交

【HETERPS】pipeline adaptive for heterps (#33159) · bfef7feb

由 danleifeng 提交于 7月 06, 2021

* pipeline adaptive for heterps;test=develop
* fix finalize hang;test=develop
* add is_compiled_with_heterps for dataset;test=develop
* fix hashtable core when pass ins_num=0;test=develop

bfef7feb

22 6月, 2021 1 次提交
- D
  
  fix exit bug for heterps;test=develop (#33724) · 1cfbcb14
  由 danleifeng 提交于 6月 22, 2021
  
  1cfbcb14
15 4月, 2021 1 次提交

heterps support pscore (#32093) · 9f8c8f96

由 Thunderbrook 提交于 4月 15, 2021

* pscore support heterps

* fleet cmake

* fleet wrapper

* macro

* solve conflict

* solve conflict

* add unitest

* paddle enforce

* unitest

* unitest

* unitest

9f8c8f96

02 3月, 2021 1 次提交

topo and memory performance for heterps (#30440) · d1075df2

由 danleifeng 提交于 3月 02, 2021

* topo and memory performance for heterps; test=develop
* add trainwithprofiler in heter trainier; test=develop

d1075df2

24 2月, 2021 1 次提交
- T
  support multi node in heterps (#31102) · c4f279fe
  由 Thunderbrook 提交于 2月 24, 2021
```
* push multi node

* multi node

* MultiThread

* remove log

* solve bug in 30829
```
  c4f279fe
23 2月, 2021 1 次提交
- Q
  
  [ROCM] update fluid framework for rocm (part2), test=develop (#31010) · a60d93fb
  由 Qi Li 提交于 2月 23, 2021
  
  a60d93fb
01 2月, 2021 1 次提交
- T
  dump to cpu (#30750) · cb66c53c
  由 Thunderbrook 提交于 2月 01, 2021
```
* dump to cpu

* format

* format

* format
```
  cb66c53c
21 1月, 2021 1 次提交
- T
  solve build gpu task core (#30626) · 1bebc092
  由 Thunderbrook 提交于 1月 21, 2021
```
* build gpu task core

* format
```
  1bebc092
14 1月, 2021 1 次提交
- Y
  
  Heter ps new (#30198) · 6e0da01c
  由 yaoxuefeng 提交于 1月 14, 2021
  
  6e0da01c
23 12月, 2020 1 次提交

heter box (#29734) · 09b6e719

由 Thunderbrook 提交于 12月 23, 2020

* 　add heter box

* add trainer, worker, wrapper...

* format

* for ci

* format

* remove boost get

* boost & copyright

* rename

* 　rename

* format

* format

* format
Co-authored-by: Nyaoxuefeng6 <yaoxuefeng@baidu.com>

09b6e719

Crayon鑫 / Paddle 与 Fork 源项目一致

Crayon鑫 / Paddle
与 Fork 源项目一致