提交 · a74208c12e402498b29d8d199533b619bc8bbacb · csdn_franckjun / Paddle

20 7月, 2021 1 次提交
- W
  
  [hybrid parallel] Optimize pipeline memory (#34230) · a74208c1
  由 WangXi 提交于 7月 20, 2021
  
  a74208c1
09 7月, 2021 1 次提交
- Y
  
  [hybrid performance] pipeline cache trainer (#33998) · 98c7191d
  由 Yuang Liu 提交于 7月 09, 2021
  
  98c7191d
29 6月, 2021 1 次提交
- T
  Remove HeterBox (#33718) · 66c7a076
  由 Thunderbrook 提交于 6月 29, 2021
```
* remove heterbox

* remove heterbox
```
  66c7a076
25 5月, 2021 1 次提交
- D
  fix hogwild_worker init_place bug (#33078) · 88dfb30f
  由 danleifeng 提交于 5月 25, 2021
```
* fix hogwild_worker dev_ctx place bug; test=develop
```
  88dfb30f
10 5月, 2021 1 次提交
- T
  [pslib] pslib with cmake (#32800) · fbbc3394
  由 Thunderbrook 提交于 5月 10, 2021
```
* pslib with cmake

* heter util

* vlog

* heter server test

* add dtor

* cmake
```
  fbbc3394
08 5月, 2021 1 次提交
- D
  【heterps】support cuda11 for heterps; add profiler in oneps (#32640) · beab9563
  由 danleifeng 提交于 5月 08, 2021
```
* add trainprofiler for heterps in oneps; test=develop

* add set_use_ps_gpu; test=develop
```
  beab9563
06 5月, 2021 1 次提交
- G
  
  Fix bugs of pipeline on ascend. (#32737) · c5ae21f4
  由 gongweibao 提交于 5月 06, 2021
  
  c5ae21f4
23 4月, 2021 1 次提交
- B
  solve hccl communicate conflict (#32447) · 0e74eea2
  由 Baibaifan 提交于 4月 23, 2021
```
solve hccl communicate conflict (#32447)
```
  0e74eea2
15 4月, 2021 1 次提交

heterps support pscore (#32093) · 9f8c8f96

由 Thunderbrook 提交于 4月 15, 2021

* pscore support heterps

* fleet cmake

* fleet wrapper

* macro

* solve conflict

* solve conflict

* add unitest

* paddle enforce

* unitest

* unitest

* unitest

9f8c8f96

01 4月, 2021 1 次提交
- T
  LOG CLEAN (#31819) · 0589ed21
  由 tangwei12 提交于 4月 01, 2021
```
* upgrade vlog

* train from dataset fetch optimize
```
  0589ed21
22 3月, 2021 1 次提交
- L
  [3D-parallel] add 1f1b scheduler for pipeline (#31566) · a501a7b0
  由 lilong12 提交于 3月 22, 2021
```
* add 1f1b scheduler for pp, test=develop
```
  a501a7b0
11 3月, 2021 1 次提交
- T
  solve bug in heter mode (#31531) · 3789a699
  由 Thunderbrook 提交于 3月 11, 2021
```
* heter bug

* format

* format
```
  3789a699
02 3月, 2021 1 次提交

topo and memory performance for heterps (#30440) · d1075df2

由 danleifeng 提交于 3月 02, 2021

* topo and memory performance for heterps; test=develop
* add trainwithprofiler in heter trainier; test=develop

d1075df2

25 2月, 2021 1 次提交
- Q
  
  [ROCM] update fluid framework for rocm (part4), test=develop (#31013) · 580447d0
  由 Qi Li 提交于 2月 25, 2021
  
  580447d0
23 12月, 2020 1 次提交

heter box (#29734) · 09b6e719

由 Thunderbrook 提交于 12月 23, 2020

* 　add heter box

* add trainer, worker, wrapper...

* format

* for ci

* format

* remove boost get

* boost & copyright

* rename

* 　rename

* format

* format

* format
Co-authored-by: Nyaoxuefeng6 <yaoxuefeng@baidu.com>

09b6e719

23 11月, 2020 2 次提交

L
enable pipeline to run with Executor.run() (#28373) · f77a78cd
由 lilong12 提交于 11月 23, 2020
```
* update, test=develop
```
f77a78cd

support ps-gpu (#28752) · 0073f9bd

由 Thunderbrook 提交于 11月 23, 2020

* ps gpu transpile

* ps gpu

* remove op

* gps trainer

* local ps

* add macro

* HeterBox

* def cuda

* tab

* code style

* style

Co-authored-by: Thunderbrook <a754913769#163.com>

0073f9bd

14 10月, 2020 1 次提交

Multi task (#26002) · 5a83496c

由 zhang wenhui 提交于 10月 14, 2020

* add multitask

* add multitask, test=develop

* fix code style, test=develop

* add partail push dense, test=develop

* fix has_kay in py3, test=develop

* fix, test=develop

* fix, test=develop

* fix, test=develop

5a83496c

25 9月, 2020 1 次提交

add xpu in heter mode (#27000) · 6f69a4cb

由 Thunderbrook 提交于 9月 25, 2020

* add xpu in heter mode
test=develop

* BOOST_CONST_GET; PADDLE_THROW
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* refine
test=develop

* refine
test=develop

* refine
test=develop

* refine code
test=develop

6f69a4cb

24 9月, 2020 1 次提交

use iwyu clean include (#27267) · df43905f

由 wanghuancoder 提交于 9月 24, 2020

* use iwyu clean include, test=develop, test=win

* compilation error, test=develop

* fix compilation error2, test=develop

* fix compilation error3, test=develop

* fix compilation error4, test=develop

* fix compilation error5, test=develop

* fix compilation error6, test=develop

* fix compilation error7, test=develop

* fix compilation error8, test=develop

* fix compilation error8, test=develop

* fix compilation error10, test=develop

* fix compilation error11, test=develop

df43905f

17 9月, 2020 1 次提交
- L
  
  fix the bug of non-exit, test=develop (#27350) · 9f9d15e2
  由 lilong12 提交于 9月 17, 2020
  
  9f9d15e2
06 8月, 2020 1 次提交

add heter ps mode (#25682) · 0cb60c70

由 Thunderbrook 提交于 8月 06, 2020

* add heter ps mode

* code style
test=develop

* add with_pslib
test=develop

* unitest
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* test monitor
test=develop

* prepare trainer
test=develop

* code style
test=develop

0cb60c70

30 7月, 2020 1 次提交
- L
  fix test_pipeline, test=develop (#25808) · 5f30e57c
  由 lilong12 提交于 7月 30, 2020
```
* fix test_pipeline, test=develop
```
  5f30e57c
07 7月, 2020 1 次提交
- L
  add the support for pipeline (#24560) · e39aa70e
  由 lilong12 提交于 7月 07, 2020
```
* add device_worker for pipeline, test=develop
```
  e39aa70e
03 6月, 2020 1 次提交
- 1
  downpour_worker增加try_catch机制，打印program所有参数 (#24700) · 9d2bd0ac
  由 123malin 提交于 6月 03, 2020
```
* test=develop, add try_catch for debug
```
  9d2bd0ac
19 5月, 2020 1 次提交

Random Dump (#24477) · 0ec3a42e

由 hutuxian 提交于 5月 19, 2020

* Refactor code for dump_field & dump_param: abstracting the common function in base class.
* Support dump randomly & random with lineid
* Support specify the random interval, which avoids printing too much logs.

0ec3a42e

01 4月, 2020 1 次提交
- X
  add fleet pslib pull and push sparse op and push dense op (#23139) · 3a45767d
  由 xujiaqi01 提交于 4月 01, 2020
```
* add fleet pslib pull and push sparse op and push dense op
* test=develop
```
  3a45767d
17 2月, 2020 1 次提交
- 1
  
  support dumping params/grads in transpiler mode (#22490) · 00594c1c
  由 123malin 提交于 2月 17, 2020
  
  00594c1c
11 2月, 2020 2 次提交

multi-loss optimization by adding a DownpourOpt worker (#22025) · 2235ee1a

由 yaoxuefeng 提交于 2月 11, 2020

* update

* update test=develop

* update compile set test=develop

* update compile set test=develop

* update test=develop

* update test=develop

* update test=develop

* update compile setting test=develop

* update compile setting test=develop

* update run demo test=develop

* update test=develop

* update test=develop

* fix test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

* update format test=develop

* update format test=develop

* update style test=develop

* update style test=develop

* change style test=develop

* change style test=develop

* change style test=develop

* add dataset unittest test=develop

* update test=develop

* update for record test=develop

* udpate style for record test=develop

* update for record test=develop

* update for record test=develop

* update for record test=develop

* fix format test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

2235ee1a

Compile without nccl deps. [1/2] (#22509) · a90fa540

由 Wilber 提交于 2月 11, 2020

支持不依赖nccl进行编译。[1/2]

多卡下，如果没有打开WITH_NCCL开关编译，多卡不能通信，则只能选择一张卡使用。
Co-authored-by: N石晓伟 <39303645+Shixiaowei02@users.noreply.github.com>

a90fa540

17 1月, 2020 1 次提交
- T
  integrated HALF_ASYNC to communicator (#21869) · 82bc814a
  由 tangwei12 提交于 1月 17, 2020
```
* add half_async in the communicator
* fix DistributedStrategy
```
  82bc814a
18 12月, 2019 1 次提交
- X
  fix compiled error when with_pslib=on (#21769) · 0eb4d990
  由 xujiaqi01 提交于 12月 18, 2019
```
* fix compiled error of butil when with_pslib=on and with_testing=on
* test=develop
```
  0eb4d990
20 11月, 2019 1 次提交

support general embedding params (#21217) · 349e82d6

由 Thunderbrook 提交于 11月 20, 2019

* general table

* add sparse table
test=develop

* no cvm
test=develop

* add no_cvm
test=develop

* add note
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* add key of optimizer
test=develop

349e82d6

15 11月, 2019 1 次提交

add copy table (#21086) · 9e045170

由 xujiaqi01 提交于 11月 15, 2019

* copy some feasigns and corresponding embeddings from one sparse table to another
* copy all feasigns and corresponding embeddings from one sparse table to another
* copy all dense params from one table to another
* copy some local vars to other local vars

9e045170

31 10月, 2019 1 次提交

support dump param of model into afs (#20302) · 59bcdc8a

由 Thunderbrook 提交于 10月 31, 2019

* support dump param to afs
test=develop

* code style
test=develop

* code style
test=develop

* dump param
test=develop

* dump param
test=develop

* dump param
test=develop

* dump param
test=develop

59bcdc8a

25 10月, 2019 1 次提交

fix several sparse table issuses (#20686) · 48669aa8

由 xujiaqi01 提交于 10月 25, 2019

* no longer need to define all embedding layers (no one less) of all slots in each program. make trainer_param repeated in ps.proto.
* add find_distributed_lookup_table_grads instead of hard code GRAD
* support embedding stop gradient. push sparse has error before fix this.* 
* fix fill sparse, skip slots which do not have embedding. each slot's embedding in a sparse table should be used in all training programs before fix this.
* fix pull sparse, skip slots which do not have embedding.
* fix collect feasign label info, skip slots which do not have embedding.
* support when there are multi sparse tables in one or multi training programs, each program can pull/push its own related sparse tables instead of all sparse tables.
* test=develop

48669aa8

18 10月, 2019 1 次提交
- X
  add check nan / inf in downpour worker (#20694) · 5223b0dd
  由 xujiaqi01 提交于 10月 18, 2019
```
* add check nan / inf in downpour worker during training
* test=develop
```
  5223b0dd
25 9月, 2019 1 次提交
- X
  fix memory leak in HogwildWorker (#19956) · f50e701b
  由 xujiaqi01 提交于 9月 25, 2019
```
fix memory leak in HogwildWorker,  whose ops are  explicitly deleted in destructor
```
  f50e701b
30 8月, 2019 1 次提交

add thread scope stat accurate metrics test=develop (#19480) · 10ca3f96

由 yaoxuefeng 提交于 8月 30, 2019

* add thread scope stat accurate metrics test=develop

* fix style

* fix style

* fix style

* fix style test=develop

* fix style test=develop

* fix style test=develop

* fix style test=develop

* fix style test=develop

* fix style test=develop

* fix style test=develop

* fix conflict

* fix style

* fix style test=develop

* fix error test=develop

* fix error test=develop

10ca3f96

29 8月, 2019 1 次提交

support debug each output of each ins (#19004) · 1fe468d3

由 Thunderbrook 提交于 8月 29, 2019

* dump slot

* test

* proto

* dump slot

* test

* proto

* code style

* code style

* code style

* style

* add delete after unseen days

* add unseen days

* code style

* conflict solve
test=develop

* add clear model

* code style
test=develop

* code style
test=develop

* support debug tensor of each ins
test=develop

* support debug tensor of each ins
test=develop

* learning rate

* code style

* code style

* code style

* code style

* code style

* code style

* code style

* code style

* code style

* code style

* code style

* code style

* code style
test=develop

* code style
test=develop

* unitest

* style

* style

* multi phase

* add channel

* code style

* style

* style

* unitest

* style

* define

* define
test=develop

* style
test=develop

* rm define
test=develop

* linux

* linux
test=develop

* style
test=develop

* output format
test=develop

* windows ci
test=develop

1fe468d3

csdn_franckjun / Paddle 与 Fork 源项目一致

csdn_franckjun / Paddle
与 Fork 源项目一致