提交 · cf70d5b3502c59851f95de79eadb6278988466b2 · Crayon鑫 / Paddle

14 10月, 2020 1 次提交

由 zhang wenhui 提交于 10月 14, 2020

* add multitask

* add multitask, test=develop

* fix code style, test=develop

* add partail push dense, test=develop

* fix has_kay in py3, test=develop

* fix, test=develop

* fix, test=develop

* fix, test=develop

5a83496c

13 10月, 2020 1 次提交

【paddle.fleet】Update fleetrun & ps-heter (#27472) · c5f2802d

由 Chengmo 提交于 10月 13, 2020

* refine fleetrun.ps_launch

* update fleet run for multi device support

* ps_graph support ps-gpu

* fix heter save

* add heter save unittest

* fix unittest & simple code

* update fleetrun

* fix fleetrun

* fix launch barrier

* fix role maker

* add paddlecloud rolemaker unittest

* rename heter_worker_device_guard

c5f2802d

29 9月, 2020 1 次提交
- 1
  test=develop, optimize geo communicator (#26857) · cc780b19
  由 123malin 提交于 9月 29, 2020
```
* test=develop, optimize geo communicator 
```
  cc780b19
23 9月, 2020 1 次提交

large scale kv speedup (#26510) · bc5f0246

由 tangwei12 提交于 9月 23, 2020

* rename communicator meet->BatchesCounter

* fix parame recv for sparse

* geo sparse init from pserver

* optimize init from pserver

* add large scale optimizer fuse(SGD/ADAM)

* rectification init_worker and exe.run startup program

bc5f0246

20 9月, 2020 1 次提交

【paddle.fleet】Fix/role maker api fix (#27326) · d6b54de4

由 tangwei12 提交于 9月 20, 2020

* fix fleet util and gloo

* fix worker endpoints

* fix

* fix UT

* fix gloo

* fix gloo

* update gloo

* update gloo

* update gloo

* update gloo

* update gloo

* fix gloo wrapper for hdfs

* add file gloo and UT

* fix UT

* fix UT

* fix UT

* hide public method of RoleMaker

* fix UT

* GPU fleetrun support gloo

* parameterserver fleetrun support gloo

* add UT

* add UT

* fix UT

* fix get server endpoint

* fix get server endpoint

* fix UT

* hide public method of rolemaker

* hide public method of rolemaker

* hide public method of rolemaker

* Update test_fleet_rolemaker_new.py

* hide public method of rolemaker

* hide public method of rolemaker

d6b54de4

08 9月, 2020 1 次提交
- 1
  【paddle.fleet】parameter_server_optimizer support auto_strategy (#26838) · f2d68d3e
  由 123malin 提交于 9月 08, 2020
```
* test=develop, add ps auto
```
  f2d68d3e
04 9月, 2020 1 次提交
- C
  fix Heter Ps multi thread (#26876) · c4846196
  由 Chengmo 提交于 9月 04, 2020
```
* fix heter-ps multi thread
```
  c4846196
02 9月, 2020 1 次提交
- C
  supplement bug fix of parameter server (#26217) · d0962abd
  由 Chengmo 提交于 9月 02, 2020
```
* fix fluid.embedding
```
  d0962abd
31 8月, 2020 1 次提交
- Y
  
  fleet add save with whitelist test=develop (#23376) · a47d92d8
  由 yaoxuefeng 提交于 8月 31, 2020
  
  a47d92d8
30 8月, 2020 1 次提交
- C
  【paddle.fleet】Support Heter Parameter Server (#25998) · 7f2aa2db
  由 Chengmo 提交于 8月 30, 2020
```
* Support Heter Parameter Server
```
  7f2aa2db
21 8月, 2020 1 次提交
- T
  fix decay global counter (#26387) · 8e4ed662
  由 tangwei12 提交于 8月 21, 2020
```
* fix decay global counter

* remove unused print, test=distp0
```
  8e4ed662
19 8月, 2020 1 次提交
- C
  Fix ps gpu (#26218) · eeeef957
  由 Chengmo 提交于 8月 19, 2020
```
* support ps-gpu
```
  eeeef957
07 8月, 2020 1 次提交
- T
  Fix/large scale fix (#25999) · 3755564a
  由 tangwei12 提交于 8月 07, 2020
```
* fix large scale KV 
* fix single training using async ssa graph
```
  3755564a
06 8月, 2020 1 次提交

add heter ps mode (#25682) · 0cb60c70

由 Thunderbrook 提交于 8月 06, 2020

* add heter ps mode

* code style
test=develop

* add with_pslib
test=develop

* unitest
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* code style
test=develop

* test monitor
test=develop

* prepare trainer
test=develop

* code style
test=develop

0cb60c70

03 8月, 2020 1 次提交
- G
  
  fix stratege.set_program_config (#25864) · 6773fcc1
  由 gentelyang 提交于 8月 03, 2020
  
  6773fcc1
30 7月, 2020 1 次提交

Integrated Trainer of Parameter Server (API add... · caa90a65

由 tangwei12 提交于 7月 30, 2020

Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) (#22957)

* Integrated Trainer of Parameter Server

caa90a65

30 4月, 2020 1 次提交
- X
  add timeout and http store in communication (#23436) · 1034ca31
  由 xujiaqi01 提交于 4月 30, 2020
```
* add timeout and http store in communication, add revert and confirm in fleet
* test=develop
```
  1034ca31
13 4月, 2020 1 次提交
- X
  add unit accessor (#23703) · 15ce8e21
  由 xujiaqi01 提交于 4月 13, 2020
```
* add unit accessor in fleet, support DownpourUnitAccessor
* test=develop
```
  15ce8e21
11 4月, 2020 2 次提交
- X
  fix add dense table (#23681) · 70f7c23f
  由 xujiaqi01 提交于 4月 11, 2020
```
* fix add dense table
test=develop

* fix
test=develop

* fix
test=develop
```
  70f7c23f
- X
  add save with prefix (#23449) · d98084e7
  由 xujiaqi01 提交于 4月 11, 2020
```
* add save with prefix
* test=develop
```
  d98084e7
02 4月, 2020 1 次提交
- X
  
  fix dump slot in strategy (#23398) · 21f59779
  由 xujiaqi01 提交于 4月 02, 2020
  
  21f59779
01 4月, 2020 1 次提交
- X
  add fleet pslib pull and push sparse op and push dense op (#23139) · 3a45767d
  由 xujiaqi01 提交于 4月 01, 2020
```
* add fleet pslib pull and push sparse op and push dense op
* test=develop
```
  3a45767d
27 3月, 2020 1 次提交

fix no_cvm in config_fleet (#22818) · c8f9e66b

由 xujiaqi01 提交于 3月 27, 2020

* fix no cvm, when accessor is DownpourSparseValueAccessor, set no_cvm=True
* test=develop

c8f9e66b

26 3月, 2020 1 次提交
- X
  add clear one table (#23089) · 68ea1ad5
  由 xujiaqi01 提交于 3月 26, 2020
```
* add clear_one_table
* test=develop
```
  68ea1ad5
20 3月, 2020 1 次提交
- Y
  
  add pslib SparseDoubleTable test=develop (#23053) · 995a6376
  由 yaoxuefeng 提交于 3月 20, 2020
  
  995a6376
18 3月, 2020 1 次提交
- T
  Revert "Integrated API of Parameter Server (#22710)" test=develop (#23071) · c4a6a0e2
  由 tangwei12 提交于 3月 18, 2020
```
This reverts commit 66fce9e8.
```
  c4a6a0e2
17 3月, 2020 1 次提交
- T
  Integrated API of Parameter Server (#22710) · 66fce9e8
  由 tangwei12 提交于 3月 17, 2020
```
Fleet Parameter Server API Integrated
```
  66fce9e8
10 3月, 2020 1 次提交
- Y
  fix add grad bug test=develop (#22924) · c5cbe7f0
  由 yaoxuefeng 提交于 3月 10, 2020
```
* fix add grad bug test=develop

* update style test=develop
```
  c5cbe7f0
03 3月, 2020 1 次提交
- 1
  test=develop, optimize distributedstrategy (#22677) · 0f9d4081
  由 123malin 提交于 3月 03, 2020
```
* test=develop, optimize distributedstrategy
```
  0f9d4081
28 2月, 2020 1 次提交
- T
  
  fix typo word (#22784) · 433cef03
  由 tianshuo78520a 提交于 2月 28, 2020
  
  433cef03
23 2月, 2020 1 次提交
- T
  
  fix typo words (#22653) · d2ba91aa
  由 tianshuo78520a 提交于 2月 23, 2020
  
  d2ba91aa
22 2月, 2020 1 次提交
- T
  SYNC with communicaotor (#22344) · 66a31501
  由 tangwei12 提交于 2月 22, 2020
```
* add sync communicator and implement
```
  66a31501
17 2月, 2020 1 次提交
- 1
  
  support dumping params/grads in transpiler mode (#22490) · 00594c1c
  由 123malin 提交于 2月 17, 2020
  
  00594c1c
16 2月, 2020 1 次提交
- T
  add texttable for pretty flag output (#22584) · 1aab3e61
  由 tangwei12 提交于 2月 16, 2020
```
pretty print for communicator flag
```
  1aab3e61
12 2月, 2020 1 次提交
- T
  fix bug with compiledProgram (#22495) · b0675c81
  由 tangwei12 提交于 2月 12, 2020
```
* add thread barrier for the compiled program
```
  b0675c81
11 2月, 2020 1 次提交

multi-loss optimization by adding a DownpourOpt worker (#22025) · 2235ee1a

由 yaoxuefeng 提交于 2月 11, 2020

* update

* update test=develop

* update compile set test=develop

* update compile set test=develop

* update test=develop

* update test=develop

* update test=develop

* update compile setting test=develop

* update compile setting test=develop

* update run demo test=develop

* update test=develop

* update test=develop

* fix test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

* update format test=develop

* update format test=develop

* update style test=develop

* update style test=develop

* change style test=develop

* change style test=develop

* change style test=develop

* add dataset unittest test=develop

* update test=develop

* update for record test=develop

* udpate style for record test=develop

* update for record test=develop

* update for record test=develop

* update for record test=develop

* fix format test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

* update test=develop

2235ee1a

03 2月, 2020 1 次提交
- T
  fix bug with half (#22378) · 7e2665c5
  由 tangwei12 提交于 2月 03, 2020
```
* fix bug with half communicator
```
  7e2665c5
02 2月, 2020 1 次提交
- X
  add GeneralRoleMaker (#22295) · 371f377b
  由 xujiaqi01 提交于 2月 02, 2020
```
* add GeneralRoleMaker which is for general usage
* test=develop
```
  371f377b
17 1月, 2020 1 次提交
- T
  integrated HALF_ASYNC to communicator (#21869) · 82bc814a
  由 tangwei12 提交于 1月 17, 2020
```
* add half_async in the communicator
* fix DistributedStrategy
```
  82bc814a
06 1月, 2020 1 次提交
- 1
  add distributed_strategy (#21710) · 7fb817d4
  由 123malin 提交于 1月 06, 2020
```
* add distributed_strategy
```
  7fb817d4

Crayon鑫 / Paddle 与 Fork 源项目一致

Crayon鑫 / Paddle
与 Fork 源项目一致