提交 · 37216a8fb9c95c0a477fc2eef67a8ca27f48b6a6 · PaddlePaddle / Paddle

11 7月, 2022 1 次提交

[Dygraph] Support new apis in ProcessGroupNCCL (#43918) · 37216a8f

由 Haohongxiang 提交于 7月 11, 2022

* fix conflict

* new pg apis

* add docs of new apis

* update

* fix coverage

* update

* fix bug

* fix reduce scatter

* fix api

* update
Co-authored-by: NForFishes <2282912238@qq.com>

37216a8f

02 7月, 2022 1 次提交

unify cpu context, part2 (#44012) · 755438a7

由 Leo Chen 提交于 7月 02, 2022

* fix init()

* delete test_device_context

* replace CPUDeviceContext with CPUContext

* fix test_scalar

* remove dot_op.cc

* fix compile

755438a7

28 6月, 2022 2 次提交
- R
  Remove boost::variant (#43100) · b3cf28f8
  由 Ruibiao Chen 提交于 6月 28, 2022
```
* boost::variant -> paddle::variant

* boost::variant.apply_visit -> paddle::visit

* Update pybind_boost_hraders.h

* Fix CINN compilation errors

* Revert FetchResultType
```
  b3cf28f8
- Q
  
  fix compiling error when WITH_PSCORE=ON on DCU, test=develop (#43833) · 5d6bdabb
  由 Qi Li 提交于 6月 28, 2022
  
  5d6bdabb
26 6月, 2022 1 次提交
- S
  
  format all files in fluid using new config (#43776) · 576236a0
  由 Sing_chan 提交于 6月 26, 2022
  
  576236a0
13 6月, 2022 1 次提交
- S
  
  Support DCU in ProcessGroup (#43356) · c92b3805
  由 ShenLiang 提交于 6月 13, 2022
  
  c92b3805
07 6月, 2022 1 次提交
- H
  [Dygraph] Fix bugs of EagerReducer for complex control flows (#43252) · 2922985a
  由 Haohongxiang 提交于 6月 07, 2022
```
* fix bugs of reducer

* update

* update
```
  2922985a
05 6月, 2022 1 次提交
- S
  
  【code format check upgrade】 step2：clang-format (#42840) · a3730dc8
  由 Sing_chan 提交于 6月 05, 2022
  
  a3730dc8
04 6月, 2022 1 次提交
- S
  
  【code format check upgrade】 step2：cmake-format (#43057) · 92568edb
  由 Sing_chan 提交于 6月 04, 2022
  
  92568edb
28 5月, 2022 1 次提交
- S
  [Bug Fix]Fix global_scatter/global_gather in ProcessGroup (#43027) · 8cc2e28c
  由 ShenLiang 提交于 5月 28, 2022
```
* fix alltoall

* rename utest
```
  8cc2e28c
18 5月, 2022 1 次提交
- Y
  
  [collective] dynamic shape for send_v2 and recv_v2 (#42765) · 1f64c42e
  由 Yuang Liu 提交于 5月 18, 2022
  
  1f64c42e
11 5月, 2022 1 次提交
- H
  [Dygraph] Support diff batch for sparse of EagerReducer (#42646) · c5232b4b
  由 Haohongxiang 提交于 5月 11, 2022
```
* support diff batch for sparse of eagerreducer

* fix
```
  c5232b4b
06 5月, 2022 1 次提交
- L
  
  add send/recv for ProcessGroupHeter (#42318) · df113208
  由 lilong12 提交于 5月 06, 2022
  
  df113208
29 4月, 2022 1 次提交
- J
  
  Using small vector for slot and merge edge into grad_slot_meta (#42350) · 2bee99df
  由 Jiabin Yang 提交于 4月 29, 2022
  
  2bee99df
26 4月, 2022 1 次提交

fix heter_client&heter_server (#42188) · 27cb52a4

由 ziyoujiyi 提交于 4月 26, 2022

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* arm_brpc compile

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* only output is ok

* base is ok

* .

* .

* .

* .

* .

* .

* .

* .

* add switch server bin

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* adapt brpc ssl

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* fix heter_server & heter_client

* .

* .

* int->int64_t

* .

27cb52a4

25 4月, 2022 1 次提交
- merge all phi kernel lib to several big static lib, reduce link command (#42185) · e52e6d01
  由 zhouweiwei2014 提交于 4月 25, 2022
```
* merge all phi lib to several big static lib

* merge all phi lib to several big static lib
```
  e52e6d01
19 4月, 2022 1 次提交
- B
  
  fix_nccl_barrier (#41970) · 3e8b6bbc
  由 Baibaifan 提交于 4月 19, 2022
  
  3e8b6bbc
18 4月, 2022 1 次提交
- L
  
  fix bug for eager mode distributed training (#41841) · 34f30f79
  由 lilong12 提交于 4月 18, 2022
  
  34f30f79
15 4月, 2022 1 次提交
- L
  
  update (#41762) · 482e5b6c
  由 lilong12 提交于 4月 15, 2022
  
  482e5b6c
14 4月, 2022 1 次提交
- C
  
  remove all is initialized using (#41766) · 4733fe60
  由 Chen Weihang 提交于 4月 14, 2022
  
  4733fe60
13 4月, 2022 2 次提交
- L
  
  Use densetensor instead of Tensor for ProcessGroup (#41403) · 1e56ca8a
  由 lilong12 提交于 4月 13, 2022
  
  1e56ca8a
- C
  [Phi&CustomOp] Remove deprecated enum PlaceType for custom op & add warning (#41647) · 78ef1071
  由 Chen Weihang 提交于 4月 13, 2022
```
* remove old custom op placetype

* replace dist  placetype using

* add with gpu macro

* fix mutable_data error

* fix set value error

* add comment
```
  78ef1071
07 4月, 2022 2 次提交
- L
  
  use group id to differentiate keys for tcp store (#41496) · 75227c9e
  由 lilong12 提交于 4月 07, 2022
  
  75227c9e
- L
  
  add send/recv to/from switch module for PrcoessGroupHeter (#41285) · 633ac4e6
  由 lilong12 提交于 4月 07, 2022
  
  633ac4e6
04 4月, 2022 1 次提交
- H
  [Dygraph] Support sparse tensor in refactored reducer (#40836) · 1b031987
  由 Haohongxiang 提交于 4月 04, 2022
```
* [Dygraph] Support sparse tensor in refactored reducer

* add uts

* refactor

* update

* fix bugs
```
  1b031987
02 4月, 2022 1 次提交
- L
  
  wrapper the usage of distributed functions (#39720) · 8df46229
  由 lilong12 提交于 4月 02, 2022
  
  8df46229
31 3月, 2022 2 次提交
- Z
  [Phi] Rename ScalarArray to IntArray (#40975) · e559fe41
  由 zyfncg 提交于 3月 31, 2022
```
* rename scalar_array to int_array

* update cmake

* fix conflict

* remove useless log
```
  e559fe41
- L
  
  Pg heter cloud (#40911) · 92faeedf
  由 lilong12 提交于 3月 31, 2022
  
  92faeedf
22 3月, 2022 1 次提交
- Z
  [Phi] Replace Backend by Place in C++ API (#40732) · 5b7fadec
  由 zyfncg 提交于 3月 22, 2022
```
* replace Backend by Place in C++ API

* fix left code

* fix test_to_api bug
```
  5b7fadec
21 3月, 2022 1 次提交

Refine to_tensor for eager mode and support gpu_pinned (#40535) · 45d1fb8d

由 0x45f 提交于 3月 21, 2022

* Refine to_tensor for eager mode

* support gpu_pinned

* refine code

* support gpu_pinned copy_to

* fix layer.__setattr__

* support to_tensor for gpu_pinned

* fix unit test

* refine gpu_pinned

* restore the original code

* add is_gup_pinned() and refine eager.Tensor._copy_to()

45d1fb8d

18 3月, 2022 2 次提交
- S
  [DataParallel]Support control flow in new DP (#40593) · 984eacb3
  由 ShenLiang 提交于 3月 18, 2022
```
* fix bug

* fix bug
```
  984eacb3
- L
  
  Use store for gloo process group (#40629) · bb2cb762
  由 lilong12 提交于 3月 18, 2022
  
  bb2cb762
15 3月, 2022 1 次提交

[Dygraph] Refactoring of reducer in DataParallel (#40389) · 1a32391c

由 Haohongxiang 提交于 3月 15, 2022

* refactor reducer

* modify cmakelists

* solve conflicts

* rename group and update process_group

* fix bugs of ProcessGroupNCCL

* modify for CIs

* refactoring reducer

1a32391c

11 3月, 2022 1 次提交
- L
  
  fix the bug for processgroup_hccl compiling (#40437) · f70f5e4f
  由 lilong12 提交于 3月 11, 2022
  
  f70f5e4f
08 3月, 2022 1 次提交
- L
  add the implementation of process group for hccl (#40228) · 73583f86
  由 lilong12 提交于 3月 08, 2022
```
* add pg_hccl
```
  73583f86
07 3月, 2022 1 次提交
- L
  
  initialize processgroupnccl with store (#40181) · 0ad25fb9
  由 lilong12 提交于 3月 07, 2022
  
  0ad25fb9
04 3月, 2022 1 次提交
- L
  add communication api for ProcessGroupGloo (#40100) · 5435459a
  由 lilong12 提交于 3月 04, 2022
```
* add pg_gloo apis
```
  5435459a
03 3月, 2022 2 次提交
- L
  
  add communication api for ProcessGroupNCCL (#40097) · b565b349
  由 lilong12 提交于 3月 03, 2022
  
  b565b349
- L
  Add the implementation of Gloo for ProcessGroup (#39892) · c16f85f9
  由 lilong12 提交于 3月 03, 2022
```
* add pg_gloo
```
  c16f85f9
02 3月, 2022 1 次提交
- B
  
  add_new_comm_primitive (#40040) · 4e00d2bb
  由 Baibaifan 提交于 3月 02, 2022
  
  4e00d2bb

PaddlePaddle / Paddle 大约 1 年 前同步成功

PaddlePaddle / Paddle
大约 1 年前同步成功