提交 · 1e18b57be32775fbad0c1262c25481900162b9a3 · 机器未来 / Paddle

20 4月, 2022 16 次提交

L

update (#41762) (#41843) · 1e18b57b
由 lilong12 提交于 4月 20, 2022

1e18b57b
H
[Dygraph] Refactor Model Parallel in eager mode (#41761) (#41960) · 5ce7f48d
由 Haohongxiang 提交于 4月 20, 2022
```
* refactor mp in eager mode

* update

* update

* add uts
```
5ce7f48d

cherry pick recent updates in graph-engine to release2.3 (#42027) · ef78c9c2

由 seemingwang 提交于 4月 20, 2022

* gpu_graph engine optimization+ (#41455)

* extract sub-graph

* graph-engine merging

* fix

* fix

* fix heter-ps config

* test performance

* test performance

* test performance

* test

* test

* update bfs

* change cmake

* test

* test gpu speed

* gpu_graph_engine optimization

* add ssd layer to graph_engine

* fix allocation

* fix syntax error

* fix syntax error

* fix pscore class

* fix

* recover test

* recover test

* fix spelling

* recover

* fix

* Cpu gpu graph engine (#41942)

* extract sub-graph

* graph-engine merging

* fix

* fix

* fix heter-ps config

* test performance

* test performance

* test performance

* test

* test

* update bfs

* change cmake

* test

* test gpu speed

* gpu_graph_engine optimization

* add ssd layer to graph_engine

* fix allocation

* fix syntax error

* fix syntax error

* fix pscore class

* fix

* recover test

* recover test

* fix spelling

* recover

* fix

* fix linking problem

* remove comment

ef78c9c2

[cherry-pick] Cherry pick pr of new-exec (#42009) · 80992253

由 Leo Chen 提交于 4月 20, 2022

* [new-exec] shrink downstream map (#41471)

* shrink downstream map

* shrink last live ops of var

* add comment

* fix bug

* add dependency for send/recv to support pp parallel (#41652)

* [new-exec] clear the scope listener after run (#41947)

* clear the listener after run

* only sync variables in program

* refine code

* fit for lod_tensor_blocking_queue

80992253

X

[cherry-pick]fix StickBreakingTransform forward error when input rank is over 2 (#41940) (#41983) · 60c212d5
由 Xiaoxu Chen 提交于 4月 20, 2022

60c212d5
H
windows compile add onnxruntime switch (#41988) (#42015) · 23cc4636
由 heliqi 提交于 4月 20, 2022
```
windows编译脚本增加onnxruntime编译选项
```
23cc4636
N
[cherry-pick] Add AutoTune to reader.py for DataLoader (#42004) · a8ee07c8
由 niuliling123 提交于 4月 20, 2022
```
Add AutoTune to reader.py for DataLoader
```
a8ee07c8
F

fix:conflict (#41913) · 4ef0a0b7
由 feng_shuai 提交于 4月 20, 2022

4ef0a0b7

Cherry-pick PR41720, support no_need_buffer in eager_fluid state (#41720) (#41956) · 279d2db3

由 pangyoki 提交于 4月 20, 2022

* support no_need_buffer in eager_fluid state

* change no_need_buffer info from fwd_info to bwd_info

* fix CI fail, gru_unit donnot use no_need_buffer

* fix conflict between no_need_buffer and dispensable

* use tensor.define in dispensable

* solve conflict

* solve conflict

279d2db3

J
Fixed performance issue regarding BackwardRun using add_final_state_dygraph (#41912) (#41991) · 968bf46e
由 Jiabin Yang 提交于 4月 20, 2022
```
Co-authored-by: NZhanlue Yang <jim19930609@gmail.com>
```
968bf46e

[Phi] Support construct Scalar by using Non-CPU Tensor (#41765) (#41963) · 3b25afb2

由 YuanRisheng 提交于 4月 20, 2022

* support construct scalar using non-cpu tensor

* fix bugs when run unittest

* fix compile bugs

* fix bugs when run ci

* fix compile bugs

* fix bugs when move copy

* perfect unit test

* perfect unittest

* update according to comment

* add target dependency

* deal with conflict

* fix bugs when run unit test

* fix unit test bugs

3b25afb2

[Cherry-pick]fix bug for eager mode distributed training (#41975) · 9a75b4b9

由 Aurelius84 提交于 4月 20, 2022

* update (#41636)

* fix bug for eager mode distributed training (#41841)
Co-authored-by: Nlilong12 <lilong12@baidu.com>

9a75b4b9

[Cherry-Pick]Fix expand_sig infershape BUG under static graph mode and... · 93f0e594

由 Aurelius84 提交于 4月 20, 2022

[Cherry-Pick]Fix expand_sig infershape BUG under static graph mode and NeedTransformPlace behavior if set skip_transform in yaml (#41973)

* [Phi]Fix expand_sig infershape BUG under static graph mode (#41936)

* [Phi]Fix expand_sig infershape BUG under static graph mode

* [Phi]Fix expand_sig infershape BUG under static graph mode

* [Phi]Fix unittest

* [Phi]Fix unittest

* [Eager]Fix NeedTransformPlace behavior if set skip_transform in yaml (#41920)

* [Eager]Fix NeedTransformPlace behavior if set skip_transform in yaml

* add unittest for full_like

* fix unittest

93f0e594

[cherry-pick] Refine user experience for profiler (#41989) · 2ea5e02c

由 chenjian 提交于 4月 20, 2022

* fix divide zero error when cpu only (#41794)

* reduce performance influence by RecordEvent in Python (#41822)

* reduce performance influence

* add unit test

* fix

* Rebase for profiler statistic ratio (#41939)

* fix according to suggestion

* add kernel summary

* improve coverage

2ea5e02c

Z
[cherry-pick] Implement Amp Layout AutoTune(41884) (#41964) · 85a4ecb6
由 Zhang Ting 提交于 4月 20, 2022
```
 cherry-pick #41884 
```
85a4ecb6
F

strided_slice (#41573) (#41914) · d17e39c2
由 feng_shuai 提交于 4月 20, 2022

d17e39c2

19 4月, 2022 17 次提交

[cherry-pick] add rsqrt, equal_all, expand yaml and unittest (#41443, #41540) (#41965) · 018245d8

由 zyfncg 提交于 4月 19, 2022

* add rsqrt yaml and unittest (#41443)

* Add expand equal all yaml (#41540)

* add expand, poisson

* add poison grad

* add expand equal_all poisson triangular solve yaml
Co-authored-by: Nhong <43953930+phlrain@users.noreply.github.com>

018245d8

Z
[XPUPS]add rename for heter_ps.cu (#41922) (#41968) · 13202ff7
由 zmxdream 提交于 4月 19, 2022
```
* add rename for heter_ps.cu

* update. test=develop

* update. test=develop

* fix. test=develop
```
13202ff7

[Eager] Fix numpy interface for constructing empty tensor (#41904) (#41954) · 551e9140

由 Weilong Wu 提交于 4月 19, 2022

* [Eager] Fix numpy interface for constructing empty tensor

* Fix CI, construct empty tensor

* Modify empty tensor's shape from [] to [0]

* Add more test for constructing empty tensor

551e9140

W
[Eager] paddle.sort interface use final_state (#41934) (#41955) · 5e8d7804
由 Weilong Wu 提交于 4月 19, 2022
```
* [Eager] paddle.sort interface use final_state

* Add eager test case for paddle.sort()
```
5e8d7804
Z

fix setTensorWrapper with no_need_buffers (#41892) (#41952) · 21c333df
由 zhangbo9674 提交于 4月 19, 2022

21c333df
Y
[Cherry-pick 2.3] Autotune the workspace and kernel choosing of conv (#41833) · b4adbe5c
由 Yiqun Liu 提交于 4月 19, 2022
```
Cherry-pick #40338 #41741 #41313
```
b4adbe5c

[cherry-pick] XPUPS Adaptation (#41917) · a9d8b947

由 Fan Zhang 提交于 4月 19, 2022

* XPUPS Adaptation (#40991)

* Adapt XPUPS - 1st version - 3.24

* Adapt XPUPS - update XPU PushSparse -  2nd version - 3.24

* Adapt XPUPS - add XPU PullSparseOp - 3nd version - 3.25

* refactor heter comm kernel

* update. test=develop

* Adapt XPUPS - modify by compilation - 4th version - 3.27

* update calc_shard_offset. test=develop

* update xpu kernel. test=develop

* update args of calc_shard_offset

* update. test=develop

* remove customGradMerger

* update. test=develop

* heter_comm update

* heter_comm update

* update calc_shard_offset. test=develop

* heter_comm update

* update args of calc_shard_offset

* update. test=develop

* remove customGradMerger

* update. test=develop

* fix. test=develop

* update. test=develop

* update. test=develop

* update optimizer kernel

* Adapt XPUPS - use WITH_XPU_KP and modify wrapper kernel function - 5th version - 3.30

* update. test=develop

* update pslib.cmake

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* Adapt XPUPS - modify by kp compilation  - 6th version - 3.30

* update. test=develop

* update. test=develop

* update. test=develop

* update optimizer kernel

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* fix. test=develop

* fix. test=develop

* used by minxu

* update heter_comm_inl

* fix. test=develop

* Adapt XPUPS - modify by kp compilation  - 7th version - 3.30

* fix. test=develop

* add optimizer kernel. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 3.31 update

* Adapt XPUPS - update kp compilation path  - 8th version - 3.31

* add optimizer kernel. test=develop

* fix kunlun not support size_t. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix kunlun not support size_t. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update heter_comm_kernel.kps 3.31

* fix. test=develop

* fix. test=develop

* update heter_comm_kernel.kps 3.31

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update heter_comm.h 3.31

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update hashtable. test=develop

* update. test=develop

* Adapt XPUPS - update by kp compilation  - 9th version - 4.1

* update hashtable. test=develop

* fix. test=develop

* update hashtable 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 10th version - 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update. test=develop

* modify by compilation 4.1

* update. test=develop

* update. test=develop

* fix. test=develop

* modify by compilation 4.1

* update. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* modify by compilation 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* modify by compilation 4.1 19:30

* fix. test=develop

* update ps_gpu_wrapper.kps 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 11th version - 4.1

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 12nd version - 4.2

* fix. test=develop

* fix. test=develop

* modify by compilation 4.2

* 4.2 update

* fix. test=develop

* template init. test=develop

* update 4.6

* fix. test=develop

* template init. test=develop

* 4.6 modify by compilation

* hashtable template init. test=develop

* hashtable template init. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=devlop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=devlop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 13nd version - 4.7

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 4.11 update

* fix. test=develop

* fix. test=develop

* 4.11 update

* update by pre-commit

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 4.12 update

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 14th version - 4.13

* 4.13 update

* 4.14 update

* 4.14 update

* 4.14 update

* 4.14 modify by merged latest compilation

* retry CI 4.14

* 4.15 pass static check

* 4.15 modify by gpups CI

* 3.16 update by gpups CI - modify ps_gpu_wrapper.h

* 4.16 update

* 4.16 pass xpu compile

* 4.16 retry CI

* 4.16 update
Co-authored-by: Nzmxdream <zhangminxu01@baidu.com>

* modify ps_gpu_wrapper.cc

* update
Co-authored-by: Nzmxdream <zhangminxu01@baidu.com>

a9d8b947

F

add trt supoort for slice op (#41467) (#41911) · 7ec1e9af
由 feng_shuai 提交于 4月 19, 2022

7ec1e9af
F

add div plugin and add filter (#41243) (#41908) · 15d30815
由 feng_shuai 提交于 4月 19, 2022

15d30815
Revert "modify xpu.cmake,*test=kunlun (#41832)" · f293bcb8
由 z8hanghuan 提交于 4月 19, 2022
```
This reverts commit 8ccdb91b.
```
f293bcb8

[DoubleGrad] Enabled test_autograd_functional_dynamic.py under eager mode (#41668) (#41895) · 68643a9e

由 Zhanlue Yang 提交于 4月 19, 2022

* [DoubleGrad] Enabled double grad test cases in eager_mode for test_imperative_double_grad

* Fixed elementwise issue

* Addressed CI failures

* [DoubleGrad] Enabled test_imperative_triple_grad test cases under eager_mode

* [DoubleGrad] Enabled test_autograd_functional_dynamic.py under eager mode

* Enabled more test cases

* Fixed performance issues

* Fixed minor issue

68643a9e

J

fix_poo2d_trt_convert (#41860) (#41915) · e568268b
由 JingZhuangzhuang 提交于 4月 19, 2022

e568268b
J

fix infer gpu strategy (#41925) · aa6eb0e8
由 JingZhuangzhuang 提交于 4月 19, 2022

aa6eb0e8
Z
Add kernel sparse_mask_helper; sparse_coo_tensor_grad (#41586) (#41902) · 44d8c6ed
由 zhangkaihuo 提交于 4月 19, 2022
```
cherry-pick the PR#41586 to realese/2.3
```
44d8c6ed

cinn_launch_op: optimize the overhead of preparing variables before executing... · dab7dfbf

由 TeFeng Chen 提交于 4月 19, 2022

cinn_launch_op: optimize the overhead of preparing variables before executing cinn compiled program (#41777) (#41910)

cherry-pick #41777
* optimize preparation overhead before executing cinn compiled program

dab7dfbf

[DoubleGrad] Enabled test_imperative_triple_grad test cases under eager_mode (#41612) (#41894) · 0fb06e46

由 Zhanlue Yang 提交于 4月 19, 2022

* [DoubleGrad] Enabled double grad test cases in eager_mode for test_imperative_double_grad

* Fixed elementwise issue

* Addressed CI failures

* [DoubleGrad] Enabled test_imperative_triple_grad test cases under eager_mode

* Fixed minor issues

0fb06e46

Optimization for graph_sample_neighbors API (#41447) (#41897) · 6115b016

由 Siming Dai 提交于 4月 19, 2022

* add eids result for graph_sample_neighbors

* fix bug

* move fisher_yates sample to warp

* add cpu eid output

* delete comment

* delete comment

* change nullptr placeholder

* optimize sample kernel

* fix mutable_data

6115b016

18 4月, 2022 7 次提交

L

use group id to differentiate keys for tcp store (#41496) (#41510) · 6449a232
由 lilong12 提交于 4月 18, 2022

6449a232
L

update (#41756) · 97d1ab2a
由 lilong12 提交于 4月 18, 2022

97d1ab2a
A
[Eager] Add _fallback_legacy_dygraph for npu/xpu/rocm (#41774) (#41898) · 96c95b3d
由 Aurelius84 提交于 4月 18, 2022
```
* [Eager] add _fallback_legacy_dygraph for npu/xpu/rocm

* fix import
```
96c95b3d

fix bugs in moe (#41903) · f92dbfb7

由 Roc 提交于 4月 18, 2022

* fix moe apis (#41650)

* Moe ref (#41836)

* moe ref

* ref commit

* update; document_fix

* update;document_fix

* Moe ref (#41864)

* moe ref

* ref commit; document_fix

* update; document_fix

* update document_fix

* update; document_fix

f92dbfb7

[cherry-pick]XPUPS add support for kunlun2 (#41916) · 3a2fb4cf

由 zmxdream 提交于 4月 18, 2022

* [XPUPS]add support for kunlun2 (#40985)


[XPUPS]add support for kunlun2
Co-authored-by: NWorgenZhang <frank08081993@gmail.com>

* [XPUPS]fix hashtable_kernel.kps (#41790)

* refactor heter comm kernel

* update. test=develop

* update calc_shard_offset. test=develop

* update xpu kernel. test=develop

* update args of calc_shard_offset

* update. test=develop

* remove customGradMerger

* update. test=develop

* update. test=develop

* fix. test=develop

* update. test=develop

* update. test=develop

* update optimizer kernel

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* fix. test=develop

* fix. test=develop

* add optimizer kernel. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix kunlun not support size_t. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update hashtable. test=develop

* update. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update. test=develop

* update. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* template init. test=develop

* hashtable template init. test=develop

* fix. test=develop

* fix. test=devlop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix hashtable_kernel. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop
Co-authored-by: NWorgenZhang <frank08081993@gmail.com>

* [XPUPS]modify xpu_kp.cmake with HETERPS&PSLIB (#41760)

* modify xpu_kp.cmake with HETERPS&PSLIB

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop
Co-authored-by: NWorgenZhang <frank08081993@gmail.com>

3a2fb4cf

modify xpu.cmake,*test=kunlun (#41832) · 8ccdb91b

由 z8hanghuan 提交于 4月 16, 2022

* modify xpu.cmake,*test=kunlun

* modify xpu.cmake,*test=kunlun

* modify xpu.cmake,*test=kunlun

* modify xpu.cmake,*test=kunlun

8ccdb91b

[Phi]Reduce kernels into multiply files (#41747) (#41854) · 688f4ec0

由 chentianyu03 提交于 4月 18, 2022

* split reduce_kernel

* rm reduce_kernel in cmake

* split reduce_grad kernels

* fix cmake build error

* format code

* fix standalone_executor_test error

688f4ec0

机器未来 / Paddle 与 Fork 源项目一致

机器未来 / Paddle
与 Fork 源项目一致