提交 · 91cf770bd2feb2406e192a6d319a0dcd2de73537 · PaddlePaddle / Paddle

12 5月, 2022 10 次提交

由 Fan Zhang 提交于 5月 12, 2022

* Adapt XPUPS - 1st version - 3.24

* Adapt XPUPS - update XPU PushSparse -  2nd version - 3.24

* Adapt XPUPS - add XPU PullSparseOp - 3nd version - 3.25

* refactor heter comm kernel

* update. test=develop

* Adapt XPUPS - modify by compilation - 4th version - 3.27

* update calc_shard_offset. test=develop

* update xpu kernel. test=develop

* update args of calc_shard_offset

* update. test=develop

* remove customGradMerger

* update. test=develop

* heter_comm update

* heter_comm update

* update calc_shard_offset. test=develop

* heter_comm update

* update args of calc_shard_offset

* update. test=develop

* remove customGradMerger

* update. test=develop

* fix. test=develop

* update. test=develop

* update. test=develop

* update optimizer kernel

* Adapt XPUPS - use WITH_XPU_KP and modify wrapper kernel function - 5th version - 3.30

* update. test=develop

* update pslib.cmake

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* Adapt XPUPS - modify by kp compilation  - 6th version - 3.30

* update. test=develop

* update. test=develop

* update. test=develop

* update optimizer kernel

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* fix. test=develop

* fix. test=develop

* used by minxu

* update heter_comm_inl

* fix. test=develop

* Adapt XPUPS - modify by kp compilation  - 7th version - 3.30

* fix. test=develop

* add optimizer kernel. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 3.31 update

* Adapt XPUPS - update kp compilation path  - 8th version - 3.31

* add optimizer kernel. test=develop

* fix kunlun not support size_t. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix kunlun not support size_t. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update heter_comm_kernel.kps 3.31

* fix. test=develop

* fix. test=develop

* update heter_comm_kernel.kps 3.31

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update heter_comm.h 3.31

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update hashtable. test=develop

* update. test=develop

* Adapt XPUPS - update by kp compilation  - 9th version - 4.1

* update hashtable. test=develop

* fix. test=develop

* update hashtable 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 10th version - 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update. test=develop

* modify by compilation 4.1

* update. test=develop

* update. test=develop

* fix. test=develop

* modify by compilation 4.1

* update. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* modify by compilation 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* modify by compilation 4.1 19:30

* fix. test=develop

* update ps_gpu_wrapper.kps 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 11th version - 4.1

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 12nd version - 4.2

* fix. test=develop

* fix. test=develop

* modify by compilation 4.2

* 4.2 update

* fix. test=develop

* template init. test=develop

* update 4.6

* fix. test=develop

* template init. test=develop

* 4.6 modify by compilation

* hashtable template init. test=develop

* hashtable template init. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=devlop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=devlop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 13nd version - 4.7

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 4.11 update

* fix. test=develop

* fix. test=develop

* 4.11 update

* update by pre-commit

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 4.12 update

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 14th version - 4.13

* 4.13 update

* 4.14 update

* 4.14 update

* 4.14 update

* 4.14 modify by merged latest compilation

* retry CI 4.14

* 4.15 pass static check

* 4.15 modify by gpups CI

* 3.16 update by gpups CI - modify ps_gpu_wrapper.h

* 4.16 update

* 4.16 pass xpu compile

* 4.16 retry CI

* 4.16 update

* Adapt XPUPS - adapt BKCL comm for XPUPS - 4.24

* update by compilation

* Adapt XPUPS - register PSGPUTrainer for XPUPS - 4.25

* update device_worker_factory

* Adapt XPUPS - split heter_ps into .cu and .cc - 4.27

* Adapt XPUPS - register pull_box_sparse op under XPU_KP - 4.28

* update

* 5.7 modify ps_gpu_wrapper pull_sparse

* 5.11 update ps_gpu_wrapper CopyKeysKernel
Co-authored-by: Nzmxdream <zhangminxu01@baidu.com>

272b7f1c

F

[MLU] fix cnnl error when index is 2D (#42669) · 190cf44f
由 fwenguang 提交于 5月 12, 2022

190cf44f

Add cinn pass to program (#42623) · 9ac736c2

由 sneaxiy 提交于 5月 12, 2022

* add cinn pass to program

* remove build_cinn_pass ut

* polish ut, add ut

* guard ut with is_compiled_with_cinn

* enable ut test_build_cinn_pass_resnet

9ac736c2

add xpu buffer_reader, *test=kunlun (#42578) · cc343a41

由 z8hanghuan 提交于 5月 12, 2022

* add xpu buffer_reader, *test=kunlun

* xpu buffer_reader, use XPUDeviceGuard, *test=kunlun

* modify xpu.cmake, *test=kunlun

* modify xpu.cmake, *test=kunlun

* modify xpu.cmake, *test=kunlun

* add xpu buffer_reader, *test=kunlun

* add xpu buffer reader, *test=kunlun

* add xpu buffer reader, *test=kunlun

cc343a41

Speed up sr accumulation (#42658) · 43d70bcc

由 Jiabin Yang 提交于 5月 12, 2022

* Support Gradient Accumulation for sr

* add ut

* change ut to fit small vector

* speed up accumulation

43d70bcc

J
[Eager] Remove full reserved strategy (#42690) · 35c7c835
由 Jiabin Yang 提交于 5月 12, 2022
```
* remove full reserved strategy

* fix inplace error
```
35c7c835
Z

add exp,log trt converter (#42655) · 6e90ba1b
由 zhupengyang 提交于 5月 12, 2022

6e90ba1b
W
[Paddle-Inference] support transformer generation: some passes (#42664) · 5914b18a
由 Wangzheee 提交于 5月 12, 2022
```
* [Paddle-Inference] support transformer generation: some passes
```
5914b18a
T

【Hackathon No.60】refactor unary sparse ops and add sparse sqrt, tanh, sin (#41356) · f1eda7d0
由 tiancaishaonvjituizi 提交于 5月 12, 2022

f1eda7d0
F

[MLU] add slice kernel (#42245) · ddb3868e
由 fwenguang 提交于 5月 12, 2022

ddb3868e

11 5月, 2022 10 次提交
- Z
  [Phi] Change the output format of C++ backward api (Part1) (#42677) · ba71fbea
  由 zyfncg 提交于 5月 11, 2022
```
* change the output format of C++ backward api

* fix merge conflict

* fix sparse api code auto-gen

* fix eager_gen bug

* fix bug of output is null

* fix bug of conv2d_grad_impl

* fix optional grad

* fix bug of eager-gen double_grad

* fix bug

* fix multiply_double_grad bug

* remove node pruning
```
  ba71fbea
- Z
  Move weights and biases scale computing into pass (#42241) · c0652972
  由 Zuza Gawrysiak 提交于 5月 11, 2022
```
* Add int8 scales gathering pass for convolution

* Fix typo

* Add unittest

* Add corrected unit test

* Change test name

* Remove enabling mkldnn in test

* Speed up test

* Change max examples

* Add functional test

* Change test name

* Add new test case

* Rename pass
```
  c0652972
- A
  
  [Eager]Fix EagerTensor _copy_to memory overlap problem (#42668) · 5131b11f
  由 Aurelius84 提交于 5月 11, 2022
  
  5131b11f
- J
  
  support custom operator run in double grad mode (#42653) · 00ecb98f
  由 Jiabin Yang 提交于 5月 11, 2022
  
  00ecb98f
- A
  [IPU] update to popart v2.5.0 (#42552) · 27acc6c3
  由 Allen Guo 提交于 5月 11, 2022
```
* update to popart v2.5.0

* use a specific version of sdk2.5.0
```
  27acc6c3
- F
  
  stride_slice don't support trt6 (#42639) · c4bed7e4
  由 feng_shuai 提交于 5月 11, 2022
  
  c4bed7e4
- H
  [Dygraph] Support diff batch for sparse of EagerReducer (#42646) · c5232b4b
  由 Haohongxiang 提交于 5月 11, 2022
```
* support diff batch for sparse of eagerreducer

* fix
```
  c5232b4b
- T
  
  remove old XDNN implementation test=kunlun (#42404) · 7b828f71
  由 taixiurong 提交于 5月 11, 2022
  
  7b828f71
- W
  swish refactor (#42610) · a1abb7c9
  由 wenbin 提交于 5月 11, 2022
```
* swish refactor

* bug fix

* trt7 non-linear bug fix
```
  a1abb7c9
- A
  
  update CompilationProgressLogger (#42665) · 29a6b8c9
  由 Allen Guo 提交于 5月 11, 2022
  
  29a6b8c9
10 5月, 2022 19 次提交

X
[EinsumOp] Polish forward logic and backward logic for optimize (#42603) · cf198dc9
由 xiongkun 提交于 5月 10, 2022
```
* change logic for optimize

* modifty
```
cf198dc9
R

[CustomDevice] add inference support (#42036) · 02e5c4be
由 ronnywang 提交于 5月 10, 2022

02e5c4be

Rea-dd conv_affine_channel fuse pass as oneDNN only pass (#41998) · 3540d33b

由 piotrekobi 提交于 5月 10, 2022

* Readd conv_affine_channel fuse pass as mkldnn pass

* Fix formatting

* Add new test to parallel_UT_rule.py

* Fix Coverage and Windows CI issues

* Revert "Fix Coverage and Windows CI issues"

This reverts commit f33459846385c9fd51c07f9f44e7ff283a652637.

* Fix CI errors

* Remove unnecessary conv_eltwise_add_affine_channel fuse pass

* Remove test from parallel_UT_rule.py

3540d33b

T

add fp16 for reshape op on kunlun2, *test=kunlun (#42605) · 754edf6e
由 TTerror 提交于 5月 10, 2022

754edf6e

fix switch client multithread bug (#42600) · e2540c17

由 ziyoujiyi 提交于 5月 10, 2022

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* arm_brpc compile

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* only output is ok

* base is ok

* .

* .

* .

* .

* .

* .

* .

* .

* add switch server bin

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* adapt brpc ssl

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* fix heter_server & heter_client

* .

* .

* int->int64_t

* .

* safe map in multithread

* fix heter unitest

* .

* fix code_style

* .

* fix bug

* .

e2540c17

shape mkldnn kernel adapted to NHWC (#42548) · d47690b2

由 Jacek Czaja 提交于 5月 10, 2022

* - shape mkldnn adapted to NHWC

- NHWC shape mkldnn ut

- fixes to UT

- Fix to UT

- Fixes to UT

- Fix of compilation

* - lint candidate fix

d47690b2

[Video detection] Added fill_constant FP32 FWD oneDNN kernel (#37216) · 66a10f36

由 jakpiase 提交于 5月 10, 2022

* added fill_constant kernel

* CI fix

* ci fix

* switched from nan to zero memory

* CI FIX

* ci fixes

* CI rerun

* ci fix

* minor change

* CI rerun

66a10f36

【PaddlePaddle Hackathon 2】18、为 Paddle 新增 paddle.heaviside 和 paddle.Tensor.heaviside API (#41872) · 4892d592

由 BrilliantYuKaimin 提交于 5月 10, 2022

* Create elementwise_heaviside_op.cc

* add ElementwiseHeavisideFunctor

* Create test_elementwise_heaviside_op.py

* 增加heaviside的python接口

* add heaviside in white list

* 增加heaviside的签名

* 增加heaviside的核函数

* 增加heaviside梯度的核函数

* 增加heaviside梯度的注册

* 调整代码格式

* Update elementwise_sig.cc

* add heaviside in __all__

* Update heaviside docs

* Update math.py

* Update math.py

* Update math.py

4892d592

W
[Eager] print gpu mem info (#42616) · 81644145
由 wanghuancoder 提交于 5月 10, 2022
```
* print mem

* refine

* refine

* refine

* refine
```
81644145
L

add int8 for cast (#42634) · 8a100774
由 lilong12 提交于 5月 10, 2022

8a100774
Q

[MLU]add adam, adamw op of mlu device (#42557) · cc077693
由 qipengh 提交于 5月 10, 2022

cc077693
F

[MLU] add layernorm mlu kernel (#42356) · ecd6db43
由 fwenguang 提交于 5月 10, 2022

ecd6db43
Q

[MLU]add assign op of mlu device (#42591) · 4e5fb733
由 qipengh 提交于 5月 10, 2022

4e5fb733
J
pdnode_compare (#42597) · 30234dd7
由 JingZhuangzhuang 提交于 5月 10, 2022
```
* pdnode_compare

* panode compare

* pdnode_compare
```
30234dd7
Z

merge develop. test=develop (#42624) · 0ce42fb0
由 zmxdream 提交于 5月 10, 2022

0ce42fb0
L

fix bug for heter (#42590) · 21b35167
由 lilong12 提交于 5月 10, 2022

21b35167
S

fix sample error (#42595) · df96d1ed
由 Siming Dai 提交于 5月 10, 2022

df96d1ed
A
fix random cache (#723) (#42621) · be87caf2
由 Allen Guo 提交于 5月 10, 2022
```
Co-authored-by: Nyaozhixin <522190855@qq.com>
```
be87caf2
S

broadcast_add kp performance optimization (#42097) · c7855125
由 shixingbo 提交于 5月 10, 2022

c7855125

09 5月, 2022 1 次提交
- A
  [Eager]Fix tensor.name is empty behavior (#42587) · 81078a88
  由 Aurelius84 提交于 5月 09, 2022
```
* [Eager]Fix tensor.name is empty behavior

* fix unittest
```
  81078a88

PaddlePaddle / Paddle 大约 1 年 前同步成功

PaddlePaddle / Paddle
大约 1 年前同步成功