提交 · 92568edbf7a6023f897b8d7e5f9f1ea985f28fa2 · PaddlePaddle / Paddle

04 6月, 2022 1 次提交
- S
  
  【code format check upgrade】 step2：cmake-format (#43057) · 92568edb
  由 Sing_chan 提交于 6月 04, 2022
  
  92568edb
02 6月, 2022 17 次提交

Enable fc on bfloat16 (#43154) · cb1a0ec1

由 Tomasz Socha 提交于 6月 02, 2022

* Enable fc on bfloat16

* Add pass for residual connection

* Dissable Residual connection pass for now

* Ban ResidualData from DQ

* style

* WO for python tests

cb1a0ec1

Add generate_proposals_v2 op and expend function of gather op for kunlun. *test=kunlun (#43162) · ff22a9c4

由 Leo Guo 提交于 6月 02, 2022

* Add generate_proposals_v2 op and unittest for kunlun. *test=kunlun

* Add the assign op to xpu2_op_list and expand the function of gather op. Add the unit-test of generate_proposals_v2. *test=kunlun

ff22a9c4

[Eager] FLAGS_retain_grad_for_all_tensor set false in default (#43142) · 4d3b7d7d

由 Weilong Wu 提交于 6月 02, 2022

* [Eager] FLAGS_retain_grad set false

* Add FLAGS_retain_grad_ for some tests

* Add FLAGS_retain_grad_ to some tests

* modified set_flags

* modified set_flags

* fix windows-ci and windows-openblas-ci

* import paddle.fluid

4d3b7d7d

W
[Eager] clear_gradient use set_constant but not zeros_like (#43171) · 1e0ea6a4
由 wanghuancoder 提交于 6月 02, 2022
```
* clear_gradient use set_constant but not zeros_like
```
1e0ea6a4
S
Fix bug of CUDAGraph kernel parameter comparation (#43163) · 3fcfcd51
由 sneaxiy 提交于 6月 02, 2022
```
* fix cuda graph sizeof

* fix tuple type
```
3fcfcd51

[XPUPS] modify BKCL comm op register (#43028) · 1bfbcfaf

由 Fan Zhang 提交于 6月 02, 2022

* Adapt XPUPS - 1st version - 3.24

* Adapt XPUPS - update XPU PushSparse -  2nd version - 3.24

* Adapt XPUPS - add XPU PullSparseOp - 3nd version - 3.25

* refactor heter comm kernel

* update. test=develop

* Adapt XPUPS - modify by compilation - 4th version - 3.27

* update calc_shard_offset. test=develop

* update xpu kernel. test=develop

* update args of calc_shard_offset

* update. test=develop

* remove customGradMerger

* update. test=develop

* heter_comm update

* heter_comm update

* update calc_shard_offset. test=develop

* heter_comm update

* update args of calc_shard_offset

* update. test=develop

* remove customGradMerger

* update. test=develop

* fix. test=develop

* update. test=develop

* update. test=develop

* update optimizer kernel

* Adapt XPUPS - use WITH_XPU_KP and modify wrapper kernel function - 5th version - 3.30

* update. test=develop

* update pslib.cmake

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* Adapt XPUPS - modify by kp compilation  - 6th version - 3.30

* update. test=develop

* update. test=develop

* update. test=develop

* update optimizer kernel

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* fix. test=develop

* fix. test=develop

* used by minxu

* update heter_comm_inl

* fix. test=develop

* Adapt XPUPS - modify by kp compilation  - 7th version - 3.30

* fix. test=develop

* add optimizer kernel. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 3.31 update

* Adapt XPUPS - update kp compilation path  - 8th version - 3.31

* add optimizer kernel. test=develop

* fix kunlun not support size_t. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix kunlun not support size_t. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update heter_comm_kernel.kps 3.31

* fix. test=develop

* fix. test=develop

* update heter_comm_kernel.kps 3.31

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update heter_comm.h 3.31

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update hashtable. test=develop

* update. test=develop

* Adapt XPUPS - update by kp compilation  - 9th version - 4.1

* update hashtable. test=develop

* fix. test=develop

* update hashtable 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 10th version - 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update. test=develop

* modify by compilation 4.1

* update. test=develop

* update. test=develop

* fix. test=develop

* modify by compilation 4.1

* update. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* modify by compilation 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* modify by compilation 4.1 19:30

* fix. test=develop

* update ps_gpu_wrapper.kps 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 11th version - 4.1

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 12nd version - 4.2

* fix. test=develop

* fix. test=develop

* modify by compilation 4.2

* 4.2 update

* fix. test=develop

* template init. test=develop

* update 4.6

* fix. test=develop

* template init. test=develop

* 4.6 modify by compilation

* hashtable template init. test=develop

* hashtable template init. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=devlop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=devlop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 13nd version - 4.7

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 4.11 update

* fix. test=develop

* fix. test=develop

* 4.11 update

* update by pre-commit

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 4.12 update

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 14th version - 4.13

* 4.13 update

* 4.14 update

* 4.14 update

* 4.14 update

* 4.14 modify by merged latest compilation

* retry CI 4.14

* 4.15 pass static check

* 4.15 modify by gpups CI

* 3.16 update by gpups CI - modify ps_gpu_wrapper.h

* 4.16 update

* 4.16 pass xpu compile

* 4.16 retry CI

* 4.16 update

* Adapt XPUPS - adapt BKCL comm for XPUPS - 4.24

* update by compilation

* Adapt XPUPS - register PSGPUTrainer for XPUPS - 4.25

* update device_worker_factory

* Adapt XPUPS - split heter_ps into .cu and .cc - 4.27

* Adapt XPUPS - register pull_box_sparse op under XPU_KP - 4.28

* update

* 5.7 modify ps_gpu_wrapper pull_sparse

* 5.11 update ps_gpu_wrapper CopyKeysKernel

* 5.13 modify calc_shard_offset_kernel & fill_shard_key_kernel

* modify fill_dvals_kernel & PullCopy & c_sync_calc_stream - 5.18

* modify PushCopy & fill_shard_grads_kernel & register push_box_sparse - 5.19

* Adapt XPUPS - modify BKCL comm op register - 5.26

* Adapt XPUPS - modify BKCL comm op register - 5.27

* Adapt XPUPS - modify BKCL comm op register - 5.27v2

* Adapt XPUPS - modify BKCL comm op register - 5.27v3

* Adapt XPUPS - modify c_comm_init_all_op to adapt BKCL init - 5.30

* Adapt XPUPS - modify c_comm_init_all_op to adapt BKCL init v2 - 5.30

* Adapt XPUPS - modify c_comm_init_all_op to adapt BKCL init v3 - 5.30

* Adapt XPUPS - modify c_comm_init_all_op to adapt BKCL init v4 - 5.31
Co-authored-by: Nzmxdream <zhangminxu01@baidu.com>

1bfbcfaf

T
Fix for Bfloat16 placement pass. (#43109) · 030b23da
由 Tomasz Socha 提交于 6月 02, 2022
```
* Fix bfloat16 placement pass

* Make it nicer

* Fix leftovers

* Style
```
030b23da
Z
Support head_dim = 96 in fused_multi_transformer for PLATO-XL (#43120) · 990c5e7f
由 Zhang Zheng 提交于 6月 02, 2022
```
* Support head_dim = 96 in fused_multi_transformer in PLATO-XL

* add notes
```
990c5e7f
[MLU]add mlu kernel for squeeze and squeeze2 (#43094) · 041000c2
由光明和真理提交于 6月 02, 2022
```
Co-authored-by: Nliupeiyu <liupeiyu@cambricon.com>
```
041000c2
C

add concat_grad mlu kernel. (#43117) · fe911a51
由 Chenxiao Niu 提交于 6月 02, 2022

fe911a51

add federated learning parameter server(fl-ps) mode (#42682) · d999049f

由 ziyoujiyi 提交于 6月 02, 2022

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* fl-ps v1.0

* .

* support N + N mode

* .

* .

* .

* .

* delete print

* .

* .

* .

* .

d999049f

W
[Paddle-Inference] new general transformer inference support (#43077) · 2810dfea
由 Wangzheee 提交于 6月 02, 2022
```
* new general transformer inference support
```
2810dfea
Z
Delete inplace strategy in group_norm_fwd (#43137) · 0cb9dae5
由 Zhang Zheng 提交于 6月 02, 2022
```
* Delete inplace strategy in group_norm_fwd

* fix
```
0cb9dae5
W
[Eager] first run accumulation node (#43134) · 0f1be6e0
由 wanghuancoder 提交于 6月 02, 2022
```
* first run accumulation node
```
0f1be6e0
G

fix the bug of margin cross entropy loss for eager mode (#43161) · 67163fb4
由 Guoxia Wang 提交于 6月 02, 2022

67163fb4
L
Extend forward fast layer_norm kernel to support more dimensions. (#43118) · 85baa3c0
由 Li Min 提交于 6月 02, 2022
```
* extend forward fast_ln_kernel to support more column values.
```
85baa3c0

Support CUDA Graph for partial graph in dygraph mode (#42786) · d05b940a

由 sneaxiy 提交于 6月 02, 2022

* support CUDAGraph for partial graph

* add ut

* fix ci

* fix ut again because of eager mode

* fix kunlun ci

* fix win ci

d05b940a

01 6月, 2022 7 次提交
- Y
  Add yaml and unittest for instance_norm op (#43060) · 56ae33b6
  由 YuanRisheng 提交于 6月 01, 2022
```
* add yaml

* fix infrt compile bugs
```
  56ae33b6
- Q
  
  [NPU] fix npu runtime error of HCCLParallelContext, test=develop (#43116) · 2dac35f3
  由 Qi Li 提交于 6月 01, 2022
  
  2dac35f3
- G
  
  support nccl api for bfloat16, required >= cudnn 10.1, nccl >= 2.10.3 (#43147) · 67b9b51b
  由 Guoxia Wang 提交于 6月 01, 2022
  
  67b9b51b
- S
  Make fuse_gemm_epilogue support transpose_x and transpose_y (#40558) · 048b0013
  由 sneaxiy 提交于 6月 01, 2022
```
* support weight transpose

* add ut

* add template

* fix transpose error

* fix transpose_comment

* add api tests

* add skipif

* add doc
```
  048b0013
- R
  Add pinned memory to host memory stats (#43096) · c4b7c485
  由 Ruibiao Chen 提交于 6月 01, 2022
```
* Add pinned memory to HostMemoryStats

* Add macro for WrapStatAllocator

* Fix CI errors
```
  c4b7c485
- H
  
  [revert] revert inference accelarate #43125 · 81622708
  由 huzhiqiang 提交于 6月 01, 2022
  
  81622708
- C
  [Yaml]add conv3d, depthwise_conv2d yaml (#42807) · 5f2c251c
  由 chentianyu03 提交于 6月 01, 2022
```
* add conv3d yaml

* add conv3d_grad, conv3d_double_grad

* add final_state_conv3d test case

* add conv3d double test case

* add depthwise_conv2d grad yaml

* add depthwise_conv2d double grad test case

* modify the order of args

* add depthwise_conv2d_grad_grad config
```
  5f2c251c
31 5月, 2022 11 次提交

Remove mkldnn attributes from base ops (#42852) · 4b89120b

由 Sławomir Siwek 提交于 5月 31, 2022

* remove attrs from base op

* fix typos

* remove brelu

* undo removing code related to matmul

* remove whitespaces

* undo changes in matmul

* remove empty line

4b89120b

[Eager] Fix Full Zero (#43048) · 462ae005

由 wanghuancoder 提交于 5月 31, 2022

* fix full zero

* fix full zero

* fix full zero

* fix full zero

* refine

* refine

* refine

462ae005

C

[MLU] add mlu kernel for abs op (#43099) · cb195fa0
由 cambriconhsq 提交于 5月 31, 2022

cb195fa0
C
[Eager] Polish append op using for model perf (#43102) · e9589e35
由 Chen Weihang 提交于 5月 31, 2022
```
* polish append op using

* fix var error

* fix group norm impl
```
e9589e35
A
[NPU] fix arg_max and reduce_max (#42887) · f9e55dee
由 Aganlengzi 提交于 5月 31, 2022
```
* fix arg_max and reduce_max

* add arg_max ut
```
f9e55dee

【PaddlePaddle Hackathon 2】16 新增 API RRelu (#41823) · 21e1d10f

由 thunder95 提交于 5月 31, 2022

* rrelu逻辑部分

* unregistered op kernel (unresolved)

* commit before merge

* 丰富测试用例

* 修复rrelu-sig的bug

* 修复cpu环境测试

* 修改拼写错误

* 修改code format

* 尝试优化测试用例timeout的问题

* 优化测试用例

* 移除seed, 优化随机函数

* update en doc for rrelu

* fix rrelu en docs, test=document_fix

* add paper link for en docs, test=document_fix

* udpate en doc

* add r,test=document_fix

21e1d10f

L
Fix the underflow of fp16 fake quantize operators (#43088) · 0ae8a2d6
由 Leo Chen 提交于 5月 31, 2022
```
Co-authored-by: NRyan Jeng <rjeng@nvidia.com>
```
0ae8a2d6

Support backward prune for eager intermidiate (#43111) · 4700a08e

由 Jiabin Yang 提交于 5月 31, 2022

* support is empty

* fix error

* fix code error

* change to fake empty

* using fake empty first

* using fake empty first

* Support backward prune in fluid

4700a08e

L
Rename dropout is test (#43098) · 67497119
由 Li Min 提交于 5月 31, 2022
```
* replace dropout_is_test with is_test.
* improve atol on a100.
```
67497119
W

fix slice plugin (#43110) · b779d2b8
由 Wilber 提交于 5月 31, 2022

b779d2b8

OneDNN md-in-tensor refactoring part 5: Memory descriptor enabled for... · 12d8a567

由 jakpiase 提交于 5月 30, 2022

OneDNN md-in-tensor refactoring part 5: Memory descriptor enabled for elementwises, reductions and expand_v2 ops (#43036)

* enabled md in elementwises, reductions and expand_v2

* CI fix for invalid numpy copy

* fixed formatting

* CI rerun

* changes after review

12d8a567

30 5月, 2022 4 次提交
- C
  
  [mlu] add one_hot_v2 mlu kernel (#43025) · 13a21cf7
  由 Chenxiao Niu 提交于 5月 30, 2022
  
  13a21cf7
- L
  Add fused_bias_dropout_residual_ln op and layer. (#43062) · dceccd9d
  由 Li Min 提交于 5月 30, 2022
```
* add fused_bias_dropout_residual_ln op and layer.
```
  dceccd9d
- H
  
  fix scale_matmul fuse pass (#43089) · e1e0deed
  由 heliqi 提交于 5月 30, 2022
  
  e1e0deed
- S
  [TensorRT] Fix delete fill_constant pass (#43053) · 1448520d
  由 shentanyue 提交于 5月 30, 2022
```
* update lite compile cmake

* Update delete_fill_constant_op_pass.cc

* Update analysis_config.cc
```
  1448520d

PaddlePaddle / Paddle 大约 1 年 前同步成功

PaddlePaddle / Paddle
大约 1 年前同步成功