提交 · 661d0800175c0ff911ef8b37629f6a0986b0a6dd · Crayon鑫 / Paddle

16 5月, 2022 6 次提交

optimize cinn find graph by graph address (#42697) · 661d0800

由 jiangcheng 提交于 5月 16, 2022

* optimize cinn find graph by graph address

* graph_key use int64_t instead of program string

* fix framework _to_readable_code python code

* rename get_readable_comile_key to get_serialize_comile_key

661d0800

S
[Bug]Fix recompute random in modelparallel (#42747) · f55c0b33
由 ShenLiang 提交于 5月 16, 2022
```
* fix recompute in mp

* fix recompute
```
f55c0b33

[PHI] Support construct IntArray by using Non-CPU Tensosr (#41764) · 8eecd852

由 zyfncg 提交于 5月 16, 2022

* support construct scalar using non-cpu tensor

* fix bugs when run unittest

* fix compile bugs

* fix bugs when run ci

* fix compile bugs

* fix bugs when move copy

* perfect unit test

* perfect unittest

* update according to comment

* int_array supports constructed by gpu tensor

* add some test

* polish code

* adjust full api

* add unittest

* add unittest
Co-authored-by: NYuanRisheng <yuanrisheng@baidu.com>

8eecd852

C

add custom linear backward test (#42740) · aeb33958
由 Chen Weihang 提交于 5月 16, 2022

aeb33958
S

kp ld multiple definition bugfix (#42707) · 5198a497
由 shixingbo 提交于 5月 16, 2022

5198a497

fix node transfer problem (#42674) · b61a6e71

由 seemingwang 提交于 5月 16, 2022

* enable graph-engine to return all id

* change vector's dimension

* change vector's dimension

* enlarge returned ids dimensions

* add actual_val

* change vlog

* fix bug

* bug fix

* bug fix

* fix display test

* singleton of gpu_graph_wrapper

* change sample result's structure to fit training

* recover sample code

* fix

* secondary sample

* add graph partition

* fix pybind

* optimize buffer allocation

* fix node transfer problem

* remove log

* support 32G+ graph on single gpu

* remove logs

* fix

* fix

* fix cpu query

* display info

* remove log

* remove empyt file
Co-authored-by: NDesmonDay <908660116@qq.com>

b61a6e71

13 5月, 2022 18 次提交
- C
  
  fix saved expected kernel type error (#42743) · 2eacef49
  由 Chen Weihang 提交于 5月 13, 2022
  
  2eacef49
- L
  Fix hang problem when some workers exited unexcepted (#42708) · b5e60db4
  由 lilong12 提交于 5月 13, 2022
```
* update
```
  b5e60db4
- W
  
  add gpu resources. (#42723) · 1280f294
  由 Wilber 提交于 5月 13, 2022
  
  1280f294
- R
  Refactor test_tensordot (#42650) · 757b5d31
  由 Ruibiao Chen 提交于 5月 13, 2022
```
* Refactor test_tensordot

* Add test_static

* Fix CI errors
```
  757b5d31
- W
  
  fix sample code error of paddle.lerp, test=document_fix (#42748) · cc0fa79b
  由 wuhuanzhou 提交于 5月 13, 2022
  
  cc0fa79b
- W
  Fix max_pool3d doc, test=document_fix (#42715) · c3d50af8
  由 Wei Shengyu 提交于 5月 13, 2022
```
* fix pooling doc

* fix typo test=document_fix

* fix doc typo, test=document_fix
```
  c3d50af8
- W
  fix adaptive_avg_pool1d doc bug (#42721) · b372ab3e
  由 Walter 提交于 5月 13, 2022
```
* fix adaptive_avg_pool1d doc bug

* fix adaptive_avg_pool1d doc bug
```
  b372ab3e
- L
  Fix decode_jpeg example code (#42733) · a52f8e4a
  由 LielinJiang 提交于 5月 13, 2022
```
* fix decode_jpeg example code

* fix decode_jpeg example code
```
  a52f8e4a
- C
  Fix example code bugs (#42739) · 73342c67
  由 Chen Long 提交于 5月 13, 2022
```
* update readme test=document_fix

* fix api docs bugs test=document_fix
```
  73342c67
- Q
  [IPU] fix ipu and add python infer api, test=develop (#42724) · 9029fde7
  由 Qi Li 提交于 5月 13, 2022
```
* [IPU] fix ipu and add python infer api, test=develop

* [IPU] add paddlepaddle-ipu package name, test=develop
```
  9029fde7
- W
  [Eager] Support test_dist_hapi_model under eager mode (#42702) · 9840fb70
  由 Weilong Wu 提交于 5月 13, 2022
```
* [Eager] Support test_dist_hapi_model under eager mode

* [Eager] Polish code

* Fix code-format issue, coverage-ci issue
```
  9840fb70
- T
  
  add communication cost for cost model (#42727) · cbc5ca0f
  由 Tao CHANG 提交于 5月 13, 2022
  
  cbc5ca0f
- K
  [Launch] add gpu report during training (#42675) · 3052f36c
  由 kuizhiqing 提交于 5月 13, 2022
```
* add nvsmi

* collect gpu info to log

* fix unitest

* rm ret_type
```
  3052f36c
- L
  
  refine directory of build-time (#42717) · 0c6baf3c
  由 Leo Chen 提交于 5月 13, 2022
  
  0c6baf3c
- W
  
  fix spectral_norm en doc (#42728) · 99c9265f
  由 wangna11BD 提交于 5月 13, 2022
  
  99c9265f
- W
  
  [Eager] Roll back legacy for fused_attention and fused_feedforward op test (#42719) · 3e7e0af6
  由 Weilong Wu 提交于 5月 13, 2022
  
  3e7e0af6
- A
  update new feature of mlperf (#735) (#42706) · 82ce2d56
  由 Allen Guo 提交于 5月 13, 2022
```
* update new feature of mlperf
Co-authored-by: Nyaozhixin <522190855@qq.com>
```
  82ce2d56
- L
  
  Update api docs (#42725) · cde2b24d
  由 Linjie Chen 提交于 5月 13, 2022
  
  cde2b24d
12 5月, 2022 16 次提交

S

Fix some typos in paddle/. (#42408) · 2012672c
由 Shuangchi He 提交于 5月 12, 2022

2012672c
P

Change oneDNN SHA (#42657) · 91cf770b
由 piotrekobi 提交于 5月 12, 2022

91cf770b

Xpups dev (#42692) · 272b7f1c

由 Fan Zhang 提交于 5月 12, 2022

* Adapt XPUPS - 1st version - 3.24

* Adapt XPUPS - update XPU PushSparse -  2nd version - 3.24

* Adapt XPUPS - add XPU PullSparseOp - 3nd version - 3.25

* refactor heter comm kernel

* update. test=develop

* Adapt XPUPS - modify by compilation - 4th version - 3.27

* update calc_shard_offset. test=develop

* update xpu kernel. test=develop

* update args of calc_shard_offset

* update. test=develop

* remove customGradMerger

* update. test=develop

* heter_comm update

* heter_comm update

* update calc_shard_offset. test=develop

* heter_comm update

* update args of calc_shard_offset

* update. test=develop

* remove customGradMerger

* update. test=develop

* fix. test=develop

* update. test=develop

* update. test=develop

* update optimizer kernel

* Adapt XPUPS - use WITH_XPU_KP and modify wrapper kernel function - 5th version - 3.30

* update. test=develop

* update pslib.cmake

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* Adapt XPUPS - modify by kp compilation  - 6th version - 3.30

* update. test=develop

* update. test=develop

* update. test=develop

* update optimizer kernel

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* fix. test=develop

* fix. test=develop

* used by minxu

* update heter_comm_inl

* fix. test=develop

* Adapt XPUPS - modify by kp compilation  - 7th version - 3.30

* fix. test=develop

* add optimizer kernel. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 3.31 update

* Adapt XPUPS - update kp compilation path  - 8th version - 3.31

* add optimizer kernel. test=develop

* fix kunlun not support size_t. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix kunlun not support size_t. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update heter_comm_kernel.kps 3.31

* fix. test=develop

* fix. test=develop

* update heter_comm_kernel.kps 3.31

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update heter_comm.h 3.31

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update hashtable. test=develop

* update. test=develop

* Adapt XPUPS - update by kp compilation  - 9th version - 4.1

* update hashtable. test=develop

* fix. test=develop

* update hashtable 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 10th version - 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update. test=develop

* modify by compilation 4.1

* update. test=develop

* update. test=develop

* fix. test=develop

* modify by compilation 4.1

* update. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* modify by compilation 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* modify by compilation 4.1 19:30

* fix. test=develop

* update ps_gpu_wrapper.kps 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 11th version - 4.1

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 12nd version - 4.2

* fix. test=develop

* fix. test=develop

* modify by compilation 4.2

* 4.2 update

* fix. test=develop

* template init. test=develop

* update 4.6

* fix. test=develop

* template init. test=develop

* 4.6 modify by compilation

* hashtable template init. test=develop

* hashtable template init. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=devlop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=devlop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 13nd version - 4.7

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 4.11 update

* fix. test=develop

* fix. test=develop

* 4.11 update

* update by pre-commit

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 4.12 update

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 14th version - 4.13

* 4.13 update

* 4.14 update

* 4.14 update

* 4.14 update

* 4.14 modify by merged latest compilation

* retry CI 4.14

* 4.15 pass static check

* 4.15 modify by gpups CI

* 3.16 update by gpups CI - modify ps_gpu_wrapper.h

* 4.16 update

* 4.16 pass xpu compile

* 4.16 retry CI

* 4.16 update

* Adapt XPUPS - adapt BKCL comm for XPUPS - 4.24

* update by compilation

* Adapt XPUPS - register PSGPUTrainer for XPUPS - 4.25

* update device_worker_factory

* Adapt XPUPS - split heter_ps into .cu and .cc - 4.27

* Adapt XPUPS - register pull_box_sparse op under XPU_KP - 4.28

* update

* 5.7 modify ps_gpu_wrapper pull_sparse

* 5.11 update ps_gpu_wrapper CopyKeysKernel
Co-authored-by: Nzmxdream <zhangminxu01@baidu.com>

272b7f1c

F

[MLU] fix cnnl error when index is 2D (#42669) · 190cf44f
由 fwenguang 提交于 5月 12, 2022

190cf44f

Add cinn pass to program (#42623) · 9ac736c2

由 sneaxiy 提交于 5月 12, 2022

* add cinn pass to program

* remove build_cinn_pass ut

* polish ut, add ut

* guard ut with is_compiled_with_cinn

* enable ut test_build_cinn_pass_resnet

9ac736c2

add xpu buffer_reader, *test=kunlun (#42578) · cc343a41

由 z8hanghuan 提交于 5月 12, 2022

* add xpu buffer_reader, *test=kunlun

* xpu buffer_reader, use XPUDeviceGuard, *test=kunlun

* modify xpu.cmake, *test=kunlun

* modify xpu.cmake, *test=kunlun

* modify xpu.cmake, *test=kunlun

* add xpu buffer_reader, *test=kunlun

* add xpu buffer reader, *test=kunlun

* add xpu buffer reader, *test=kunlun

cc343a41

J

add batch tensor support for some vision transforms functions (#42701) · e906eb5b
由 JYChen 提交于 5月 12, 2022

e906eb5b

Speed up sr accumulation (#42658) · 43d70bcc

由 Jiabin Yang 提交于 5月 12, 2022

* Support Gradient Accumulation for sr

* add ut

* change ut to fit small vector

* speed up accumulation

43d70bcc

J
[Eager] Remove full reserved strategy (#42690) · 35c7c835
由 Jiabin Yang 提交于 5月 12, 2022
```
* remove full reserved strategy

* fix inplace error
```
35c7c835
Z

add exp,log trt converter (#42655) · 6e90ba1b
由 zhupengyang 提交于 5月 12, 2022

6e90ba1b
W
[Paddle-Inference] support transformer generation: some passes (#42664) · 5914b18a
由 Wangzheee 提交于 5月 12, 2022
```
* [Paddle-Inference] support transformer generation: some passes
```
5914b18a
P
add approval for _enable_legacy_dygraph in unittest (#42687) · a7926ef2
由 pangyoki 提交于 5月 12, 2022
```
* add approval for eager CI

* add wiki manual
```
a7926ef2

Use tempfile to place the temporary files (#42626) · eca8a579

由 zlsh80826 提交于 5月 12, 2022

* Use tempfile to place the temporary files

* Revise test_bert to use tempfile for temporary files

* Use tempfile for test_transformer

* Fix test_dataset file race

eca8a579

A

fix base docker image name, test=document_fix (#42673) · 1ce9c2ba
由 Allen Guo 提交于 5月 12, 2022

1ce9c2ba
T

【Hackathon No.60】refactor unary sparse ops and add sparse sqrt, tanh, sin (#41356) · f1eda7d0
由 tiancaishaonvjituizi 提交于 5月 12, 2022

f1eda7d0
F

[MLU] add slice kernel (#42245) · ddb3868e
由 fwenguang 提交于 5月 12, 2022

ddb3868e

Crayon鑫 / Paddle 与 Fork 源项目一致

Crayon鑫 / Paddle
与 Fork 源项目一致