提交 · 68babef1ba032c67d662e614ca96526b97ca8658 · Crayon鑫 / Paddle

19 5月, 2022 2 次提交

distribute label evenly among partitions in graph engine (#42846) · 68babef1

由 seemingwang 提交于 5月 19, 2022

* enable graph-engine to return all id

* change vector's dimension

* change vector's dimension

* enlarge returned ids dimensions

* add actual_val

* change vlog

* fix bug

* bug fix

* bug fix

* fix display test

* singleton of gpu_graph_wrapper

* change sample result's structure to fit training

* recover sample code

* fix

* secondary sample

* add graph partition

* fix pybind

* optimize buffer allocation

* fix node transfer problem

* remove log

* support 32G+ graph on single gpu

* remove logs

* fix

* fix

* fix cpu query

* display info

* remove log

* remove empyt file

* distribute labeled data evenly in graph engine
Co-authored-by: NDesmonDay <908660116@qq.com>

68babef1

[TensorRT] Support yolov5s (#42688) · a7778930

由 shentanyue 提交于 5月 19, 2022

* support yolov5s static/int8

* fix eltwise_sub and div weight compute

* fix delete_fill_constant_pass

a7778930

18 5月, 2022 11 次提交
- C
  
  fix tensorrt dla int8 problem (#42826) · a51817d7
  由 csy0225 提交于 5月 18, 2022
  
  a51817d7
- F
  Add Code Generation for operators, op makers and argument mapping functions (#41772) · e339d3c1
  由 Feiyu Chan 提交于 5月 18, 2022
```
Add Code Generation for operators,  op makers and argument mapping functions (#41772)
```
  e339d3c1
- W
  [Eager] Polish eager code generation (#42822) · b9342a80
  由 Weilong Wu 提交于 5月 18, 2022
```
* [Eager] Polish eager code generation

* Remove useless code in codegen
```
  b9342a80
- S
  matmul and matmul_v2 refactor (#42732) · 570d0322
  由 Sławomir Siwek 提交于 5月 18, 2022
```
* matmul refactor

* remove UT which only check ENFORCE output

* code format

* improve memory usage
```
  570d0322
- A
  [NPU] add take_along_axis and take_along_axis_grad kernels (#42773) · 6f0a28f5
  由 Aganlengzi 提交于 5月 18, 2022
```
* [NPU] add take_along_axis and take_along_axis_grad ops

* [NPU] add take_along_axis and take_along_axis_grad ops

* fix ut because cpu kernel can not be fallbacked
```
  6f0a28f5
- N
  
  Add return in initial function (#42823) · bebaee37
  由 niuliling123 提交于 5月 18, 2022
  
  bebaee37
- Y
  
  [collective] dynamic shape for send_v2 and recv_v2 (#42765) · 1f64c42e
  由 Yuang Liu 提交于 5月 18, 2022
  
  1f64c42e
- T
  Fix graph hang (#42768) · 133d63fa
  由 Thunderbrook 提交于 5月 18, 2022
```
* fix device_free

* fix hang
```
  133d63fa
- S
  【CI】support py3.6 in windows-ci pipeline (#42711) · fa8c755a
  由 Sing_chan 提交于 5月 18, 2022
```
* set scipy and numpy version suit for py3.6

* pynacl1.5.0 which is needed by PyGithub built failed in python36, change it to 1.4.0 also works;test=document_fix;test=windows_ci

* np.corrcoef support parameter since 1.20

* delete test code
```
  fa8c755a
- Z
  Add intermediate config for some api in yaml (#42824) · 384062fa
  由 zyfncg 提交于 5月 18, 2022
```
* add intermediate for some api

* fix bug

* fix fluid.layer
```
  384062fa
- T
  
  fix static-check ci third_party cache (#42815) · 6e45a0fb
  由 tianshuo78520a 提交于 5月 18, 2022
  
  6e45a0fb
17 5月, 2022 8 次提交
- C
  
  polish kernel type str (#42791) · d3686376
  由 Chen Weihang 提交于 5月 17, 2022
  
  d3686376
- A
  [NPU] add multinomial op (#42613) · fd140696
  由 Aganlengzi 提交于 5月 17, 2022
```
* [NPU] add multinomial op

* fix place

* deal with cann version

* fix for old operator

* change another way
```
  fd140696
- Z
  
  add yolo_box_fuse_pass, yolo_box_head_op, yolo_box_post_op (#42641) · 6b58de95
  由 zhupengyang 提交于 5月 17, 2022
  
  6b58de95
- C
  [Eager] Add nan and inf check utils (#42763) · a51c492c
  由 Chen Weihang 提交于 5月 17, 2022
```
* add nan_inf_utils for eager

* support check nan and inf

* add unittest for coverage
```
  a51c492c
- S
  
  refine cpu query (#42803) · 9b15efce
  由 Siming Dai 提交于 5月 17, 2022
  
  9b15efce
- A
  [IPU] rm updateOptimizerFromHost for eval mode (#42800) · b2d8f6df
  由 Allen Guo 提交于 5月 17, 2022
```
* rm updateOptimizerFromHost for eval mode (#742)

* rm updateOptimizerFromHost for eval mode

* fix ci

* clean files
```
  b2d8f6df
- C
  [Eager] Adapt faster tokenizer op (#42718) · b189e83f
  由 Chen Weihang 提交于 5月 17, 2022
```
* adapt faster tokenizer op

* add eager test

* add unittest
```
  b189e83f
- A
  
  [NPU] add reduce_max_grad op (#42672) · 78d5cf7b
  由 Aganlengzi 提交于 5月 17, 2022
  
  78d5cf7b
16 5月, 2022 12 次提交

Enable bfloat16 for VIT-OCR model. (#42758) · c714926d

由 Tomasz Socha 提交于 5月 16, 2022

* Clean-up bfloat16 tester

* New blacklist mechanizm for dequantization

* Style

* Style II

* Style III

c714926d

N

delete rank switch in broadcast_function.h for compile (#42645) · 8501fb00
由 niuliling123 提交于 5月 16, 2022

8501fb00
L
Fix statistics (#42232) · 5c811382
由 liutiexing 提交于 5月 16, 2022
```
* WorkQueue supports always_spinning option

* update

* update

* fix stat
```
5c811382
C

fix trace op record event error (#42775) · 5d136510
由 Chen Weihang 提交于 5月 16, 2022

5d136510

Add the new XDNN implementation. test=kunlun (#42683) · 87667c66

由 wbn 提交于 5月 16, 2022

* Add the new XDNN implementation. test=kunlun

* Add the new XDNN implementation. test=kunlun

* Modify the code based on review, test=kunlun

87667c66

Y

Optimize linspace to avoid GPU -> CPU copy. (#42750) · 34cda80b
由 Yiqun Liu 提交于 5月 16, 2022

34cda80b
Z
[Phi] Refactor format of inplace C++ api (#42735) · 5924458b
由 zyfncg 提交于 5月 16, 2022
```
* update code

* change the return type for inplace dygraph api

* change the tuple construct
```
5924458b
W
[Eager] Fix test_model.py under eager in windows-openblas ci (#42756) · 566ccfef
由 Weilong Wu 提交于 5月 16, 2022
```
* [Eager] Fix test_model.py under eager in windows-openblas ci

* Use || in this case

* recover _in_eager_mode_
```
566ccfef
W

fused_multi_transformer add fused softmax mask (#42636) · f9d5ae4e
由 WangXi 提交于 5月 16, 2022

f9d5ae4e

optimize cinn find graph by graph address (#42697) · 661d0800

由 jiangcheng 提交于 5月 16, 2022

* optimize cinn find graph by graph address

* graph_key use int64_t instead of program string

* fix framework _to_readable_code python code

* rename get_readable_comile_key to get_serialize_comile_key

661d0800

[PHI] Support construct IntArray by using Non-CPU Tensosr (#41764) · 8eecd852

由 zyfncg 提交于 5月 16, 2022

* support construct scalar using non-cpu tensor

* fix bugs when run unittest

* fix compile bugs

* fix bugs when run ci

* fix compile bugs

* fix bugs when move copy

* perfect unit test

* perfect unittest

* update according to comment

* int_array supports constructed by gpu tensor

* add some test

* polish code

* adjust full api

* add unittest

* add unittest
Co-authored-by: NYuanRisheng <yuanrisheng@baidu.com>

8eecd852

fix node transfer problem (#42674) · b61a6e71

由 seemingwang 提交于 5月 16, 2022

* enable graph-engine to return all id

* change vector's dimension

* change vector's dimension

* enlarge returned ids dimensions

* add actual_val

* change vlog

* fix bug

* bug fix

* bug fix

* fix display test

* singleton of gpu_graph_wrapper

* change sample result's structure to fit training

* recover sample code

* fix

* secondary sample

* add graph partition

* fix pybind

* optimize buffer allocation

* fix node transfer problem

* remove log

* support 32G+ graph on single gpu

* remove logs

* fix

* fix

* fix cpu query

* display info

* remove log

* remove empyt file
Co-authored-by: NDesmonDay <908660116@qq.com>

b61a6e71

13 5月, 2022 5 次提交
- C
  
  fix saved expected kernel type error (#42743) · 2eacef49
  由 Chen Weihang 提交于 5月 13, 2022
  
  2eacef49
- L
  Fix hang problem when some workers exited unexcepted (#42708) · b5e60db4
  由 lilong12 提交于 5月 13, 2022
```
* update
```
  b5e60db4
- W
  
  add gpu resources. (#42723) · 1280f294
  由 Wilber 提交于 5月 13, 2022
  
  1280f294
- Q
  [IPU] fix ipu and add python infer api, test=develop (#42724) · 9029fde7
  由 Qi Li 提交于 5月 13, 2022
```
* [IPU] fix ipu and add python infer api, test=develop

* [IPU] add paddlepaddle-ipu package name, test=develop
```
  9029fde7
- A
  update new feature of mlperf (#735) (#42706) · 82ce2d56
  由 Allen Guo 提交于 5月 13, 2022
```
* update new feature of mlperf
Co-authored-by: Nyaozhixin <522190855@qq.com>
```
  82ce2d56
12 5月, 2022 2 次提交

S

Fix some typos in paddle/. (#42408) · 2012672c
由 Shuangchi He 提交于 5月 12, 2022

2012672c

Xpups dev (#42692) · 272b7f1c

由 Fan Zhang 提交于 5月 12, 2022

* Adapt XPUPS - 1st version - 3.24

* Adapt XPUPS - update XPU PushSparse -  2nd version - 3.24

* Adapt XPUPS - add XPU PullSparseOp - 3nd version - 3.25

* refactor heter comm kernel

* update. test=develop

* Adapt XPUPS - modify by compilation - 4th version - 3.27

* update calc_shard_offset. test=develop

* update xpu kernel. test=develop

* update args of calc_shard_offset

* update. test=develop

* remove customGradMerger

* update. test=develop

* heter_comm update

* heter_comm update

* update calc_shard_offset. test=develop

* heter_comm update

* update args of calc_shard_offset

* update. test=develop

* remove customGradMerger

* update. test=develop

* fix. test=develop

* update. test=develop

* update. test=develop

* update optimizer kernel

* Adapt XPUPS - use WITH_XPU_KP and modify wrapper kernel function - 5th version - 3.30

* update. test=develop

* update pslib.cmake

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* Adapt XPUPS - modify by kp compilation  - 6th version - 3.30

* update. test=develop

* update. test=develop

* update. test=develop

* update optimizer kernel

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* fix. test=develop

* fix. test=develop

* used by minxu

* update heter_comm_inl

* fix. test=develop

* Adapt XPUPS - modify by kp compilation  - 7th version - 3.30

* fix. test=develop

* add optimizer kernel. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 3.31 update

* Adapt XPUPS - update kp compilation path  - 8th version - 3.31

* add optimizer kernel. test=develop

* fix kunlun not support size_t. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix kunlun not support size_t. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update heter_comm_kernel.kps 3.31

* fix. test=develop

* fix. test=develop

* update heter_comm_kernel.kps 3.31

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update heter_comm.h 3.31

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update hashtable. test=develop

* update. test=develop

* Adapt XPUPS - update by kp compilation  - 9th version - 4.1

* update hashtable. test=develop

* fix. test=develop

* update hashtable 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 10th version - 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* update. test=develop

* modify by compilation 4.1

* update. test=develop

* update. test=develop

* fix. test=develop

* modify by compilation 4.1

* update. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* modify by compilation 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* modify by compilation 4.1 19:30

* fix. test=develop

* update ps_gpu_wrapper.kps 4.1

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 11th version - 4.1

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 12nd version - 4.2

* fix. test=develop

* fix. test=develop

* modify by compilation 4.2

* 4.2 update

* fix. test=develop

* template init. test=develop

* update 4.6

* fix. test=develop

* template init. test=develop

* 4.6 modify by compilation

* hashtable template init. test=develop

* hashtable template init. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=devlop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=devlop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 13nd version - 4.7

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 4.11 update

* fix. test=develop

* fix. test=develop

* 4.11 update

* update by pre-commit

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* 4.12 update

* fix. test=develop

* Adapt XPUPS - update by kp compilation  - 14th version - 4.13

* 4.13 update

* 4.14 update

* 4.14 update

* 4.14 update

* 4.14 modify by merged latest compilation

* retry CI 4.14

* 4.15 pass static check

* 4.15 modify by gpups CI

* 3.16 update by gpups CI - modify ps_gpu_wrapper.h

* 4.16 update

* 4.16 pass xpu compile

* 4.16 retry CI

* 4.16 update

* Adapt XPUPS - adapt BKCL comm for XPUPS - 4.24

* update by compilation

* Adapt XPUPS - register PSGPUTrainer for XPUPS - 4.25

* update device_worker_factory

* Adapt XPUPS - split heter_ps into .cu and .cc - 4.27

* Adapt XPUPS - register pull_box_sparse op under XPU_KP - 4.28

* update

* 5.7 modify ps_gpu_wrapper pull_sparse

* 5.11 update ps_gpu_wrapper CopyKeysKernel
Co-authored-by: Nzmxdream <zhangminxu01@baidu.com>

272b7f1c

Crayon鑫 / Paddle 与 Fork 源项目一致

Crayon鑫 / Paddle
与 Fork 源项目一致