提交 · 4c9f96c902b06cb9d17ce3e56e0ace5b47a050c0 · 橘蓝 / Paddle

18 2月, 2021 6 次提交

[CustomOp] Support Compile multi ops at same time (#30920) · 4c9f96c9

由 Aurelius84 提交于 2月 18, 2021


* add more unitest for ABI compatibility

* add more unittest

* refine warning style

* support compile multi custom ops in same time

* fix not import paddle in unittest

* fix typo

* add more unittest

* add comment for details

4c9f96c9

Add Conv Transpose BF16 (#30877) · caf9d398

由 joanna.wozna.intel 提交于 2月 18, 2021

* Add conv transpose BF16

* Share function GetWeightsTz

* Adjust to review and fix op compatibility

* Add bias to unique handler name

* Remove errors related to paddle enforce

* Add conv2d_transpose to bf16 list and kernel refator

caf9d398

H
Refine fake_interface Error Message (#30981) · cbbe1274
由 Huihuang Zheng 提交于 2月 18, 2021
```
Refine fake_interface Error Message
```
cbbe1274

Add Support for Tuple in for Loop (#30998) · c1375783

由 Huihuang Zheng 提交于 2月 18, 2021

Dy2stat didn't support tuple as iteration variable in the past. This PR added there main cases:

1). Non-enumerate case: for var1, var2 in var|var.numpy() will be re-written as:
for FOR_ITER_TUPLE_PREFIX_x in var | var.numpy():
var1 = FOR_ITER_TUPLE_PREFIX_x[0]
var2 = FOR_ITER_TUPLE_PREFIX_x[1]
2). Enumerate out tuple case: for t in enumerate(var|var.numpy) will be rewritten as:
for FOR_ITER_TUPLE_INDEX_PREFIX_x, FOR_ITER_TUPLE_PREFIX_x in enumerate(var|var.numpy):
t = (FOR_ITER_TUPLE_INDEX_PREFIX_x, FOR_ITER_TUPLE_PREFIX_x)
3). Enumerate inner tuple case: for i, (var1, (var2, va3)) in enumerate(var|var.numpy()) will
be re-written as:
for i, FOR_ITER_TUPLE_PREFIX_x in var | var.numpy():
var1 = FOR_ITER_TUPLE_PREFIX_x[0]
var2 = FOR_ITER_TUPLE_PREFIX_x[1][0]
var3 = FOR_ITER_TUPLE_PREFIX_x[1][1]

c1375783

W

Handle missing symlink method on Windows (#31006) · 2497f439
由 Wojciech Uss 提交于 2月 17, 2021

2497f439

[CustomOp] Check Compiler ABI compatibility (#30869) · 5653c3a4

由 Aurelius84 提交于 2月 18, 2021

* support setup.py to compile custom op

* move file into paddle.utils.cpp_extension

* support python setup.py install

* refine code style

* Enrich code and add unittest

5653c3a4

11 2月, 2021 1 次提交
- H
  
  fix lrn bug in reshape size, test=develop (#30968) · 20e300e2
  由 huangjun12 提交于 2月 11, 2021
  
  20e300e2
10 2月, 2021 2 次提交

W

delay timeout of unnittest 'test_static_save_load'. (#30975) · 8ab29f4b
由 WeiXin 提交于 2月 10, 2021

8ab29f4b

New custom operator extension mechanism (#30690) · f649442d

由 Chen Weihang 提交于 2月 09, 2021

* initial commit: simple demo

* polish copyright format

* add grap op simple demo

* adapt uncertain number of argument

* change trait marco name

* add place & dtype support for add kernel

* add dispath and infershape func

* poish code & add notes

* add dynamic_loader dep for paddle_framework

* add new custom op test dir

* polish impl details

* add unittest for new custom op

* fix failed unittest

* Costum op (#1)

* fix compile error

* wrap framework tensor with LoDTensor

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* add CustomTensor default constructor

* add size() for CustomTensor

* make size const for CustomTensor

* refactor place related api to circle the concept

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* make place const

* make Tensor copy

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* remove additional head of framework

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* add gpu test

* merge latest cwh code in

* adjust ut code of custom op

* adjust ut code of custom op

* adjust ut code of custom op

* Remove ShareData from user && Change CustomTensor to Tensor && Support more data type (#2)

* fix compile error

* wrap framework tensor with LoDTensor

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* add CustomTensor default constructor

* add size() for CustomTensor

* make size const for CustomTensor

* refactor place related api to circle the concept

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* make place const

* make Tensor copy

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* remove additional head of framework

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* add gpu test

* merge latest cwh code in

* adjust ut code of custom op

* adjust ut code of custom op

* adjust ut code of custom op

* adjust ut code of custom op

* adjust ut code of custom op

* hid share data from and to

* rename CustomTensor to Tensor

* refactor register design & add test

* change op_funtion to op_meta_info

* split op meta info into .h and .cc

* move get methods into friend class

* move OpMetaInfoHelper into framework space

* move CustomTensorUtils into framework space

* change pybind api name

* move PD C API into op meta info

* add register custom op api

* remove inference cmake change

* refactor copy to api && change Reshape to lowercase && support more dtype && add more test (#3)

* fix compile error

* wrap framework tensor with LoDTensor

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* add CustomTensor default constructor

* add size() for CustomTensor

* make size const for CustomTensor

* refactor place related api to circle the concept

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* make place const

* make Tensor copy

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* remove additional head of framework

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* add gpu test

* merge latest cwh code in

* adjust ut code of custom op

* adjust ut code of custom op

* adjust ut code of custom op

* adjust ut code of custom op

* adjust ut code of custom op

* hid share data from and to

* rename CustomTensor to Tensor

* support multi dtype

* remove lod, make reshape lowercase, add copy test and refactor copy api

* remove lod, make reshape lowercase, add copy test and refactor copy api

* remove lod, make reshape lowercase, add copy test and refactor copy api

* remove lod, make reshape lowercase, add copy test and refactor copy api

* fix copy to error

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* polish detail & error message

* polish test details

* Add cast api && Change copy related api to copy_to && add more test (#4)

* fix compile error

* wrap framework tensor with LoDTensor

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* add CustomTensor default constructor

* add size() for CustomTensor

* make size const for CustomTensor

* refactor place related api to circle the concept

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* fix compile error

* make place const

* make Tensor copy

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* debug CustomTensor core

* remove additional head of framework

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* use back to shared ptr for custom tensor

* add gpu test

* merge latest cwh code in

* adjust ut code of custom op

* adjust ut code of custom op

* adjust ut code of custom op

* adjust ut code of custom op

* adjust ut code of custom op

* hid share data from and to

* rename CustomTensor to Tensor

* support multi dtype

* remove lod, make reshape lowercase, add copy test and refactor copy api

* remove lod, make reshape lowercase, add copy test and refactor copy api

* remove lod, make reshape lowercase, add copy test and refactor copy api

* remove lod, make reshape lowercase, add copy test and refactor copy api

* fix copy to error

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add more test

* add type cast

* add cast and make copy to api

* add cast and make copy to api

* add cast and make copy to api

* add cast and make copy to api

* merge cwh code

* merge cwh code

* merge cwh code

* merge cwh code

* merge cwh code

* add more error log

* add more error log

* polish code

* used for test

* remove test comment

* remove test comment

* fix uint8 type error

* fix lost uint8 type error

* add test for coverage

* polish details by reviewer comments

* add prefix for DISABLE_COPY_AND_ASSIGN
Co-authored-by: NJiabin Yang <360788950@qq.com>

f649442d

09 2月, 2021 9 次提交
- Z
  
  fix bug of Linux UT parallel level (#30971) · 5c033271
  由 Zhou Wei 提交于 2月 09, 2021
  
  5c033271
- C
  support label with float input of cross_entropy, test=develop (#30929) · f5ca2db2
  由 chajchaj 提交于 2月 09, 2021
```
* support label with float input of cross_entropy, test=develop

* fix code style in nn/functional/loss.py, test=develop
```
  f5ca2db2
- P
  modify dockerfile: support cuda11 and delete gcc8.2 in cpu version (#30746) · 52edaecc
  由 pangyoki 提交于 2月 09, 2021
```
* support cuda11 and delete gcc8.2 in cpu version

* change method

* fix pip

* change 11 to 11.0
```
  52edaecc
- W
  update eigen version on Windows (#30573) · 9b3c80c8
  由 wuhuanzhou 提交于 2月 09, 2021
```
* update eigen version on Windows, test=develop

* add /bigobj for cl, test=develop
```
  9b3c80c8
- S
  
  Solve inconsistent order in each card in dynamic graph (#30931) · dae3e1f3
  由 ShenLiang 提交于 2月 09, 2021
  
  dae3e1f3
- W
  
  Fix the problem that the number of ops executed by xpu is wrong (#30961) · 14d039e4
  由 WangXi 提交于 2月 09, 2021
  
  14d039e4
- H
  Update gast requirement, test=develop (#30932) · 8e72e031
  由 Huihuang Zheng 提交于 2月 09, 2021
```
gast version can be conflict with the other software users installed. We set the version to be higher than 0.3.3
```
  8e72e031
- C
  
  try to fix reader and signal test failed (#30960) · 010f2caa
  由 Chen Weihang 提交于 2月 08, 2021
  
  010f2caa
- A
  
  Fix LayerNorm tester for gcc4.8 (#30962) · 3ba69809
  由 Adam Osewski 提交于 2月 09, 2021
  
  3ba69809
08 2月, 2021 5 次提交
- Q
  
  [ROCM] update fluid platform for rocm39 (part3), test=develop (#30913) · 93c1d9e7
  由 Qi Li 提交于 2月 08, 2021
  
  93c1d9e7
- Q
  
  fix depends of kunlun bkcl (#30945) · 15297a06
  由 QingshuChen 提交于 2月 08, 2021
  
  15297a06
- L
  
  [Static setitem] Support index is ellipsis for setitem in static mode (#30836) · 12c15beb
  由 liym27 提交于 2月 08, 2021
  
  12c15beb
- L
  
  Add error message for slice op(#30851) · 97f7a70c
  由 liym27 提交于 2月 08, 2021
  
  97f7a70c
- L
  
  [kunlun]fix sync in multi kunlun xpu dygraph training. (#30943) · 87197f8c
  由 liuyuhui 提交于 2月 08, 2021
  
  87197f8c
07 2月, 2021 6 次提交
- W
  op benchmark ci retry with specfied id (#30743) · 99bf6228
  由 wuhuanzhou 提交于 2月 07, 2021
```
* op benchmark ci retry with specfied id, notest, test=op_benchmark

* fix parse case name with case id, notest, test=op_benchmark

* remove test code, test=develop
```
  99bf6228
- 石
  bug fix of xpu lite engine, test=develop (#30918) · 99bd16eb
  由石晓伟提交于 2月 07, 2021
```
* bug fix of xpu lite engine, test=develop

* xpu zero copy tensor, test=develop

* revert paddle/fluid/inference/tests/api/CMakeLists.txt
```
  99bd16eb
- T
  
  Add WITH_XPU_BKCL in Kunlun-CI (#30919) · 2e932338
  由 tianshuo78520a 提交于 2月 07, 2021
  
  2e932338
- W
  fix a bug of Sequential::__getitem__ (#30899) · 823f499a
  由 wanghuancoder 提交于 2月 07, 2021
```
* fix a bug of Sequential::__getitem__, test=develop

* add testcase, test=develop
```
  823f499a
- Q
  
  [ROCM] update fluid platform for rocm39 (part2), test=develop (#30774) · 34f1628c
  由 Qi Li 提交于 2月 07, 2021
  
  34f1628c
- W
  
  fix cpplint cfg, test=develop (#30924) · 5ded39f2
  由 wanghuancoder 提交于 2月 07, 2021
  
  5ded39f2
06 2月, 2021 1 次提交
- J
  
  [oneDNN] Added basic changes for elementwise_add_grad bf16 (#30925) · 9e527d99
  由 Jacek Czaja 提交于 2月 06, 2021
  
  9e527d99
05 2月, 2021 10 次提交
- C
  add truncated gaussian random (#30922) · c98f144f
  由 Chengmo 提交于 2月 05, 2021
```
add truncated gaussian random
```
  c98f144f
- L
  
  [Kunlun] add gen_bkcl_id_op, support multi XPU cards training using multiprocess (#30858) · 4a8b8b45
  由 liuyuhui 提交于 2月 05, 2021
  
  4a8b8b45
- L
  Performance optimization for dynamic setitem: Call op set_value to speed up... · 39f41cb4
  由 liym27 提交于 2月 05, 2021
```
Performance optimization for dynamic setitem: Call op set_value to speed up because the original call to TensorToPyArray will introduce unnecessary data copy. (#30817)
```
  39f41cb4
- L
  
  [Kunlun]fix include files of gen_comm_id_helper.cc (#30917) · bef46ccf
  由 liuyuhui 提交于 2月 05, 2021
  
  bef46ccf
- W
  
  let LayerList could add [None], test=develop (#30911) · 90d92111
  由 wanghuancoder 提交于 2月 05, 2021
  
  90d92111
- W
  
  add include for heterbox_trainer.cc, develop=test (#30910) · aab3a301
  由 wanghuancoder 提交于 2月 05, 2021
  
  aab3a301
- T
  
  dyngraph (#30892) · 24873f4f
  由 taixiurong 提交于 2月 05, 2021
  
  24873f4f
- Z
  Use correct master weights in AdamW. (#30895) · 71acde9a
  由 Zhen Wang 提交于 2月 05, 2021
```
* Use correct master weights in AdamW.

* Just modify the master weight.

* Update for CI Coverage.
```
  71acde9a
- L
  
  rm test_datasets from file parallel_UT_relu.py (#30907) · 79fa8fb0
  由 LielinJiang 提交于 2月 05, 2021
  
  79fa8fb0
- A
  More UT for LayerNormFuse pass (#30891) · 092a2b14
  由 Adam Osewski 提交于 2月 05, 2021
```
* Additionally change to not throw error from inside pass.
```
  092a2b14

橘蓝 / Paddle 与 Fork 源项目一致

橘蓝 / Paddle
与 Fork 源项目一致