提交 · 46988e21656affdac852ea9522ada02bdff54fbf · Crayon鑫 / Paddle

29 11月, 2021 1 次提交

Fix bugs when bias add none in static graph for fused_attention op. (#37566) (#37608) · 46988e21

由 Li Min 提交于 11月 29, 2021

cherry-pick of PR #37566:

Based on #37411, this PR:

    Continue to fix the bugs when bias add is none in static graph for fused_attention op.
    Polish and improve the unittests in test_fused_attention_op_api.py.

46988e21

28 11月, 2021 1 次提交
- Z
  
  fix heter_server (#37604) (#37627) · 4066713f
  由 zmx 提交于 11月 28, 2021
  
  4066713f
26 11月, 2021 4 次提交

fix bug of slice_grad using use_mkldnn attr (#37584) · 14fd53d5

由 zyfncg 提交于 11月 26, 2021

slice_grad op在选择kernel过程中出现错误，问题原因是在获取use_mkldnn属性时，map中未找到该键值，所以抛出out_of_range异常
本PR在map获取use_mkldnn属性数据前增加了是否存在该键值的判断逻辑，从而避免出现上述异常

14fd53d5

add new API/OP: paddle.linalg.triangular_solve (#36714) (#37551) · 3a81805b
由 zhouweiwei2014 提交于 11月 26, 2021
```
cherry-pick #36714
```
3a81805b

[cherry-pick 2.2 heterps]bug fix for launch_utils.py (#37521) (#37570) · 4b41b8e9

由 zmx 提交于 11月 26, 2021

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* [heterps]bug fix for _run_from_dataset

* fix heter_server.cc

* fix launch_utils.py

* fix heter_section_worker.cc

* fix. test=develop

* fix. test=develop

4b41b8e9

L

Fix the issue of disordered loading cifar data (#37272) (#37528) · ca8b8586
由 LielinJiang 提交于 11月 26, 2021

ca8b8586

25 11月, 2021 4 次提交
- S
  [cherry-pick 2.2]fix data parallel when VOCAB var in program (#37546) · c8429d36
  由 Steffy-zxf 提交于 11月 25, 2021
```
* fix data parallel when VOCAB var in program

* fix ci coverage
```
  c8429d36
- K
  
  avoid setting logging.basicConfig (#37031) (#37530) · 824c4ef9
  由 kuizhiqing 提交于 11月 25, 2021
  
  824c4ef9
- Z
  [cherry-pick-2.2.1]Opt topk (#37325) · 89fb1964
  由 zhangkaihuo 提交于 11月 25, 2021
```
目前的fused_attention_op不支持attn_mask=None的输入，本PR对此进行了补充，并补充了相应的单测逻辑。
```
  89fb1964
- P
  Cherry-pick PR 37420, fix inplace bug when the first grad_var(loss_grad) is... · d31d597f
  由 pangyoki 提交于 11月 25, 2021
```
Cherry-pick PR 37420, fix inplace bug when the first grad_var(loss_grad) is inplace var (#37420) (#37488)

fix inplace bug，Cherry pick PR #37420
```
  d31d597f
24 11月, 2021 1 次提交
- L
  [Cherry pick 2.2] fix bugs to support bias add none for fused_attention op. (#37411) (#37483) · bed652d6
  由 Li Min 提交于 11月 24, 2021
```
Add support for bias is none for fused_attention op.
```
  bed652d6
23 11月, 2021 9 次提交

L

bug fix shard_index (#37042) (#37421) · f873d3a1
由 lilong12 提交于 11月 23, 2021

f873d3a1

[cherry-pick]Refactor Heterogenous Pipeline Parameter Server (#37446) · 4dc426f4

由 zmx 提交于 11月 23, 2021

* bug fix for  DeserializeSelectedRows. test=develop (#36520)

* fix SerializeSelectedRows (#36543)

* bug fix for  DeserializeSelectedRows. test=develop

* fix bug for SerializeSelectedRows. test=develop

* update. test=develop

* [Heterps]Refactor Heter Pipeline Parameter Server (#36845)

* change username

* fix

* fix

* fix

* fix

* fix

* update

* update

* update unittests

* fix

* update

* fix

* update

* fix

* fix

* fix

* update

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update send_and_recv op. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* update. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix ut. test=develop

* fix unit. notest,test=coverage

* fix ut. notest, test=coverage

* update. notest,test=coverage

* fix ut. notest, test=coverage

* fix ut. notest, test=coverage

* fix. notest, test=coverage

* fix. notest, test=coverage

* fix ut. notest, test=coverage

* fix ut. notest, test=coverage

* fix ut. notest, test=coverage

* fix ut. notest, test=coverage

* add func. notest, test=coverage

* fix ut. notest, test=coverage

* fix. test=develop

* fix. test=develop

* Fix unit test for send_and_recv_cpu & send_and_recv_gpu (#37129)

* [heterps]fix ut for heter_pipeline_trainer.cc  (#37136)

* fix ut. test=develop

* fix ut. test=develop

* [heterps]bug fix for local training with --heter_worker_num (#37166)

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* [heterps]Refactor heterogenous worker (#37244)

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* refactor heter trainer. test=develop

* fix. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix ut. test=develop

* [heterps]add heterps mode judgement (#37298)

* [heterps]change default executor for heter trainer (#37314)

* fix pslib. test=develop

* add device to train_from_dataset. test=develop

* refine fleet.stop_worker. test=develop

* fix ut. test=develop

* fix ut. test=develop

* fix executor & ut. test=develop

* fix executor & ut. test=develop

* fix executor & ut. test=develop

* [heterps]remove api for heter pipeline ps (#37396)

* fix api. test=develop

* fix api. test=develop

* fix code style. test=release/2.2

* fix CMakeLists. test=develop (#37454)

4dc426f4

Z

elu support alpha < 0 (#37316) (#37437) · 436808c6
由 zhupengyang 提交于 11月 23, 2021

436808c6

cherry pick save/load in the_one_ps (#37461) · 58a51130

由 wangguanqun 提交于 11月 23, 2021

* save/load in ps runtime(the_one_ps) (#36097)

* add trainer desc config to distributed strategy

* code style modified

* data_feed set lod

* fix bug

* code style

* fix bug

* save load

* save load

* save unittest

* add unittest of the_one_ps

* unittest

* add todo in communicator sendsparse

* fix bug in save_inference_model (#37362)

58a51130

S
[Cherry-pick 2.2]Enhance error message of scatter op (#37431) · d5e73f07
由 sneaxiy 提交于 11月 23, 2021
```
* enhance scatter err msg check

* fix ci error
```
d5e73f07

[Dy2stat]Allow users to switch eval/train mode when using @to_static to... · eed736dc

由 0x45f 提交于 11月 23, 2021

[Dy2stat]Allow users to switch eval/train mode when using @to_static to decorate a function (#37383) (#37432)

本PR之前使用@to_static装饰一个单独的function时，对于生成的Program无法切换train/eval模式，只能运行在train模式下。这也就导致动转静后用户多次调用function显存会一直增长。
本PR之后，使用@to_static装饰一个单独的function时，可以通过function.train()或者function.eval()的方式来切换train/eval模式。

eed736dc

W

fix shape api (#37412) · 2778fcd9
由 Wilber 提交于 11月 23, 2021

2778fcd9
J

fix memeory_optimize_pass bug (#37324) (#37413) · 0fa96e91
由 JingZhuangzhuang 提交于 11月 23, 2021

0fa96e91
J

cherry_pick conv2d omission (#37419) · 6b3ffe99
由 JingZhuangzhuang 提交于 11月 23, 2021

6b3ffe99

22 11月, 2021 3 次提交
- C
  Fix a bug of quantization (#36982) (#37381) · 9ffb43be
  由 ceci3 提交于 11月 22, 2021
```
* fix a quantization bug
Co-authored-by: NXGZhang <46363693+XGZhang11@users.noreply.github.com>
```
  9ffb43be
- S
  [cherry-pick] Add paddle.incubate.graph_send_recv API(#37205) (#37343) · 109f8a8e
  由 Siming Dai 提交于 11月 22, 2021
```
* Add paddle.incubate.graph_send_recv API

* fix bug in CudaAtomicMin and CudaAtomicMax

* add empty line
```
  109f8a8e
- L
  fix bug to support dropout eval grad computing. (#37305) (#37331) · 604b6fc0
  由 Li Min 提交于 11月 22, 2021
```
fix bug to support dropout eval grad computing. cherry-pick #37305.
```
  604b6fc0
19 11月, 2021 3 次提交

0
[Dy2stat]Support `for i in [1,2,3]` statements in dy2stat (#37259) (#37356) · 44db219a
由 0x45f 提交于 11月 19, 2021
```
该PR使得动转静模块能够正确转换如下的for i in [1, 2, 3]语句。
```
44db219a
0
set net.forward to original forward function in flops (#36852) (#37357) · b5594759
由 0x45f 提交于 11月 19, 2021
```
set net.forward to original forward function in flops when net is a dy2stat model.
```
b5594759

[cherry-pick]Add sparse attention doc warning (#37189) · 5fd8312d

由 Liu-xiandong 提交于 11月 19, 2021

* fix cusparse compile bug in CUDA11.2, test=develop

* modify sparse_attention docs, test=document_fix (#36554)

* modify sparse_attention docs, test=develop

* add warning

* add warning ,test=document_fix

5fd8312d

17 11月, 2021 4 次提交
- W
  [Paddle-Inference] fix_qkv_plugin: fix half scale (#37096) (#37264) · 027664e8
  由 Wangzheee 提交于 11月 17, 2021
```
* fix_qkv_plugin: half_scale

* [Paddle-Inference] fix_qkv_plugin: fix half scale
```
  027664e8
- W
  
  cherrypick fix op_teller (#37266) · 3fdbab25
  由 Wangzheee 提交于 11月 17, 2021
  
  3fdbab25
- W
  
  add_fc_convert_layers_name (#37157) (#37267) · 71b04f61
  由 Wangzheee 提交于 11月 17, 2021
  
  71b04f61
- J
  
  add fetch to black list (#37123) (#37261) · 8cb370f7
  由 JingZhuangzhuang 提交于 11月 17, 2021
  
  8cb370f7
16 11月, 2021 3 次提交

[cherry-pick-2.2.1]fix fused_transformer_encoder_layer bug (#37229) · 36dd295e

由 zhangkaihuo 提交于 11月 16, 2021

修复了fused_transformer_encoder_layer fine-tune过程发现的一些问题：

    fused_attention_op添加attn_mask=None的支持：PR
    pre_layer_norm处理问题：PR
    参数处理，计算错误的问题：PR
    add_bias计算错误问题：PR
    添加pure fp16的支持：PR

36dd295e

Z
fix bug of indexing with ellipsis (#37192) · 79b9f47e
由 zyfncg 提交于 11月 16, 2021
```
修复了一维Tensor在使用省略号(...)索引时维度检测异常的问题。
```
79b9f47e
石
clean inference logs when config.DisableGlogInfo is triggered (#36356) (#37212) · dc873eba
由石晓伟提交于 11月 16, 2021
```
Co-authored-by: NPei Yang <peiyang@baidu.com>
```
dc873eba

15 11月, 2021 1 次提交
- Z
  MLPerf Optimization for Release/2.2 (#37109) · 287ca7d5
  由 Zeng Jinle 提交于 11月 15, 2021
```
* add mlperf optimization PRs

* update
```
  287ca7d5
10 11月, 2021 1 次提交
- J
  Fix rnn grad bug in cpu when dropout is zero (#37080) (#37086) · 70cb0a54
  由 Jack Zhou 提交于 11月 10, 2021
```
* fix rnn grad bug when num_layers is set 2 and dropout_prob is set 0

* add more test for rnn
```
  70cb0a54
08 11月, 2021 2 次提交
- W
  Optimized the solve op code:renamed var and removed template func (#36981) (#37011) · a787b278
  由 Weilong Wu 提交于 11月 08, 2021
```
    Renamed the variable and function
    Removed the original template function
    Removed the tests_properties in CMakeLists.txt
```
  a787b278
- Z
  setitem support passing stop_gradient from value to tensor (#37028) · 76cab751
  由 zyfncg 提交于 11月 08, 2021
```
att,Fix issue:36902
```
  76cab751
01 11月, 2021 2 次提交
- L
  [cherry-pick]fix cusparse compile bug in CUDA11.2, test=release/2.2 (#36913) · ab2004bb
  由 Liu-xiandong 提交于 11月 01, 2021
```
* fix cusparse compile bug in CUDA11.2, test=develop

* fix bug
```
  ab2004bb
- F
  
  negative label in softmax cross entropy (#36907) · dcadc256
  由 Feng Xing 提交于 11月 01, 2021
  
  dcadc256
30 10月, 2021 1 次提交
- Y
  Move the ASP training API to paddle.static.sparsity. (#36525) (#36860) · 09bc9c06
  由 Yiqun Liu 提交于 10月 30, 2021
```
Cherry-pick #36525
```
  09bc9c06

Crayon鑫 / Paddle 与 Fork 源项目一致

Crayon鑫 / Paddle
与 Fork 源项目一致