* add bernoulli op

* fix cuda kernel and add unit test

* refine doc

* fix uniform

* Add mechanism for blocking oneDNN cache clearing

* Review changes and Add thread guards

* add error message

* support Baidu AI Accelerator
  * test=kunlun

* minor
 * test=kunlun

* support xpu op in separate file
 * test=kunlun

* update XPU error message and remove duplicated code

 * test=kunlun

* minor
 * test=kunlun

* minor
 * test=kunlun

* mod cvm test=develop

* mod code format test=develop

test=develop

* rename input

* add unittest, test=develop

* use paddle.data instead of fluid.data, test=develop

* add pad func

* add pad

* test=develop, add pad op and apis

* restore pad2d

* test=develop, fix paddl declare

* fix pad interface

* test=develop, fix pad

* test=develop, add all pad api and cos_sim

* test=develop, remove padding default value

* test=develop, rename var to tensor

* test=develop, add more tests

* test=develop, rename tovar to totensor

* test=develop, fix init

* test=develop, add more test

* test=develop, add more tests

* support ps-gpu

* add zero norm, inf norm support for p_norm op

* fix the invalid argument check, fix the dtype problem in test case.

* Conv2d_transpose and mul support channnelwise quantization, test=develop
* Skip collecting out threshold for output tensor of which the type is not fp32 or fp64, test=develop
* Fix error in test_user_defined_quantization, test=develop
* Add depthwise_conv_bn_fuse, test=develop
* Add conv_transpose_bn_fuse_pass for post_training_quant, test=develop

align expand_as op to expand.

* enable mkldnn layout conversion

* review fix: remove tmp_place

* fix test mkldnn swish

* add UT for PrepareData CPU->MKLDNN

* add #ifdef PADDLE_WITH_MKLDNN

* Force-push commit
Co-authored-by: Ngrygielski <adam.grygielski@gmail.com>

* add nll loss API, update demo code of the comment

* adaptive expand op to 2.0 (align to torch.expand) , test=develop

* add tile_op, test=develop

test=document_fix

remove activation wording

test=develop,test=document_fix

remove activation wording

test=develop,test=document_fix

remove activation wording

test=develop,test=document_fix

remove activation wording
tanh -> tan

test=develop,test=document_fix

explain input/out put range and out of boundary behavior

Update the code for the min,max, test=develop

* add unchaged infershape function

* add broadcast infershape function

* fix bug

* rename infershape functions

* add UnaryOpUnchangedInferShapeCheckAxis

* add error message

* add test for common infer shape functions

* dont update existed ops

* dont update op_desc.h

* add more test

* add error check, refine error message

* add auto_cast, test=develop

* add loss scaler, test=develop

* add comments, test=develop

* refine code, test=develop

* refine code, test=develop

* do not set flags automatically, test=develop

* fix custom op bug, test=develop

* add more test, test=develop

* refine enable logic, test=develop

* enable amp test with GPU, test=develop

* add unittest

* add test for found_inf

* follow comments

* follow comments

* remove global variable, use singleton

* add some notes

* update comments

* update comments

* update comments

* add use_dynamic_loss_scaling argument

* refine found_inf

* refine found_inf

* Add the max, min, maximum, minimum api for the API 2.0, test=develop

* add the support for multi-node training

update cumsum api and fix up the cumsum op

* Add oneDNN relu6 op

* Lint fixes

test=develop