* Conv2d_transpose and mul support channnelwise quantization, test=develop
* Skip collecting out threshold for output tensor of which the type is not fp32 or fp64, test=develop
* Fix error in test_user_defined_quantization, test=develop
* Add depthwise_conv_bn_fuse, test=develop
* Add conv_transpose_bn_fuse_pass for post_training_quant, test=develop

align expand_as op to expand.

* add set/get default dtype

* enable mkldnn layout conversion

* review fix: remove tmp_place

* fix test mkldnn swish

* add UT for PrepareData CPU->MKLDNN

* add #ifdef PADDLE_WITH_MKLDNN

* Force-push commit
Co-authored-by: Ngrygielski <adam.grygielski@gmail.com>

add nn.functional.normalize API for API2.0, fix L1Loss API typo, test=develop

* add feature to fleet2.0 role_maker, distribute_strategy, test=develop

* set default value to strategy in distributed_optimizer test=develop

set default python3,fix incompatible,cache dir for third party,unify error code,for windows (#26178)

* set default python3 for paddle windows,test=win

* set default python3,cache dir for third party,error code,test=win

* fix some incompatible

* fix some error

* set virtual environment,test=win

* add nll loss API, update demo code of the comment

Update the sigmoid, Sigmoid layer for the api2.0

* Update `paddle.add`

remove `alpha`
update doc sample code
remove `:alias` etc

* Remove `imperative` reference from docstring

* add children and named_children

* adaptive expand op to 2.0 (align to torch.expand) , test=develop

* expose and unify the Tensor concepts to the user

* expose tensor to user

* add copy place for Tensor

* add copy place for Tensor

* add note

* add macro PADDLE_WITH_CUDA

* remove RUN_TYPE=DIST

* fix some error

* add tile_op, test=develop

* add Class KLDivLoss and function kl_div

* test=develop, bug fix for test_dist_fleet_ctr

* add paddle.nn.functional.mse_loss

* add name

* fix conflict

* Upgrade `no_grad` decorator

test=develop

- match torch decorator usage (i.e., with parenthesis)
- handle generator functions
- add `paddle.no_grad` alias

* Switch from `functools` to `decorator`

preserves signature

* Reword decorator usage note

* add unittest for paddlerolemaker with gloo

* fix the doc of inverse, dot, cholesky

Update the code for the min,max, test=develop

add the api and doc for the margin_ranking_loss and MarginRankingLoss

* move paddle.fleet to paddle.distributed.fleet

* add auto_cast, test=develop

* add loss scaler, test=develop

* add comments, test=develop

* refine code, test=develop

* refine code, test=develop

* do not set flags automatically, test=develop

* fix custom op bug, test=develop

* add more test, test=develop

* refine enable logic, test=develop

* enable amp test with GPU, test=develop

* add unittest

* add test for found_inf

* follow comments

* follow comments

* remove global variable, use singleton

* add some notes

* update comments

* update comments

* update comments

* add use_dynamic_loss_scaling argument

* refine found_inf

* refine found_inf

* fix loaded var suffix repeat error

* use new dygraph name for loaded param

change api name eps to epsilon for the pair_distance 

* add nll loss API, update demo code of the comment

add pairewise distance for the paddlepaddle api 2.0