* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* api2.0 paddle.nn.Bilinear and paddle.nn.functional.bilinear, test=develop

* api2.0 fix code examples, test=develop

* modify test_bilinear_api, about place,to_tensor , test=develop

* re pass pre-commit, test=develop

* Update common.py

* fix BilinearTensorProduct ci error, test=develop

* add pool2d3d API,test=develop

* add api unitest,test=develop

* fix unittest, test=develop

* fix reviews, test=develop

* return one element when return indices is true, test=develop

* fix low converage; to_variable to to_tensor, test=develop

* sort API params, test=develop

* fix en doc, merge PR#26108 to here, test=develop

* fix en doc, test=develop

* fix syncbn, test=develop

* fix test,test=develop

* fix unittest,test=develop

* Add MultiHeadAttention api.
test=develop

* Add MultiHeadAttention cache type and gen_cache.
test=develop

* Add TransformerEncoderLayer and TransformerEncoder.
test=develop

* Add Transformer decoder apis.
test=develop

* Add Transformer api.
test=develop

* add unittests for transformer api

* add unittests for transformer api

* Fix some bugs in Transformer apis.
test=develop

* add unittests for encoder, decoder and transformer

* clean conflicts infor in code

* clean Chinese comments

* Add TransformerDecoderCell and TransformerBeamSearchDecoder.
test=develop

* Remove TransformerDecoderCell and TransformerBeamSearchDecoder temporarily.
test=develop

* Add import for Transformer apis.
test=develop

* Update usage of weight_attr and Tensor in Transformer api docs.
test=develop

* Update Transformer apis by renaming MultiheadAttention and cal_kv according to comments.
test=develop

* Fix MultiHeadAttention in test_transformer_api.py.
test=develop
Co-authored-by: NLiuChiaChi <709153940@qq.com>

* add alpha_dropout in nn.functional and nn.layer, test=develop

* refine Interface and assertion, test=develop

* fix ci import error, test=develop

* fix alias and use layers.scale, test=develop

* fix doc and training params, test=develop

* refine details in doc, test=develop

* fix doc details, test=develop

* update Conv2d Conv3d conv2d conv3d api

* update conv_transpose api

* add binary cross entropy with logit loss

* [API2.0] add dropout, dropout2d and dropout3d, test=develop

* refine Interface and assertion after review, test=develop

* fix alias p=1 and use scale, test=develop

* fix doc and training, test=develop

* fix doc in Dropout2D, test=develop

* add functional ctc_loss and CTCLoss class.

* modified docstring of ctc_loss and CTCLoss

* add cross_entropy to nn/layer and nn/functional, test=develop

* use functional/cross_entropy in layer/CrossEntropy

* use functional/cross_entropy in layer/CrossEntropy, test=develop

* add adaptive_avg_pool2d

* add adaptive_avg_pool3d

Fix the API of bce loss and add functional API binary_cross_entropy 

* add pad func

* add pad

* test=develop, add pad op and apis

* restore pad2d

* test=develop, fix paddl declare

* fix pad interface

* test=develop, fix pad

* test=develop, add all pad api and cos_sim

* test=develop, remove padding default value

* test=develop, rename var to tensor

* test=develop, add more tests

* test=develop, rename tovar to totensor

* test=develop, fix init

* test=develop, add more test

* test=develop, add more tests

* add SyncBatchNorm,test=develop

* logsigmoid and LogSigmoid, test=develop

* add elu gelu relu, test=develop

* update to_variable to to_tensor, test=develop

* address review comments, test=develop

* address review comments, test=develop

* change to_variable to to_tensor in test, test=develop

add nn.functional.normalize API for API2.0, fix L1Loss API typo, test=develop

* upate the target to label, test=develop

* Update the code for the margin_ranking_loss, test=develop

Update the sigmoid, Sigmoid layer for the api2.0

* expose and unify the Tensor concepts to the user

* expose tensor to user

* add copy place for Tensor

* add copy place for Tensor

* add note

* add macro PADDLE_WITH_CUDA

* remove RUN_TYPE=DIST

* fix some error

* add Class KLDivLoss and function kl_div

add the api and doc for the margin_ranking_loss and MarginRankingLoss