* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* add norm 2.0 api, test=develop

* api2.0 paddle.nn.Bilinear and paddle.nn.functional.bilinear, test=develop

* api2.0 fix code examples, test=develop

* modify test_bilinear_api, about place,to_tensor , test=develop

* re pass pre-commit, test=develop

* Update common.py

* fix BilinearTensorProduct ci error, test=develop

* Add MultiHeadAttention api.
test=develop

* Add MultiHeadAttention cache type and gen_cache.
test=develop

* Add TransformerEncoderLayer and TransformerEncoder.
test=develop

* Add Transformer decoder apis.
test=develop

* Add Transformer api.
test=develop

* add unittests for transformer api

* add unittests for transformer api

* Fix some bugs in Transformer apis.
test=develop

* add unittests for encoder, decoder and transformer

* clean conflicts infor in code

* clean Chinese comments

* Add TransformerDecoderCell and TransformerBeamSearchDecoder.
test=develop

* Remove TransformerDecoderCell and TransformerBeamSearchDecoder temporarily.
test=develop

* Add import for Transformer apis.
test=develop

* Update usage of weight_attr and Tensor in Transformer api docs.
test=develop

* Update Transformer apis by renaming MultiheadAttention and cal_kv according to comments.
test=develop

* Fix MultiHeadAttention in test_transformer_api.py.
test=develop
Co-authored-by: NLiuChiaChi <709153940@qq.com>

* add alpha_dropout in nn.functional and nn.layer, test=develop

* refine Interface and assertion, test=develop

* fix ci import error, test=develop

* fix alias and use layers.scale, test=develop

* fix doc and training params, test=develop

* refine details in doc, test=develop

* fix doc details, test=develop

* update Conv2d Conv3d conv2d conv3d api

* update conv_transpose api

* add binary cross entropy with logit loss

* [API2.0] add dropout, dropout2d and dropout3d, test=develop

* refine Interface and assertion after review, test=develop

* fix alias p=1 and use scale, test=develop

* fix doc and training, test=develop

* fix doc in Dropout2D, test=develop

* add functional ctc_loss and CTCLoss class.

* modified docstring of ctc_loss and CTCLoss

* add adaptive_avg_pool2d

* add adaptive_avg_pool3d

* add weight_norm, test=develop

* Rename `Input` into `InputSpec`

* fix argument place of Input api

* add pad func

* add pad

* test=develop, add pad op and apis

* restore pad2d

* test=develop, fix paddl declare

* fix pad interface

* test=develop, fix pad

* test=develop, add all pad api and cos_sim

* test=develop, remove padding default value

* test=develop, rename var to tensor

* test=develop, add more tests

* test=develop, rename tovar to totensor

* test=develop, fix init

* test=develop, add more test

* test=develop, add more tests

* add SyncBatchNorm,test=develop

* logsigmoid and LogSigmoid, test=develop

* add elu gelu relu, test=develop

* update to_variable to to_tensor, test=develop

* address review comments, test=develop

* address review comments, test=develop

* change to_variable to to_tensor in test, test=develop

* add Class KLDivLoss and function kl_div

add the api and doc for the margin_ranking_loss and MarginRankingLoss

add pairewise distance for the paddlepaddle api 2.0

* add Pad2D and Leaky_ReLU, test=develop

* update,test=develop

* change name,test=develop

* add unittest and redine docs,test=develop

* add alias in paddle.nn and paddle.tensor test=develop

* add alias in paddle.nn and paddle.tensor dir test=develop

* fix same conflict manually test=develop

* update fc and dygraph alias test=develop

* fix initalizer.py typo test=develop

* add base name alias; test=develop

* fix embedding bug; test=develop

* fix io error; test=develop

* add metric; test=develop

* add import palce; test=develop

* add setup; test=develop

* fix incubate reader; test=develop

* fix initializer error; test=develop

* test=develop add linear interpolate operator

* copy dygraph api to paddle.imperative, test=develop

* polish the code, test=develop

* polish code, test=develop

* polish code, test=develop

* move paddle.imperative.Layer to paddle.nn.Layer, test=develop

* define fluid alias in paddle.tensor and paddle.nn dir test=develop

* from layer import loss in paddle.nn dir test=develop

* add diag_embed op, test=develop

* add TestCase of diag_embed API

* Modified diag embed python API teastcase from dygraph to static graph, test=develop

* delete useless log and trigger ci, test=develop

* modified float16 of diag_embed, test=develop

* modified en doc of diag_embed

* trigger ci, test=develop

* add fp16 in dtype check of python API, test=develop

* modified __init__ and fix a big, test=develop

* modified a test bug of test_bicubic_interp_op and test_trilinear_interp_op, test=develop

* modified to use one kernel on cpu and cuda, test=develop

* add nll_loss op test=develop

* add approximation for gelu, test=develop

* add functional conv

* add test and doc for function convs, test=develop

* update ConvTransposeOp's InferShape and error message, test=develop

* add hsigmoid, row_conv in paddle.nn(functional and layer), test=develop

* fix hyperlinks in docstring

* add cross_entropy_loss,test=develop
* fix some commnet,test=develop

* add bce_loss

* fix mistake

* replace paddle_enforce,test=develop

* fix,test=develop

* update,test=develop

* remove duplicate,test=develop

* update,test=develop

* update error,test=develop

* update,test=develop

* fix unittest, test=develop

* update, test=develop