* add decorator, test=develop

* add fake_interface_only, test=develop

* remove some dygraph_not_support, test=develop

* change dygraph to imperative, test=develop

* add kron op and its python API, doc and unittests.
* add kron in paddle.complex

fix the bug in inferVartype in the uniform_random op, add the support the set of dtype 

* API/OP (affine_channel, group_norm, layer_norm, random_crop, unpool, log_loss) error message enhancement test=develop

* Add cholesky_op forward part. test=develop

* Complete cholesky_op forward part. test=develop

* Add cholesky_op backward part. test=develop

* Complete cholesky_op backward part. test=develop

* Refine cholesky_op error check and docs. test=develop

* Add grad_check unit test for cholesky_op. test=develop

* Fix sample code in cholesky doc. test=develop

* Refine some error messages of cholesky_op. test=develop

* Refine some error messages of cholesky_op. test=develop

* Remove unused input in cholesky_grad. test=develop

* Remove unused input in cholesky_grad. test=develop

* Fix stream for cusolverDnSetStream. test=develop

* Update PADDLE_ENFORCE_CUDA_SUCCESS from cholesky_op to adapt to latest code.
test=develop

* Add CUSOLVER ERROR in enforce.h
test=develop

* Fix the missing return value in cholesky. test=develop

* [Dy2Stat] Add test for ptb model. test=develop

* Simplify code for gast.If in is_control_flow_to_transform. test=develop

* Move IsControlFlowVisitor to file utils. test=develop

* Don't use convert_call for build-in func in CallTransformer. test=develop

* Optimize api is_control_flow_to_transform. test=develop

* Polish the document of IsControlFlowVisitor. test=develop

* Use declarative instead of dygraph_to_static_func. test=develop

* Add trainable_statistics in attr for batch_norm
* Unifying behavior of dynamic graph and static graph

* Simplify code for gast.If in is_control_flow_to_transform.
* Move IsControlFlowVisitor to file utils. 
* Don't use convert_call for build-in func in CallTransformer. 
* Optimize api is_control_flow_to_transform. 
* Polish the document of IsControlFlowVisitor.

* Update creation.py

* change int to floor, test=develop

* fix unittest, test=develop

* Init complex number neural network, test=develop

* Improve doc writing, test=develop

* Fix elementwise add & sub, test=develop

* Fix elementwise mul act, test=develop

* a) add ut for complex variable; b) remove arg act in elementwise_ops. test=develop

Repair unittest: test_dyn_rnn

* add gather split squeeze stack unsqueeze api test=develop

* add gather split squeeze stack unsqueeze api test=develop

* fix bug test=develop

* fix bug test=develop

* fix bug test=develop

* fix bug test=develop

* fix bug test=develop

* test=develop

* upload code for tensor.rand

* fix import

* update example, change paddle.tensor.rand to paddle.rand

* change 'variable' to 'Variable',  test=develop

change 'variable' to 'Variable' in description,  test=develop

* add pre-commit check

* add pre-commit check

* pre-commit check, test=develop

* add more unittest code

* trigger ci, test=develop

* pre-commit check, test=develop

* update api and test comment, test=develop

* update api and test comment, test=develop

* add more type check, test=develop

* add detail error info for device, test=develop

* add unnittest, test=develop

* resolve conflict and pre-commit check, test=develop

* update docs, test=develop

* polish eng docs, test=develop

* lod_rank_table error message enhance. test=develop

Fix the dygraph mode in matmul, add the support in Linear Op

* add DataLoader, Dataset, BatchSampler

* add clamp api, test=develop

* test=develop, add seed arguemnt of randint API

* add diag_embed op, test=develop

* add TestCase of diag_embed API

* Modified diag embed python API teastcase from dygraph to static graph, test=develop

* delete useless log and trigger ci, test=develop

* modified float16 of diag_embed, test=develop

* modified en doc of diag_embed

* trigger ci, test=develop

* add fp16 in dtype check of python API, test=develop

* modified __init__ and fix a big, test=develop

* modified a test bug of test_bicubic_interp_op and test_trilinear_interp_op, test=develop

* modified to use one kernel on cpu and cuda, test=develop

* enhance pad.* error message, test=develop

* optimize rank_attention, test=develop

* use the paddle memory pool, test=develop

* set max size, test=develop

* limit the max size, test=develop

* fix the head of cu, test=develop

* add AsDispensable, test=develop

* Add `paddle.nn.loss.MSELoss`

test=develop

* Move to `nn/layer/loss.py`

test=develop

* Add test

test=develop

* Fix dygraph

test=develop

* Increase numel in test

test=develop

* Add test for input with more dimensions

test=develop

* test=develop
Co-authored-by: Nwuxing03 <wuxing03@baidu.com>

Fix bug in convert_call because difference exists between python3 and python2. test=develop (#23966)

restrict block num of layer_norm_grad cuda kernel to 128, test=develop