* Support list and tuple for parameters of layer_norm, multiprocess_reader, DatasetFolder and ImageFolder.

* add unittest for layer_norm.

* add require gpu for example.

This reverts commit 4b7242b0.

Co-authored-by: NYang Zhang <yangzhang@live.com>

* fix amp bug

* fix name of wordsize

* add sendrecv, test=develop

* clear CUDA compile environment on windows

* fix Windows CI

* fix Windows CI

* fix Windows CI

* new optimize for where_index_op with prefix sum version.

* write a scan prefix sum kernel with stream for where index op.

* optimize where_index by using cub::DeviceScan::InclusiveSum instead of imperfect self-kernel.

* remove CheckTrue struct and rename stide_array for readable.

* optimize variable name for readable.

* optimize function name and annotation.

* optimize pull sparse

* optimize pull sparse

* change macro

* format

* fix bn docs

* fix unittest

A follow up PR of #32420, we changed the doc of python/paddle/fluid/layers/tensor.py in that PR and we are changing python/paddle/tensor/creation.py in this PR.

* Modified params of some APIs to support tuple and list.

* fixed bug.

* Modified the return value of tensor.grad from numpy as tensor.

* Modify unittests.

* fixed bugs.

* Add warning info for x.grad

* fixed unittests which used x.grad

* fixed bug.

* fix dataloader exit error if user exit program when dataloader is still iterating. test=develop

* Unset ReserveSpace for inference program.

* Support training from an inference program.

* change prepend to append

* fix ut

* add testcase

* fix ut

* fix test_custom_relu_model

* fix model parallel

* rm parallel_help.py

* add embedding

* support backward return None.

* edit unittest.

* edit code according to CI

* Improve error information

* optimize slice op and slice grad op, test=develop

* optimize variable name and annotation information, test=develop

* skip op has no fp16 kernel

* add ut

* add norm_by_times param to ctc_loss

* fix doc,test=develop

paddle.to_tensor will be translated to paddle.assign in Dy2stat, however paddle.assign doesn't support int, float, bool. This PR added the supports.

* [DOC] Clarify the difference between paddle.norm and np.linalg.norm

* add pp dygraph, test=develop

* Dygraph reocmpute

* unitest for Dygraph reocmpute

* dy recompute remove unitest for win and mac

`range` API set its output shape in dygraph but not in static graph, which can cause Dy2stat error. This PR set the shape of `range` API when possible.