* delete empty line of pybing.cc, test=develop

* fix layers train eval bug, test=develop

* add paddle.

* add unittest

Set expected place in child thread for dataloader to avoid costing cuda memory on other card (#30338)

* set expected place in child thread for dataloader

* set device id when set tensor from numpy

* revert tensor_py change

* add compile guard

* fix ci

* fix bug

* Fix bug for 'save mutiple method'

* To pass coverage.

* edit code to pass coverage.

* edit code to pass coverage.

* add unittest for coverage.

* change for coverage.

* edit for coverage.

Add clone method for static Variable so that this interface will be same as dygraph. It fixed some bugs in dy2stat

* delete paddle.nn.functional.assign

* fix dynamic to static error

* fix tensor shape bug

* fix op_num

* clean code

1. When x is Variable, call nn.shape(x) only in following cases:
 1）The shape of x is used in control flow condition.
 2）The dim to be used is negetive
2. When x is Variable, but x.shape or x.shape[idx] doesn't contain negetive value, don't convert to paddle.shape()

* Polish and Optimize the print/repr message of all layer

* fix some code format

* add distributed.split, test=develop

fix the state_dict bug for the xpu

* fix fleet for multi-stream

* fix memcpy for ncclid

* use sync to solve move operation

[Dy2Stat] Fix bug for loop: a variable is used and created in loop, but used before created (#29769)

Enable jit.save to Save Without Running.

Support to transformfor ele in var stms in which var is a slice of Tensor.

[Dy2Stat] 1. Fix bug of for-range stmts. 2. Support that step value is negative in for-range stmts (#29519)

1. Fix error in _build_cond_stmt of for-range stmts. 

2. Support that step value is negative in for-range stmts

3. Fix code because of the diff between Py2 and Py3

* add fast path for p == 0 in dropout

* add ut

* Add ReserveSpace in dygraph batch_norm.

* Add unittest for reservespace

* support deepcopy for Layer/Tensor/Paramerbase

* fix some code

* add tensor_indices in AssignGroupBySize

* add rebuild group in reducer

* fix the bug of reducer in embedding

* add comment

* rm complexvariable

* modify test_var_base unittest

* remove duplicated codes

Reduce exception type so that if covert_to_static failed, it reports right error message.

[Dy2Stat] Fix bug: Do not use gast.Subscript to replace gast.Name in when transforming for_enumerate_loop (#29310)

* basic impl of type promote

* add comment & another testcase

* fix complex bugs & support python op promote type

* fix failed unittests & polish code

* add unittest for coverage

* change to only promote complex type

* polish code details

* polish several comments

* use has_grad instead of train_mode

* add vlog for debug

* fix ut

* fix ut

[Dy2stat] Add a decorator paddle.jit.not_to_static to support that not to convert a function in Dynamic-to-Static. (#29253)

Usage scenarios：A function could have run successfully in static mode,  you can use it to decorate a function in the following cases:
  1. An unknown error occurs in the dynamic-to-static conversion process of the function;
  2. In the internal implementation of the function, it has two branches: dynamic branch and static branch;
  3. Users don't want to convert the function in the process of dynamic to static.

This PR fixes several problems in dy2stat for Deoldify model in PaddleGan.

In model, software engineer wrote if x.shape == y.shape, the Tenser shape is a tuple in dygraph so the == returns True/False, but in static graph the == becomes element-wise comparison, which is a different behavior. In this PR we reduce the element-wise comparison result.

If software engineer write computations which uses parameters in hooks, the static graph can loss the parameter variable because we put param_guard at forward of a Layer. In this PR we made param_guard cover pre-hook and post-hook.

In PaddleGan, software engineer calculated some parameter values in __init__ by running some dygraph code. Those code also run during dy2stat. So some variables may be assign as a VarBase (Tensor) first and then Variable, which raised an error. We fixed the bug in this PR by handling the case.

TODO: We just added testcase for the 1. shape comparison. Should add test case for 2. and 3. But since we are chasing 2.0RC, I will do it in the near future PR

* The leaf tensor concept is exposed and the gradient accumulation of leaf tensor

* The leaf tensor concept is exposed and the gradient accumulation of leaf tensor

* fix coverage

* fix api doc

* fix CI unittest

* fix CI unittest

* fix unitest

* empty tensor does’t need inner_var_

* fix some error message