* Support append customize attributes into op_desc in nn.Layer

* fix code style

* support override

* add unittest

* add option verbose for predict api

* add random state generate in DataLoader worker. test=develop

* add parallel_cross_entropy

* add grad for crossentropy

* fix cross entropy

* support state_dict save to memory.

* Perfect unittest

* perfect unittest.

* suport saving binary var to memory

* polish code.

* packag save/load files into pybind/io.py

* polish code .

* add example for save to memory; remove useless save load function(_load_static_dict,_save_dygraph_dict)

* delete _load_static/dygraph_dict;_save_static/dygraph_dict

* edit example of paddle.save/load

* Modify into core.ops.run_program

* add DDout in core.ops.run_program

* fix typo

* add DOut

* fix typo

* put DOut last

* modify API nn.Bilinear's doc, test=develop

* add two attributes for yolo box

* Add wrap for functional api
* Refine the wraped api
* Add unit test for quant functional layers
* Update all unit tests for dygraph qat

* move data to CUDAPlace in advance

* replace 'InnerSetOverridedStopGradient' with 'SetOverridedStopGradient'.

* improve coverage.

* polish error message.

* add dynamic layer_norm plugin

* fix bug

* fix numpy.allclose

* fix format

* fix code style

* remove shepe in dynamic shape

* code format

* remove layer norm fp16

* fix format

* fix: paddle.static.default_main_program. test=develop

* add normalize_program to __all__. test=develop

Add 'self' parameters to function Cluster::update_pods, use variable name 'cur_proxy' instead of 'proxy' in file 'tools/get_pr_ut.py' (#33377)

* undefined variable proxy

* Cluster::update_pods lacks of parameter self

* Fix two english api documents, transpose and strided_slice

* OP:strided_slice_op supports bool type inputs

* add private api for memcpy_op

* change place dtype

* add private python api for memcpy op

* fix c_split bug

* fix utest

* add c_embedding for tensorparallel

* fix inference prepare data bug

* rename functions

* typo

* typo

* typo

* UT correct

* correct condition

* correct condition

* ci coverage

* morelines

* fix ci coverage

* fix stop_gradient in paddle.to_tensor

* make to_tensor copy if data is varbase

* add ut

* refine sample code

This PR made these changes to support double grad:

1. Translate `paddle.grad` to `paddle.static.gradients` to support double grad for dy2stat.
2. Fix IfElseTransformer bug which may not change value if "Store before Load" variable is in "Store" statement is in IfElse conditional statement
3. Add `DOut` to support double grad variables in `run_program_op`
4. Add support for renaming for double grads for `jit.save/load`

* fix hang of hybrid parallel

* fix new_group for hang problem