* Save all the information of 'ParamBase' in 'Layer'. (#33500)

* Save all the information of 'ParamBase' in 'Layer'.

* edit unittest

* delete the function of saving layer object. (#33697)

* delete the function of saving layer object.

* edit doc of paddle.save/load and polish error message

* update xpu cmake for kunlun (#33328)

* xpu support amp (#33809)

* fix bug DLTP-31078 (#33877)

* update xpu cmake (#33906)

* [xpu] add dropout & amp ops in xpu place (#33891)
Co-authored-by: NTTerror <tangzhiyi11@users.noreply.github.com>

[oneDNN] Fix to #33282 , added support of X input broadcasting to oneDNN elementwise ops (#33549) (#33845)

* - fix to #33282

* - Increased threshold for elementwise_mul_bf16 grad

* -disabled faulty UT

* - fix to approval

Bug fixes， [Cherry-pick][Dy2Stat] Fix unique_name in create_static_variable_gast_node (#33963)

cherry-pick #33818

[Dy2Stat] Support Python3 type hint (#33745)

解决windows cmd和powershell显示乱码的问题

* cherry-pick fix_output_padding_conv

* add repr unittest for conv

* fix gather op and add logsumexp op on kunlun

* update xpu depence

* update tests and fix elementwise_add

* Add raw program meta optimizer (#32597)

* add raw program, test=develop

* add precision unitest for executor all reduce (#33339)

* fix dp (#33297)
Co-authored-by: NYuang Liu <liuyuang@baidu.com>
Co-authored-by: N李季 <2042519524@qq.com>

* 1, remove layernorm dynamic fp16; 2, let reshape out in dynamic shape (#33535)

* Fix gather infer shape using axis (#33413)

* fix gather shape bug

* fix None

* fix topo

* Fix hang of hybrid parallel in new_group  (#33141)

* fix hang of hybrid parallel

* fix new_group for hang problem

* fix hang

[cherry-pick] Polish code for setitem/getitem and support index for list/Tensor/None/Ellipsis/bool (#33528)

* [cherry-pick 2.1] Polish code for _getitem_impl_ (#32868)

* [cherry-pick] Polish code for setitem and getitem (#32911)

* [slice getitem] Support getitem idx is Tensor or List (#33000)

* [getitem] Support index is None for getitem in static mode (#33001)

* [Static getitem] Support static Variable getitem for Ellipsis index (#32876)

* [static getitem]Support index is list bool for getitem in static mode (#33298)

* add warning log for DataLoader output format imcompatible upgrade. test=develop

* add unittest. test=develop

* fix ci converage. test=develop

* fix ci coverage. test=develop

修复pylayer 返回to_tensor时触发段错误的bug。
原因：

如果在Python端修改了stop_gradient属性，c++ 端InnerSetOverridedStopGradient 无法修改stop_gradient属性，在c++端调用SetOverridedStopGradient修改stop_gradient属性。
to_tensor产生的tensor的grad var的DataType为默认值（-1），在backward的过程中grad var的DataType不能为默认值（-1），因此在调用ForwardDataType设置grad var的DataType。

原始PR：#33303

* Eliminate numerical differences of LayerNorm; fix LayerNorm Nan Bug while large data input

* fix bug while large shape of data input

Support diff dataset tensor place in single process dataloader

cherry-pick of #33470

 fuse L2Decay and momentum when param.regularizer is set

cherry-pick #32845

* add random state generate in DataLoader worker. test=develop

* fix license and __all__. test=develop

* fix unittest. test=develop

* update, test=develop

* fix conv2d_transpose trt bugs (#33242)

* fix jetson arch when compiling with single arch (#33269)

* Fix two english api documents, transpose and strided_slice

* OP:strided_slice_op supports bool type inputs

* fix syncbn

* fix compare op in for in the cuda device

* fix the paddle compare op for the broadcast

* fix spawn default nprocs get error

* polish error message

    paddle.save paddle.static.save protocol的默认值改为4（原默认值为2）。

    pickle protocol=4相交于protocol=2：
        protocol=4时保存/加载大于4G的单个numpy.ndarray 等。
        protocol=4时保存/加载的速度有明显提升。
        Python2 不支持protocol=4（paddle2.1主要支持Python3，不再考虑Python2）。

    兼容问题：pickle版本（protocol）会写到文件里面，pickle load的时候会自动识别到protocol，paddle2.1（paddle.save pickle默认版本为2）可以加载paddle2.1.1的模型（paddle.save pickle默认版本为4）。

原始PR：#32904

* [HybridParallel]Fix pipeline in dygraph (#33007)

* fix pipeline

* fix mp pp dp

* fix utest of hybrid parallel

* add utest for tuple

* fix utest (#33108)

* Support convert sublayers in Sequential Container

* remove paddle.jit.set_code_level

* fix precision of mp

* fix bug of seed

* fix dp

* print group