* cherry-pick of DeviceContext Split, test=develop (#23737)

* New feature: thread local allocator, test=develop (#23989)

* add the thread_local_allocator, test=develop

* refactor the thread_local_allocator, test=develop

* provides option setting strategy, test=develop

* add boost dependency to cuda_stream, test=develop

* declare the stream::Priority as enum class, test=develop

* deal with PADDLE_ENFORCE_CUDA_SUCCESS macro in pr #23816

* add diag_embed op (#23385)

* add diag_embed op, test=release/2.0-beta

* solved a conflict, test=release/2.0-beta

* lod_rank_table error message enhance. test=develop

* Add `nn.interpolate ` (#23434)

* add bmm and arange op test=develop

* add bmm and arange op test=develop

* update bce docs,test=release/2.0

* update docs, test=release/2.0

* cherry-pick OP Normal, Uniform, Xavier Initializer, smooth_l1, mean_iou error message enhancement (#23751)  test=release/2.0

* cherry-pick,Optimize the error messages of paddle CUDA API

* fix the error messages of paddle CUDA API

* Refactoring PADDLE_ENFORCE_CUDA_SUCCESS, and apply to curand/cudnn/cublas/NCCL

* remove build_ex_string

chery-pick from the pr#23978

* change compare op fore_cpu true to false; test=develop

* unitize name in optimizer; test=develop

* remove force_cpu; test=develop

* enhance pad.* error message, test=develop

* error message enhancement create_parameter create_global_var, test=develop

* use six.PY2 to use long, test=develop

* fix input dtype for create_parameter, test=develop

add manual_seed op into paddle.framework.random

* Add `paddle.nn.loss.MSELoss`

test=develop

* Move to `nn/layer/loss.py`

test=develop

* Fix dygraph

test=develop

* Add test

test=develop

* Increase numel in test

test=develop

* Add test for input with different dimensions

test=develop

optimize compare and logical ops error info, add test case for this ops， add some test case for those ops

cherry-pick #23645

[Cherry-pick 2.0] Error message enhancement of conv2d_fusion and bugfix related to control nodes detecttion in fusion_group (#23985)

* Op(conv2d_fusion) error message enhancement. (#23596)
* Fix the error misjudgment when there are control nodes in graph. (#23943)

* OP error message enhancement of l2_normalize, matmul, mean, etc 

* [Cherry-pick][dy2static]Support recursive call (#23900)
  * Support recursive call.

  * Remove Redundant decorator to pass the Py35 unittest temporarily.

* [Cherry-pick]Fix bug in convert_call because difference exists between python3 and python2. (#23966 )

* allow amp and recompute working together

Weight quantization support channel_wise_abs_max method to achieve higher accuracy (#23629) (#23937)

* Weight quantization support channel_wise_abs_max method to achieve higher accuracy

[Dy2stat] Add Test and Example Code for Different Access to ProgramTranslator and Fix Related Bug (#23958) (#23963)

Cherry pick of 23958

1. Rename Dygraph To Static Decorators to declarative
2. dygraph_to_static_func is still using in some training tests, I cannot delete it now.
3. Add some API docs

* [Cherry-pick Release/2.0] remove redundant visit func, test=develop (#23877)

* [Cherry-pick Release/2.0] [dy2static]Fix a bug of is_dygraph_api and move BasicApiTransformer to a separate file(#23923)

* Move BasicApiTransformer to a separate file. test=develop

* Fix a bug: A api in module is not a real dygraph api in dygraph_to_static. test=develop
Co-authored-by: NChen Weihang <chenweihang@baidu.com>

* Avoid logging.info be printed many times in dygraph_mode,test=develop

* Avoid logging.info be printed many times in dygraph_mode,test=develop