* fix pipeline

* fix mp pp dp

* fix utest of hybrid parallel

* add utest for tuple

* added support for most matmul cases

* added more functionality

* full functionality of matmul op, fp32 only

* added bf16 tests and functionality

* added formatting

* changes after review

* minor change

* added reviewers suggestions

* replace complex in set tensor from and to numpy

* replace complex template in cast op

* cast indices and label if their type is not consistent

* fix bug

* add unittest

* fix gather op and add logsumexp op on kunlun

* update xpu depence

* update tests and fix elementwise_add

* Support convert sublayers in Sequential Container

* remove paddle.jit.set_code_level

* fix test_paddle_save_load and test_paddle_save_load_binary

* fix unittest:test_paddle_save_load and test_paddle_save_load_binary

* delete *.pyc

* add comment for unittest

* [Rocm] fix test of random_crop_op

* [Rocm] fix test of random_crop_op

* [Rocm] fix test of random_crop_op & simple_rnn_op

* [Rocm] fix test of random_crop_op & simple_rnn_op & logsumexp

* [Rocm] fix test of random_crop_op & simple_rnn_op & logsumexp

* [Rocm] fix test of random_crop_op & simple_rnn_op & logsumexp

* [Rocm] fix test of random_crop_op & logsumexp

* BugFix StaticAanlysis with gast.Subscript

* remove codes

* Output indices of top_k npu op change to int64

* fix accuracy npu bug

* fix errors

* change cast method to FillNpuTensorWithConstant

* change cast method to FillNpuTensorWithConstant

* Enhance grep syntax to avoid random failed

* Enhance grep syntax to avoid random failed

* Add param_guard in ParameterList to support @to_static

* Refactor param_guard of @to_static

* fix unittest failed

* add more unittest

* fix the paddle compare op for the broadcast

* fix compare op in for in the cuda device

* fix precision of mp

* fix bug of seed

* fix dp

* print group

* add use_global_beta_pow

* add use_global_beta_pow

* update npu kernel

* update python api

* refine code

* add ut for use_global_beta_pow

* fix npu kernel

* add ut for api

* add ut for exception

* add ut for save/load

* fix windows CI

* fix windows CI

* fix cpp lint
* fix save/load with unexpected value
* fix save and user interface

* add varbasecopy func to fix the paraBase type bug in layers.to API

* overload _copy_to func for ParamBase

* add xpuplace

* add waiting varbsecopy completion when not blocking

* fix dst_device bug

* modify varbase to shared_ptr

* polish test decoupled py reader

* remove bin file

* fix find_unused_parameters default value