* run pre-commit

* use HOST or DEVICE instead of HOSTDEVICE in implementation of lgamma op

* add test for fp32

* add lgamma to op_threshold_white_list

* add cuda kernel for lgamma kernel

* modify numeric grad delta

* fix small English issue

* change LaunchElementwiseCudaKernel to LaunchSameDimsElementwiseCudaKernel

Change-Id: I2e82dfcee6a1d0512b94cebc32281123fa5bf597

* pretty print for datafeed error

Change-Id: I056a8b6f03608e96679a83846c97aed289cef7e6

* fix fleet dist infer ut

* refine ~npuOpRunner

* implement destructor and forbid copy

* use reference to avoid copy

* use const reference

* relax adam precision

* fix top_k

Sigmoid: Out = Sigmoid(X)
SigmoidGrad: DX = DOut*(1-Out)*Out

[This Patch]
Out
DOut -> SigmoidGradGrad -> DOutNew
DDX                        DDOut

DDOut = (1-Out)*Out*DDX
DOutNew = (1-2*Out)*DOut*DDX

* added op cast functionality for fp32/bf16

* added newline

* added entries in static mode white list and unity build

* fixed failing tests

* changes after review

* added formatting

* upgraded tests file as reviewer suggested

* changes after review

* minor change

* fix pipeline

* fix mp pp dp

* fix utest of hybrid parallel

* add utest for tuple

* added support for most matmul cases

* added more functionality

* full functionality of matmul op, fp32 only

* added bf16 tests and functionality

* added formatting

* changes after review

* minor change

* added reviewers suggestions

* replace complex in set tensor from and to numpy

* replace complex template in cast op

* cast indices and label if their type is not consistent

* fix bug

* add unittest

* fix gather op and add logsumexp op on kunlun

* update xpu depence

* update tests and fix elementwise_add

* Support convert sublayers in Sequential Container

* remove paddle.jit.set_code_level

* fix test_paddle_save_load and test_paddle_save_load_binary

* fix unittest:test_paddle_save_load and test_paddle_save_load_binary

* delete *.pyc

* add comment for unittest

* [Rocm] fix test of random_crop_op

* [Rocm] fix test of random_crop_op

* [Rocm] fix test of random_crop_op & simple_rnn_op

* [Rocm] fix test of random_crop_op & simple_rnn_op & logsumexp

* [Rocm] fix test of random_crop_op & simple_rnn_op & logsumexp

* [Rocm] fix test of random_crop_op & simple_rnn_op & logsumexp

* [Rocm] fix test of random_crop_op & logsumexp

* BugFix StaticAanlysis with gast.Subscript

* remove codes

* Output indices of top_k npu op change to int64

* fix accuracy npu bug

* fix errors

* change cast method to FillNpuTensorWithConstant

* change cast method to FillNpuTensorWithConstant

* Enhance grep syntax to avoid random failed

* Enhance grep syntax to avoid random failed

* Add param_guard in ParameterList to support @to_static

* Refactor param_guard of @to_static

* fix unittest failed

* add more unittest

* fix the paddle compare op for the broadcast

* fix compare op in for in the cuda device

* fix precision of mp

* fix bug of seed

* fix dp

* print group

* add use_global_beta_pow

* add use_global_beta_pow

* update npu kernel

* update python api

* refine code

* add ut for use_global_beta_pow

* fix npu kernel

* add ut for api

* add ut for exception

* add ut for save/load

* fix windows CI

* fix windows CI

* fix cpp lint
* fix save/load with unexpected value
* fix save and user interface

* add varbasecopy func to fix the paraBase type bug in layers.to API

* overload _copy_to func for ParamBase

* add xpuplace

* add waiting varbsecopy completion when not blocking

* fix dst_device bug

* modify varbase to shared_ptr

* polish test decoupled py reader

* remove bin file