* add nearest_interp_v2 on kunlun

* add nearest_interp_v2 on kunlun

* fix fleet for multi-stream

* fix memcpy for ncclid

* use sync to solve move operation

Add Retry Logic to CublasHandlerHolder to avoid random unittest failure.

* add double grad for conv_transpose

* Test compilation time with less parallel count, notest, test=windows_ci

* optimize rules of Unity Build, notest, test=windows_ci, test=windows_op

* limit parallel counts used only on GPU, test=develop

* remove limit of argument /m:8 on Windows, test=develop

* - Reimplemented elementwise_add grad

- lint

* - fix after review

* - Fix to fix after review

fix isfinite_v2_op OpProtoAndCheckerMaker AddComment bug 

* add conj op for complex types

* add conj for complex types

* add more test case

* add conj_op test

* modify conj api and impl

* add complex type for fill_constant_op xpu

* add setConstant for complex type

* remove complex conj test file

* user define grad for test_conj_op

* add test case for static mode of conj api

* modify conj doc

* change input args name to x

* remove useless codes

* conj support real types

* add conj test case for real number

* enable_use_gpu has higher priority than FLAGS

* update.

* Windows generate pdb and dump, for debug

* fix code style, test=develop

* modify cmakelist

Modify CublasHandleHolder from using PADDLE_ENFORCE_CUDA_SUCCESS to PADDLE_RETRY_CUDA_SUCCESS to fix random unittest failure. We checked that the unittest log showed CUDA allocation error at this file, which may due to GPU not enough. We fixed similar failure in the past, so we applied PADDLE_RETRY_CUDA_SUCCESS here.

* add complex real op & api & unittest

* add imag op & api & unittest

* refactor op impl

* revert simplify writing due to complile failed

* polish details

* polish grad op code

* fix expand && concat/transpose to new api

* update xpu_header

* update activation op on kunlun

* update activation op on kunlun

* update activation op on kunlun

* update activation op on kunlun

* update activation op on kunlun

* add nearest_interp on kunlun

* update error message

* add constant pad double grad

* 添加rocm平台支持代码

* 修改一些问题

* 修改一些歧义并添加备注

* 修改代码格式

* 解决冲突后的代码修改

* 修改operators.cmake

* 修改格式

* 修正错误

* 统一接口

* 修改日期

* improve grad perf

* add op test case for complex

* polish code details

* add xpu set constant support

* fix argument rror

* remove useless pyc file

* add transpose double grad test=develop

* fix bug of matmul_v2 for broadcast