* add double grad for conv_transpose

* Test compilation time with less parallel count, notest, test=windows_ci

* optimize rules of Unity Build, notest, test=windows_ci, test=windows_op

* limit parallel counts used only on GPU, test=develop

* remove limit of argument /m:8 on Windows, test=develop

* - Reimplemented elementwise_add grad

- lint

* - fix after review

* - Fix to fix after review

fix isfinite_v2_op OpProtoAndCheckerMaker AddComment bug 

* add conj op for complex types

* add conj for complex types

* add more test case

* add conj_op test

* modify conj api and impl

* add complex type for fill_constant_op xpu

* add setConstant for complex type

* remove complex conj test file

* user define grad for test_conj_op

* add test case for static mode of conj api

* modify conj doc

* change input args name to x

* remove useless codes

* conj support real types

* add conj test case for real number

* add complex real op & api & unittest

* add imag op & api & unittest

* refactor op impl

* revert simplify writing due to complile failed

* polish details

* polish grad op code

* fix expand && concat/transpose to new api

* update xpu_header

* update activation op on kunlun

* update activation op on kunlun

* update activation op on kunlun

* update activation op on kunlun

* update activation op on kunlun

* add nearest_interp on kunlun

* update error message

* add constant pad double grad

* 添加rocm平台支持代码

* 修改一些问题

* 修改一些歧义并添加备注

* 修改代码格式

* 解决冲突后的代码修改

* 修改operators.cmake

* 修改格式

* 修正错误

* 统一接口

* 修改日期

* improve grad perf

* add op test case for complex

* polish code details

* add xpu set constant support

* fix argument rror

* remove useless pyc file

* add transpose double grad test=develop

* fix bug of matmul_v2 for broadcast

* fix compile problem when cuda_arch < 6000

* refine code

* refine code

* support roi_align & affine_channel for kunlun

* minor

* improve drop out

* add VectorizedRandomGeneratorWithGenerator

* fix bug

* modify according to comments

* Add the strategy of skipping cc/cu test compilation and execution in CI, test=develop

* fix if error with CI_SKIP_TEST, test=develop

* fix add properties to test error on Linux/MAC, test=develop

* fix set test properties of test_code_generator error, test=develop

* remove test codes and advance judgment of file modification on Linux, test=develop

* rename CI_SKIP_TEST to CI_SKIP_CPP_TEST, test=document_fix

* Add branch judgement on Linux, test=develop

* 1.fix matmul bug 2. add one hot

* add xpu error msg

fix p_norm with empty shape (#29500)

* layernorm fw opt

* layernorm bw opt

* fix typo, test=develop

* remove const dim3 for windows CI compatibility

* merge develop
Co-authored-by: Nzlsh80826 <zlsh80826@gmail.com>

* remove tensor copy in the update_loss_scaling op

* not use thrust.

* fix some cuda memory access error.

As the title

* vec softmax fw

* vec softmax bw

* add a message argument for compiler compatibility

This reverts commit befd6d53.