* cpplint fix 3

* cpplint fix 3

* cpplint fix 3

* cpplint fix 3

resort .cu headers, set clang-format not sort include block and consider .cu as main source file (#43633)

* add new API/OP(csr->csr) of SparseTensor softmax

* fix comment

* fix to_sparse_csr

* [CustomKernel] add custom kernel c api

* update

* update

* fix unable to export capi
Co-authored-by: Nronny1996 <524019753@qq.com>

* fix xpu kp compilation

* add depends

* add some kernel(csr*dense->csr, dense*dense->csr) of SparseTensor matmul

* fix CI

* fix CI

* fix comment

* fix comment

Use int64_t in GetGpuLaunchConfig1D and ElementwiseKernel as index type to support large tensor. (#43506)

* Change some data type from int to int64_t in GetGpuLaunchConfig1D to support large tensor.

* Use int64_t in ElementwiseKernel as index type to support large tensor.

* fix starganv2

* fix starganv2 stop_gradient end error

* fix edvr_starganv2

* fix mul kernel to fix optional ddx

* fix typo

* change logic for optimize

* modifty

* optimize the backward speed of EinsumOp

* add cache optimizer for einsum op

* EinsumOp: fix new dygraph mode error

* fix bug

* change Cache->InnerCache

* fix code

* fix

* add nan inf utils for einsum op

* add as_extra

* memory optimizer for einsum

* update code

* fix stride_slice bug

* fix bug

* use GpuMemcpy and GpuMemset

* sparse convert kernel support double dispatch by indices dtype

* cudaMemcpyKind->gpuMemcpyKind

* fix depthwise conv yaml error

* fix depthwise conv double grad error

* make all phi kernels to 2(host/device) static libraries directly

* fix calling kernel_declare

* fix compile

* fix cpu compile

* fix rocm compile

* fix xpu compile

* fix xpu kp compile

* fix inference compile

Co-authored-by: NLiu Yiqun <liuyiqun01@baidu.com>

* move_group_norm

* move group norm backward

* fix code format

* modify code according comment

Transpose optimization with assitant of  Chengdu Supercomputing Center and auto_tune operation (#42704)

* support heter reindex

* add unittest, fix bug

* add comment

* delete empty line

* refine example

* fix codestyle

* add disable static

* extend forward fast_ln_kernel to support more column values.