* [AMP OP&Test] Add check_dtype for some API (part 1)

* fix

* [CustomDevice] add recompute support

* update

* trans fused attention to phi

* add optional parm

* trans fused_attention_grad to phi

* add fused attention grad register info

* fix include

* test=kunlun

* add fused attention to static build list

* add remove

* update remove

* fix performance bugs

* fix ci bugs

* optimize gap between generation step

* remove useless header

* unify_kernel

* fix compile bugs

* fix py3 bugs

* fix xpu bugs

* update

* fix bug

* fix bug

* fix bug

* fix bug

* remove c++14 assert and remove include tensor.h in phi

* mv sequence tests

* mv sequence tests

* fix test error

* fix

* fix

* fix

* fix

* fix

* fix

* fix fuse group order

* first commit

* restruct c++ interface to divide linear from matmulwithcublaslt

* finish building in cublaslt impl

* fix code bugs

* fix host cost

* add some changes

* add autogen code support for mean_all op

* bug fixed

* bug fixed

* bug fixed

* fix graph_reindex

* fix

* Update op_compat.yaml

* update

* fix bug

* update

* fix bug

* update

* fix bug

* Add prelu, clip_by_norm, multi_dot tests

* Fix code

* Fix code

* [AMP OP&Test] Unique support float16&bfloat16

* add test

* reorder MatrixRank

* fix

* fix

* fix

* fix

* fix

* add gn vjp

* fix 0

* fix args num

* fix type

* debug2

* remove unused expand

* support fp16

* fix typo

* fix reshape bug

* test3

* test4

* fix bug3

* add comment

* update

* fix bug

* update

* fix bug

* Add split, split_with_num tests

* Add randperm tests

* Fix code