* [AMP OP&Test] Unique support float16&bfloat16

* add test

* reorder MatrixRank

* fix

* fix

* fix

* fix

* fix

* add gn vjp

* fix 0

* fix args num

* fix type

* debug2

* remove unused expand

* support fp16

* fix typo

* fix reshape bug

* test3

* test4

* fix bug3

* add comment

* update

* fix bug

* update

* fix bug

* Add split, split_with_num tests

* Add randperm tests

* Fix code

* update

* revert lookup_table_op

* rename _varbase_creator as create_tensor

* rename _varbase_creator as create_tensor

* add 0D output support for inalg.slogdet,test=allcase

* fix zerom dime test error test=allcase

* fix test error test=allcase

* add static backward test, test=allcase

* del read

* fix

* test log

* fix

* fix bug

* fix the set_value error in cpu

* add a unitest for set_value OP

* fix platform::is_gpu_place

* add todo note for set_value

* add autogen code support for rnn op

* fix bug

* fix bug

* add autogen code support for lu

* fix bug

* fix bug

* fix bug

* fix bug

* [CustomDevice] add c_identity op

* fix use calc stream

* Implement a common AmpTestBase.

* Support overload of decorate.

* Change the ignore list of flake and fix an error.

* reorder_prior_box

* fix

* mv ps distributed dir

* fix

* add del auto_parallel

* add auto_parallel

* fix ps

* fix bug

* fix test bug

* fix test bug

* merge develop fix error

* merge develop fix error

* merge develop fix error

* initial commit for cutlass_teller

* second commit for cutlass_teller

* add conv2d_depthwise python template

* add conv2d_depthwise cutlass template

* /zhoukangkang/paddle_cutlass/Paddle/paddle/fluid/framework/ir/cutlass_teller.h

* refine code in Conv2dFusionCanSupport

* add macro in cutlass_teller.h

* add 3x3 5x5 teller

* add groups not 1 or conv2d_depthwise teller

* 只生成ic是8的倍数的conv2d_depthwise 的kernel

* add EXPLICIT in cutlass_teller.h

* final commit

* add split_k_slices in conv2d_depthwise

* make stages == 2

* 重构部分代码

* add CutlassFusionType

* solve illegal memory

* make stride_h=stride_w && make dilation==1

* must check HasAttr(use_cutlass) before GetAttrIfExists

* add CONV2D_DEPTHWISE_BIAS_SILU to OpType2String

* modify decl.h and util.cu

* cherry-pick fleet executor from 2.4

* fix test case

* fix ipc counter

* fix missing std::to_string

* unify kernel

* fix ci bugs

* fix py3 bugs

* fix py3 bugs

* perfect code

* [Test Mv] remove rnn

* Update test_rnn_cell_api.py

* fix bug in parse args

* fix bug

* recover legacy_*.yaml

* change 'Out' to Output

* [CINN] fix concat&pow

* update concat

* composite_backward_api

* for ci

* for ci

* update test & fix opmaker

* add random control for fused dropout add

* add __init__

* fix multinomial

* fix test_elementwise

* fix convert_float_to_uint16

* aadd test_multimial_op

* fix code style

* untracked files

* bce_loss_fp16

* remove unused files

* back max_rel_erro still big

* simplify code

* upd

* fix max_relative_error

* restart ci

* Update test_bce_loss.py

* Update test_bce_loss.py

* Update test_bce_loss.py

* Update test_bce_loss.py

* try to pass test

* restore file

* remove error value

* fix bug

---------
Co-authored-by: NZhang Ting <Douyaer2020@qq.com>