* added matmul_v2 bf16/fp32 FWD kernel

added matmul_v2 bf16/fp32 FWD kernel

* added formatting

* removed some tests due to timeout in CI

* refactored tests

* merged tests classes into one file

* minor change

* removed test guard for CUDA

* remove skipIf

* changes after review

* formated one file

* minor change

* added skipping UT in CUDA place

* scale_matmul_fuse_pass_init

* enhance scale_matmul_fuse_pass

* change scale_matmul_fuse_pass unittest

test=develop.

* add transpose transpose opdef, test=develop

* add line, test=develop

* fix wrong name, test=develop

* add pass, test=develop

* fix bug, test=develop

* fix bug, test=develop

* delete limite about alpha, test=develop

* add mul to reshape2MatmulFusePass, test=develop

* add limit about alpha, test=develop

* fix bug,test=develop

* set adaptive as false and global_pooling as True, test=develop

* set x_num_col_dims as 1, test=develop

* fix reshape, add attr limit, test=develop

* fix conflict,test=develop

* fix comment, test=develop

* fix comment,test=develop

* fix comment,test=develop

* ,test=develop

* add IsType, test=develop

* add IsType, test=develop

* - fix to #33282

* - Increased threshold for elementwise_mul_bf16 grad

* -disabled faulty UT

* - fix to approval

* tmp

* pass con_element_add2_act

* recover unittests CMakeLists

* init pass enhance

* fix the attr according to review

* repair the attr conv2d

* repair axis of elementwise_add

* CI-coverage test=allcase

* repari some attr

* recover batch_norm_act

* conv_elementwise_add2_act_fuse

* base changes for split op

* 90% of split functionality added

* full fp32 functionality

* added bf16 test

* added submemory caching

* added bf test to static mode whitelist

* minor change

* enabled split op for inference

* minor fix

* minor fix

* optimize attr default value, test=develop

* refine, test=develop

* refine, test=develop

* refine, test=develop

* fix bug in AttrReader, test=develop

* fix bug, test=develop

* fix double_grad, test=develop

* refine, test=develop

* refine, test=develop

* fix checker null, test=develop

* for test, test=develop

* refine, test=develop

* refine, test=develop

* refine, test=develop

* refine, test=develop

* refine, test=develop

* refine, test=develop

* batch_norm_act_fuse_pass_init

* repair the unittest of batch_norm_act

* simplify_with_basic

* fix

* scale factor

* Small changes related to BF16 fusion_gru and fusion_lstm

* Correct to pass arg by value

* Add conditions to rnn op

* Correct the spelling mistake

* Improving the test with checking activation

* Trigger CI

* fc_elementwise_layer_fuse_pass

* fc_ele_layernorm_pass

* fc_elementwise_layernorm_pass

* fc_elementwise_layernorm_pass_amend