* mean fp16

* fp16

* [AMP OP&Test] mean append bf/fp16

* means append more bf16 uts

* format class name

* fix ci

* fix for windows

* fix issue

* fix redundancy

* fix redund

* fix elewise_max ut bf16 numeric delta

* remove use func

* modify optimizer tests

* lint

* tile_op

* fix bfloat16 x

* feat: add relu composite rule

* feat: add relu composite rule, maximum op

* feat: add relu composite rule, maximum op

* feat: add relu composite rule, polish comments

* feat: add relu composite rule, polish comments

* feat: add relu composite rule, add python api of relu

* feat: add relu composite rule, commit hook

* fix: maximum type error & ban cinn test

* fix: maximum input sequence bugs

* resolve conflicts

* fix: code style bugs

* add: relu fp16 test

* support transpose test on prim and cinn

* fix transpose logic and polish eager_op_test

* move io

* fix ci bugs

* fix ci bugs

* fix py3 bugs

* fix example code

* fix example code

* fix text

* fix text

* deal with ci bugs

* perfect code according comment

* delete import batch

* fix cumsum prim op maker type error

* add axis=None test for cumsum_grad prim

* fix t

* add stack composite rule

* add float16 datatype test

* support elementwise_pow bfloat16

* add only_check_prim parameters in check_grad

* modify unit test

* fix floor test

* fix sigmoid bfloat16 test

* add float16 to log log1p logsumexp

* update log

* update test_activation_op.py

* update

* update codestyle

* Update  test_activation_op codestyle

* update

* update

* up

* update codestyle

* emmm

* -

---------
Co-authored-by: Nwqgo <1552367872@qq.com>

* first commit.

* change host logic

* fix code bugs

* fix code error

---------
Co-authored-by: Nzhangbopd <1299246947@qq.com>

* first approach

* test finished

* cpp test deleted

* CmakeList corrected

* multi_gru_seq_fuse_pass rewritten

* dummy cout deleted

* review changes

* timeout extended

* add float16 to less_equal

* update

* update

* update codestyle

* update file name

---------
Co-authored-by: Nwqgo <1552367872@qq.com>

* add float16 to greater_than

* update codestyle

---------
Co-authored-by: Nwqgo <1552367872@qq.com>

* add float16 to less_than

* Modify the function title

* update

* update

* update  solve PR-CI-Kunlun-KP-Build

* update codestyle

* add float16 to pixel_shuffle

* update

* update

* update solve PR-CI-Kunlun-R200-Test

---------
Co-authored-by: Nwqgo <1552367872@qq.com>

* implement floor_grad by primitive logic

* implement floor_grad by primitive logic

* Merge branch 'develop' into floor_grad

* fix a bug which is triggered by the lack of __class__.op_type

* remove two "self.__class__.op_type = self.op_type"

* matmul refactored

* fc

* SetOutMemDescWithLogicalLayoutFusesSupport

* matmul_v2

* alpha support

* group repetetive funcs

* matmul utils

* execute matmul methods

* restore registered kernel names

* split header and impl files

* remove double negatives

* increase coverage

* add onednn tests to ctest

* remove fusion logic from base matmuls

* add sigmoid composite rule

* add python api

* fix code style.

* add check_prim=True

* add sigmoid fp16 unit test.

* fix code style.

* rm bf16 check_prim

* fix code style.

* find relevant testcase

* remove with_data_parallel in test_dist_base

* fix bugs

* fix test_minst_dgc_nccl

* fix typo

* fix test_dist_mnist_gradient_merge

* rm TestDistMnistNCCL2DGCMultiCards

* fix dist_mnist

* polish code

* fix different PaddleCloudRoleMaker

* support warnings for extra attrs and axis in non default value

* support extra_attr warnings and add test case

* fix dict name

* polish

* polish

* polish

* comp gather_nd_grad

* fix

* test no cinn

* fix

* fix cinn

* Check structed kernel for new executor static build

* Update code

* Ready for resnet50

* Move transfer_dtype to phi

* Ready for transformer

* Fix CI errors

* Fix layer_norm InferMeta

* Remove layer_norm infermeta fix