* support pure bfloat16

* support bf16 linear

* update PR to pass CI

* tiny fix where_grad_kernel.cu

* add bfloat16 to selu_grad to pass CI

* fix selu grad compilation error

* [PFCC] SeluKernel Optimization

* selu kernel optimization

* add private

Co-authored-by: carryyu <>

* test_activation_op unitest error, yaml & activation.py in_dygraph_mode incomplete

* fix test_activation_op unitest error, add yaml and dygraph test

* fix code style with pre-commit

* try to fix namespace error of abs in activation_functor.h

* fix namespace error of abs

* add relu6 kernel and yaml

* format files

* format code and fix bug

* fix build failed

resort .cu headers, set clang-format not sort include block and consider .cu as main source file (#43633)

This reverts commit 05f3d48e.

This reverts commit e77a947e.

* update

* add forward case

* update

* update; test=develop

* add some grad kernel; test=develop

* move gpu kernel; test=develop

* update

* update;

* update test;

* fix selected rows bug;

* add mix vector include ;

* add mixed vector depen; test=develop

* add logit grad signature;

* polish code

* fix bug;

* add namespace for abs

* revert code

* not move softsign

* revmove duplate register;

* fix softsign bug

* polish code

* format

* format

* fix bug

* remove cmake dep

* add square sqrt selected rows support

* update

* remove clip norm

* add standalone executor sqrt dep

* standalone exec denp sqrt

* remove sqrt op in cmkaelist

* open some case

* move activation

* fix bugs when run ce

* move activation op

* adjust code format

* fix compile bugs

* fix ci bugs

* code format adjust

* code format adjust2

* activate ci status

* modify according to comment

* move activation kernel

* revert relu6

* reduce add code

* perfect use_phi_functor

* completing func name

* fix bugs when run ci

* fix bugs when run infr

* modifpy infrt get kernel signature

[Phi]Move Relu/Cos/Sin/Tan/Acos/Asin/Atan/Sinh/Cosh/Asinh/Acosh/Atanh kernels in Activation to Phi (#40175)

* move activation op

* adjust code format

* fix compile bugs

* fix ci bugs

* code format adjust

* code format adjust2

* activate ci status

* modify according to comment