* refine structure for cuda and rocm

* update

* update

* update

* update

* fix bug:
1. atten: set the default value of attn_dropout_rate to None
2. ffn: add activation parameter

* Update the implement of reduceAnyKernel according to kernel primitive api
* Fix a bug in ReadData, ReadDataBc and ReadDataReduce when NX != 1

Implement FunctionTraits to support two kinds of elementwise functor and remove some old codes for broadcast. (#35688)

Revert "Implement FunctionTraits to support two kinds of elementwise functor and remove some old codes for broadcast. (#35487)" (#35686)

Implement FunctionTraits to support two kinds of elementwise functor and remove some old codes for broadcast. (#35487)

Describe

Add feed_forward for fused attention op.
(1) Encapsulate matmul impl (forward and backward) used in attention op.
(2) Implement bias_add (forward and backward) used in attention op.