* add layerwise learning rate for adamw

* fix format

* add unitest

* add NotImplementedError

* add gpu unitest

* update gpuplace

Implement FunctionTraits to support two kinds of elementwise functor and remove some old codes for broadcast. (#35688)

delete blank lines at the beginning of the file

1. optimize the error message of softmax_with_cross_entropy_op;2. add input value check for cross_entropy, if the dimention of input is zero, raise error. test = develop

* [NPU] conv2d_transpose_grad, test=develop

* remove debug files, test=develop

* fix bug, test=develop

* [NPU] fix test_conv2d_transpose_op_npu, test=develop

add fill_ backward

Revert "Implement FunctionTraits to support two kinds of elementwise functor and remove some old codes for broadcast. (#35487)" (#35686)

* fix interpolate launch error, test=develop

* fix area mode for interp, test=develop

Implement FunctionTraits to support two kinds of elementwise functor and remove some old codes for broadcast. (#35487)

* reshape support zero-input

* add unitest

* revise error message

* upload global scatter and global gather operators related files

* fix github name

* fix CI error

* fix review and CI error

* fix inf,nan error and modify unittest samples

* add unittest samples

* add unittest samples

* fix unittest error

* test=document_fix

* test=document_fix

* modify doc and add unittest samples

* fix error newline in constant

* modify doc after mentor review

* modify __all__ and doc

* modify doc

* [ROCM] fix top_k_v2 with large shape

* [ROCM] fix top_k_v2 with large shape

* implemented clip op bf16/fp32

* added skipping if not cpu or bf16

* CI rerun after bf16 package change

* added parentheses to ensure formatting

* add test_cumprod_op

* Revert "add test_cumprod_op"

This reverts commit c96cf6dff5d09ae7d8cc72c1e8ae4369a153aa19.

* recommit

* add error message

* test input(x) initialize

* test use cpu

* update test code

* add test type

* add test case

* solve ci problem

* add complex case test

* add complex case test

* fix review problem

* fix conflict

* fix some docs

* change test case

* change test case

* fix review problems again

* fix docs

* fix inclusivescan bug

This PR supports gradient clip (ClipGradByGlobalNorm) when training with AMP(auto mixed precision).

* add as_extra to dropout op and lrn op

* refine details

* fix dropout op maker

* fix extra op for expand, expand_as, tile, unstack

* Update expand_v2_op.cc

* fix bn/in/squeeze/syncbn extra

* update bn

* update

* update