* fix interpolate launch error, test=develop

* fix area mode for interp, test=develop

Implement FunctionTraits to support two kinds of elementwise functor and remove some old codes for broadcast. (#35487)

* reshape support zero-input

* add unitest

* revise error message

* upload global scatter and global gather operators related files

* fix github name

* fix CI error

* fix review and CI error

* fix inf,nan error and modify unittest samples

* add unittest samples

* add unittest samples

* fix unittest error

* test=document_fix

* test=document_fix

* modify doc and add unittest samples

* fix error newline in constant

* modify doc after mentor review

* modify __all__ and doc

* modify doc

* [ROCM] fix top_k_v2 with large shape

* [ROCM] fix top_k_v2 with large shape

* implemented clip op bf16/fp32

* added skipping if not cpu or bf16

* CI rerun after bf16 package change

* added parentheses to ensure formatting

* add test_cumprod_op

* Revert "add test_cumprod_op"

This reverts commit c96cf6dff5d09ae7d8cc72c1e8ae4369a153aa19.

* recommit

* add error message

* test input(x) initialize

* test use cpu

* update test code

* add test type

* add test case

* solve ci problem

* add complex case test

* add complex case test

* fix review problem

* fix conflict

* fix some docs

* change test case

* change test case

* fix review problems again

* fix docs

* fix inclusivescan bug

This PR supports gradient clip (ClipGradByGlobalNorm) when training with AMP(auto mixed precision).

* add as_extra to dropout op and lrn op

* refine details

* fix dropout op maker

* fix extra op for expand, expand_as, tile, unstack

* Update expand_v2_op.cc

* fix bn/in/squeeze/syncbn extra

* update bn

* update

* update

* add opdef extra

* add reduce mean

* update style

* fix scatter gather bug:

* fix windows ci

* add asExtra for nce op

* fix unittest error in macos

* remove asExtra for is_test

* mark extra attr for unsqueeze2

* debug for inference

* init matrix_rank op, add matrix_rank CPU code and test

* add GPU kernel, remove svd_eigen.h

* add CPU kernel when tol is tensor

* add cpu and gpu code when tol is tensor

* fix CI-ROCM error

* add matrix_rank API describe, fix PR-CI-Py3 error

* fix PR-CI-Windows error, add matrix_rank API test

* delete useless comments

* fix review

* add my code in svd_helper.h

* update doc commets

* remove spaces

multiply supports bool  

* mark WhileOp AsExtra attribute

* revert kX and kOutputs

* add clip_by_norm fp16 kernel

* add ut