* support Kunlun2

* support KL2

* support KL2

* support more dim for mul op npu

* update unit test according to reviewer's comment.

* [NPU] add reduce_max

* [NPU] delete skipIf

* [NPU] add atrrs support or check

* [NPU] add attr out_dtype

* [NPU] delete debug codes

* test version of matmul_v2

* added matmul_v2 grad kernel

* minor changes

* minor changes

* minor change for CI approval

* CI fix

* CI fix

* trigger CI

* changes after review, not working yet

* moved ops to anonymous namespaces

* changes after review

* test version of matmul_v2

* added matmul_v2 grad kernel

* minor changes

* minor changes

* minor change for CI approval

* CI fix

* CI fix

* added squeeze and squeeze2 kernels

* CI fix

* CI fix

* CI fix

* disabled tests when compiled with cuda

* added setting format_tag by strides

* added sigmoid BF16 FWD/BWD and gelu BF16 BWD

* changes after review

* Revert "added sigmoid BF16 FWD/BWD and gelu BF16 BWD"

This reverts commit 6e3f76720b545abfcff9f6052b46b73a1e745cae.

* Revert "Merge branch 'matmul_v2_grad' into squeeze2_op"

This reverts commit 06fcf67843a4a7884eccdf67a02a03575e1d4cb8, reversing
changes made to 6e3f76720b545abfcff9f6052b46b73a1e745cae.

* minor change

* added reshape1/2 kernels

* moved some functions into private block

* CI fix

* CI fix

* CI fix

* added expand_v2 bf16/fp32 kernel

* minor change

* CI fix

* added missing test file

* added formatting

* reduced binary size

* CI fix

* [NPU] add clip and clip_grad on NPU, test=develop

* address review comments, test=develop

* update, test=develop

* Support setitem by None index

* remove unreachable code

* Add Checkpoint for set_value_op because add a new attribute

* support ScaleTensor for scale npu kernel

* add more tests for adam npu

* fix compile

* fix unittest

* refine adam optimizer

* [NPU] add NPU ops&uts of compare, test=develop

* testing

* try style-format

* [NPU] update compare_op_npu uts

* [NPU] fix code sytle of test_compare_op_npu.py

This PR add some primitives api related files. Those files are almost empty for the moment, but will be filled later.

Revert "Revert "[Dy2Stat] Refactor ExecutorCache logic and pre-support BuildStrategy for pass (#34181)" (#34348)" (#34384)

This reverts commit 577fdde5.

* [NPU] add tril_triu

* [NPU] delete debug codes

* [NPU] add more test cases, and api test

* [NPU] optimize codes style

* [NPU] add cumsum

* [NPU] delete debug codes

* [NPU] add attr flatten and unittests, and api tests

* [NPU] delete comment codes

* [NPU] add attr flatten and axis exclusive check

* [NPU] delete skipIf

* [NPU] add hard_sigmoid

* [NPU] delete check_dygraph=False and max_relative_error

* [NPU] delete debug codes

* [NPU] add more test cases

* [NPU] add api test TestHardsigmoidAPI

* [NPU] temp delete hard_sigmoid for resovle conficts

* [NPU] resolve conflicts

Revert "[Dy2Stat] Refactor ExecutorCache logic and pre-support BuildStrategy for pass (#34181)" (#34348)

This reverts commit 609f8225.

* logical ops support int8, int16, int32, int64, float, double

* update docs of logical ops

* fix npu and xpu logical ops

* fix npu and xpu logical ops

* fix bug in xpu logical op code

* update test_logical_op_npu and test_logical_op_xpu

* correct error type

* add index_sample_op_npu and tests

* update

* fix variable name

* fix variable name

* copy found_inf to cpu in advance to improve performance

* add npu test

* add npu test

* refine code

* refine memcpy op

* fix adam

* modify into program_id

* fix cache_info declare problem

* fix python int to C long problem

* modify point to reference

* add ENVS

* added sigmoid BF16 FWD/BWD and gelu BF16 BWD

* added newline at EOF

* switched from lambdas to local functions

* changed function names

* add int16 kernel for lookup_talbe and dequantize_abs_max op

* fix cast