Revert "Revert "[Dy2Stat] Refactor ExecutorCache logic and pre-support BuildStrategy for pass (#34181)" (#34348)" (#34384)

This reverts commit 577fdde5.

* [NPU] add tril_triu

* [NPU] delete debug codes

* [NPU] add more test cases, and api test

* [NPU] optimize codes style

* Support getitem by ellipsis index in dynamic mode

* change some code style

* Support getitem by none index in dynamic mode

* modify a comments style and remove useless code

* [NPU] add cumsum

* [NPU] delete debug codes

* [NPU] add attr flatten and unittests, and api tests

* [NPU] delete comment codes

* [NPU] add attr flatten and axis exclusive check

* [NPU] delete skipIf

* [NPU] add hard_sigmoid

* [NPU] delete check_dygraph=False and max_relative_error

* [NPU] delete debug codes

* [NPU] add more test cases

* [NPU] add api test TestHardsigmoidAPI

* [NPU] temp delete hard_sigmoid for resovle conficts

* [NPU] resolve conflicts

* fixed CI failing

* removed unnecessary imports

Revert "[Dy2Stat] Refactor ExecutorCache logic and pre-support BuildStrategy for pass (#34181)" (#34348)

This reverts commit 609f8225.

* logical ops support int8, int16, int32, int64, float, double

* update docs of logical ops

* fix npu and xpu logical ops

* fix npu and xpu logical ops

* fix bug in xpu logical op code

* update test_logical_op_npu and test_logical_op_xpu

* correct error type

* add index_sample_op_npu and tests

* update

* copy found_inf to cpu in advance to improve performance

* add npu test

* add npu test

* refine code

* refine memcpy op

* fix adam

* modify into program_id

* fix cache_info declare problem

* fix python int to C long problem

* modify point to reference

* add ENVS

* added sigmoid BF16 FWD/BWD and gelu BF16 BWD

* added newline at EOF

* switched from lambdas to local functions

* changed function names

* add int16 kernel for lookup_talbe and dequantize_abs_max op

* Support getitem by ellipsis index in dynamic mode

* change some code style

* add npu unittest only if WITH_ASCEND_CL is ON

* remove @unittest.skipIf, since these unittests will only be created when WITH_ASCEND_CL is ON

* open dygraph test for npu test

* reduce_mean supported. test=allcase

* ut. test=allcase

* test=develop

* ut.test=allcase

* correct name. test=allcase

* correct UT. test=allcase

* correct UT.test=develop

* remove op

* UT

* add convert

* fix timeout issue

* more uts

* more ut

* correct ut

* support Nest sequtial container

* rename model path

* change strided_slice when step<0.

* add unittest for paddle.strided_slice

* polish unittest

* pass found_inf to adam

* add unittest

* fix bug

* refine unittest

* change unit test's directory

* disable unittest on cpu

* mv recv to head, test=develop

* add cuda event and stream api

* add cuda event and stream api

* add get_current_stream api

* add get_current_stream api

* init streams

* modify get_current_stream

* modify get_cuttent_stream

* add synchronize func

* add current_stream doc and test file

* move get_current_stream into CUDA macro

* move CudaEvent into CUDA macro

* move _get_current_stream and _device_synchronize into cuda macro

* modify the macro of cuda stream and event

* add test case for synchronize

* add paddle.devices.cuda module

* event and stream support hip

* add doc for stream and event class

* move cuda stream and event into single pybind

* add cuda_streams_py.cc to cmakelist

* add _device_synchronize and _get_current_stream to core module

* add test case for cudastream and cudaevent

* move __all__ in streams.py

* fix test fail

* add cuda to devices __all__

* fix current_stream doc writing error

* move devices to device direction, and merge device.py into __init__.py

* add required:gpu to sample codes

* remove cuda direction from device/__init__.py

* fix used before assign

* fix used before assign

* fix func redef

* fix-func-redef

* fix func redef

* fix func redef

* fix func redef

* fix func redef

* fix func redef

* fix func redef

* fix the bug that happened in alltoall in dygraph mode

* [NPU] add sigmoid and sigmoid_cross_entropy_with_logits

* [NPU] add debug logs

* [NPU] delete debug logs

* [NPU] reset to paddle.NPUPlace(0)

* [NPU] add more unittests for sigmoid_cross_entropy_with_logits

* delete useless c++ code, and delete check_dygraph=False

* [NPU] delete repeated codes of unittests

* [NPU] fix licence code style

* [NPU] add attrs (now do not support) check for sigmoid_cross_entropy_with_logits

* add clear_float_status op

* refine infershape

* fix typo

* refine check_finite_and_scale

* refine code