refactor npu device manager (#31154)

Fix compilation problem (#31100)

* support npu allocator

* add npu device context

* fix some compile problem

* fix some compile problem

* add npu info

* compile ok

* fix include dir

* support naive_best_fit_allocator

* run ut ok, bug failed to exit

* call aclrtResetDevice before exit

* fix aclFinilize

* add system allocatot test

* add selected_gpus in gtest

* add tensor_test for npu

* support npu op, initial commit

* add npu stream

* add elementwise_add_op

* compile ok

* fix typo

* fix elementwise_add_op_npu_test

* support op run

* test can run but failed

* change aclopExecuteV2 to aclopCompileAndExecute

[feature] support npu operator

[feature] support npu allocator

Add distribution supported

usleep function in <unistd.h> only takes argument less than 1,000,000. Current call can exceed this limit, we have to fix it. This PR can fix random CI error.

* optimize memcpy perf for kunlun

* remove useless unitest for kunlun mean

* minor

* - Added UT for testing elementwise_mul caching

* lint fixes

* Polish and Optimize the print/repr message of all layer

* fix some code format

PADDLE_RETRY_CUDA_SUCCESS used wrong sleep time so it can cause timeout in unittest. This PR fixed it.

After we searched the doc in https://pubs.opengroup.org/onlinepubs/7908799/xsh/unistd.h.html, the time unit of sleep in unistd.h takes "seconds", usleep takes "microseconds", Sleep in windows.h takes "milliseconds".

* flush denormals to zero, test=develop

* add comments, test=develop

* Support MIPS arch.

* enable bilateral_slice unittest on windows platform

* reduce max threads

* add support for complex grad accumulated

* add unittest for coverage

* update test dtype

* remove useless blank line

Add Retry Logic to CublasHandlerHolder to avoid random unittest failure.

* - Reimplemented elementwise_add grad

- lint

* - fix after review

* - Fix to fix after review

* Windows generate pdb and dump, for debug

* fix code style, test=develop

* modify cmakelist

Modify CublasHandleHolder from using PADDLE_ENFORCE_CUDA_SUCCESS to PADDLE_RETRY_CUDA_SUCCESS to fix random unittest failure. We checked that the unittest log showed CUDA allocation error at this file, which may due to GPU not enough. We fixed similar failure in the past, so we applied PADDLE_RETRY_CUDA_SUCCESS here.

* 添加rocm平台支持代码

* 修改一些问题

* 修改一些歧义并添加备注

* 修改代码格式

* 解决冲突后的代码修改

* 修改operators.cmake

* 修改格式

* 修正错误

* 统一接口

* 修改日期

* 1.fix matmul bug 2. add one hot

* add xpu error msg

Add Sleep Time for CUDA Retry, which is similar to our GPU retry logic. This is a try to avoid init GPU allocation random failure in unit test.

* added external reorder to profiler

* added external and internal reorders to profiler

* added internal and external reorder to profiler

* added formatting to int/ext reorder commit

* removed unnecessary comment