* pass found_inf to adam

* add unittest

* fix bug

* refine unittest

* change unit test's directory

* disable unittest on cpu

* mv recv to head, test=develop

* add cuda event and stream api

* add cuda event and stream api

* add get_current_stream api

* add get_current_stream api

* init streams

* modify get_current_stream

* modify get_cuttent_stream

* add synchronize func

* add current_stream doc and test file

* move get_current_stream into CUDA macro

* move CudaEvent into CUDA macro

* move _get_current_stream and _device_synchronize into cuda macro

* modify the macro of cuda stream and event

* add test case for synchronize

* add paddle.devices.cuda module

* event and stream support hip

* add doc for stream and event class

* move cuda stream and event into single pybind

* add cuda_streams_py.cc to cmakelist

* add _device_synchronize and _get_current_stream to core module

* add test case for cudastream and cudaevent

* move __all__ in streams.py

* fix test fail

* add cuda to devices __all__

* fix current_stream doc writing error

* move devices to device direction, and merge device.py into __init__.py

* add required:gpu to sample codes

* remove cuda direction from device/__init__.py

* notest;test=approval

* add npu approval

* fix used before assign

* fix used before assign

* fix func redef

* fix-func-redef

* fix func redef

* fix func redef

* fix func redef

* fix func redef

* fix func redef

* fix func redef

* notest;test=approval

* notest;test=approval

* notest;test=approval

* notest;test=approval

* notest;test=approval

* notest;test=approval

* notest;test=approval

* notest;test=approval

* notest;test=approval

* notest;test=approval

* notest;test=approval

* del test py

* add wait_server_ready

* fix remove bug

* fix the bug that happened in alltoall in dygraph mode

* [NPU] add sigmoid and sigmoid_cross_entropy_with_logits

* [NPU] add debug logs

* [NPU] delete debug logs

* [NPU] reset to paddle.NPUPlace(0)

* [NPU] add more unittests for sigmoid_cross_entropy_with_logits

* delete useless c++ code, and delete check_dygraph=False

* [NPU] delete repeated codes of unittests

* [NPU] fix licence code style

* [NPU] add attrs (now do not support) check for sigmoid_cross_entropy_with_logits

As the title, this PR converts all blocks in program into SSA sub graphs and it is guarded by flag

* add clear_float_status op

* refine infershape

* fix typo

* refine check_finite_and_scale

* refine code

* Add NoNeedBufferVarsInferer

* fix code style

* fix bn

* fix

* add unittest

* fix cpu

* print the signatures of the apis

* some faults, and a test case

* use the FullArgSpec as the ArgSpec, repr>str

为了延续脚本历史，把FullArgsSpec替换为ArgSpec；在逆转回对象时，记得加上inpect.FullArgSpec对象

* script form @zhiboniu

* parsearg

* read argspec from file

* add comments

* refactor check_compatible and its testcases

* skip the empty ArgSepc()

* update the function, get inspect.FullArgSpec instances directly.

* typo

* for the functions using inner-defined VarType or other Class Type not accessable, use the string comparements.

* typo

* logging added

* 若变量和默认值都增加了，用负数索引需要再处理下这个增加的内容

* defaults itself may be NoneType

* defaults added 2 items when args only added 1 item

* same as the previous comment

* enable the check_api_compatible.py

* run test_check_api_compatible.py

* sort the output of print_signatures.py

This PR creates a class to process the program at the C++ level. Currently, this class has one class method:
GetInputsOutputsInBlock()

* Add DCU backend support for custom ops

* Added checks for DeviceCopy and renamed some macros

[pass enhance] make the attribute check only object to which defined in op proto. test=develop (#34146)

* cache core.ops, test=develop

* refine, test=develop

* Refine Constructor logic of ParallelExecutor

* Replace executor into ParallelExecutor in run_program_op

* exclude lr scheduler's state from accumulators_holder

* fix when there is no learning rate scheduler

* make a copy of the loaded state dict to avoid modifying it

* add scatter-gather opt

* fix topo for pp

* rename function

* adam add input SkipUpdate

* add unittest

* add npu unittest

* fix xpu compile

* remove param stream