* add cuda event and stream api

* add cuda event and stream api

* add get_current_stream api

* add get_current_stream api

* init streams

* modify get_current_stream

* modify get_cuttent_stream

* add synchronize func

* add current_stream doc and test file

* move get_current_stream into CUDA macro

* move CudaEvent into CUDA macro

* move _get_current_stream and _device_synchronize into cuda macro

* modify the macro of cuda stream and event

* add test case for synchronize

* add paddle.devices.cuda module

* event and stream support hip

* add doc for stream and event class

* move cuda stream and event into single pybind

* add cuda_streams_py.cc to cmakelist

* add _device_synchronize and _get_current_stream to core module

* add test case for cudastream and cudaevent

* move __all__ in streams.py

* fix test fail

* add cuda to devices __all__

* fix current_stream doc writing error

* move devices to device direction, and merge device.py into __init__.py

* add required:gpu to sample codes

* remove cuda direction from device/__init__.py

* fix used before assign

* fix used before assign

* fix func redef

* fix-func-redef

* fix func redef

* fix func redef

* fix func redef

* fix func redef

* fix func redef

* fix func redef

* fix the bug that happened in alltoall in dygraph mode

* [NPU] add sigmoid and sigmoid_cross_entropy_with_logits

* [NPU] add debug logs

* [NPU] delete debug logs

* [NPU] reset to paddle.NPUPlace(0)

* [NPU] add more unittests for sigmoid_cross_entropy_with_logits

* delete useless c++ code, and delete check_dygraph=False

* [NPU] delete repeated codes of unittests

* [NPU] fix licence code style

* [NPU] add attrs (now do not support) check for sigmoid_cross_entropy_with_logits

* add clear_float_status op

* refine infershape

* fix typo

* refine check_finite_and_scale

* refine code

* fix bn

* fix

* add unittest

* fix cpu

* cache core.ops, test=develop

* refine, test=develop

* Refine Constructor logic of ParallelExecutor

* Replace executor into ParallelExecutor in run_program_op

* adam add input SkipUpdate

* add unittest

* add npu unittest

* fix xpu compile

* remove param stream

* jit.save/load support method with parameters.

* add unittest and warning

* polish warning message.

As the title, add Python helper function to get block Inputs/Outputs. This function is helpful to distributed computing for sharding.

* Added OpTestTool for BF16 convenience

* fixes after review, names changed to snake case.

* fixes after review, naming reflects cpu.

* Support sccache to speed up compilation on Windows

* Support sccache to speed up compilation on Windows

* fix paddle.no_grad

* fix paddle.no_grad

* add npu operator for gaussian random.

* bugfix: add wait after memory copy.

* update gaussian random op: use TensorCopy.

* add trt LT version helper

* upgrade PluginTensorRT to IPluginV2Ext

* trt plugin factory is not usable in IPluginV2

* upgrade add plugin api to use IPluginV2

* remove IPlugin register and adapt getSerializeSize(), serialize()

* adapt IPluginV2Layer

* downgrade to IPluginV2

* implement elementwise clone

* add gelu plugin creator and fix gelu serialization bug

* add swish plugin creator and fix swish serialization bug

* format

* fix typo

* add elementwise plugin creator and fix serialization

* add base creator class

* add gelu plugin creator

* add hard swish creator and fix serialization

* add instance norm creator and fix serialization

* add layer norm creator and fix serialization

* add pool creator and fix serialization

* add prelu creator and fix serialization

* add slice creator and fix serialization

* add swish creator and fix serialization

* add instance norm op unittest

* remove redundent api

* fix wrong graph size to enable trt

* instance norm function move to cc

* add trt elementwise ut to trigger coverage

* remove opt cahce to hit serialization coverage

* remove opt cahce to hit serialization coverage

* remove unused code

* remove unused inputs_

* add dbg info

* remove dbg info

* add instance norm serialization

* roll back

* remove comment code

* remove trt plugin registery

* fix prelu dynamic serialization

* add prelu ut and reduce the input size to reduce memory usage

* fix pool dynamic plugin serialization and add ut

* refine pool ut with subtest

* add env for avoiding oom

* reduce test input size & increase pool op ut to 45s

* add the contributor

* remove copyright (will add in contributor)

* remove copyright (will add in contributor)

* add dropout npu op

* fix bugs

* add unittest

* fix bugs

* support 1-D input

* change ScatterAdd to EmbeddingDenseGrad in lookup_table NPU op

* EmbeddingDenseGrad only supports dim 32

* fix shape error

* softmax mask fuse upper triangle

* cover not implemented cpu code

* fix vector overflow

* refine code

* refine ut