* add new api (set_global_initializer/reset_global_initializer),test=develop

* add new api (set_global_initializer/reset_global_initializer),test=develop

* fix doc and example code of set_global_initializer,test=develop

* add for iter var list, test=develop

* add enumerate unittest, test=develop

* Start implementing int8 eltwise add

test=develop

* - Fix to Michal PR

* - Fix

test=develop

* - Lint fixes

test=develop

* - Added checking if elementwise_mul can be used

test=develop

* - Added attribs to skip_attrs_set

test=develop

* - Improved broadcasting

test=develop

- fixes to compilation

- fix

- fix

- Lint fixes

test=develop

* - removed redundant condition

test=develop
Co-authored-by: NMichal Gallus <michal.gallus@intel.com>

test=develop

* add relu for lenet, test=develop

* fix test model, test=develop

* The arg of append() can be not Tensor temporarily.

* Add Seq2Seq as ProgramTranslator Unit Test. 

* set dtype of vocab_size_tensor to int64 to pass Windows-CI. 

* fix bug of prelu when rank not equal 4, test=develop

* fix prelu inference, test=develop

* fix api, test=develop

* fix shape when mode is chennel, test=develop

* remove debug code, test=develop

* add unittest, test=develop

* blockReduce opt

* launch threads align to warpSize

* reduce unnecessary shared memory for broadcast reduced value

* vectorize SoftmaxKernelWithEltadd

* add fp16 constrain

* test=develop

As the title

* Add a StatValue class in the backend to represent a stat.
* Add a singleton StatRegistry to maintain the collection of stats.
* For the sake of code neatness, we only support type of int and float, which can cover most of the scenarios.

Some big models can timeout on Windows CPU machine. I added some timeout properties.

This commit fixs the compiling bug regarding unique_ptr of IOptimizationProfile.

IOptimizationProfile has protected dtor and is controlled by TensorRT
internally. Application shouldn't delete the pointer of IOptimizationProfile.
See TensorRT document: https://docs.nvidia.com/deeplearning/sdk/tensorrt-api/c_api/classnvinfer1_1_1_i_builder.html#a9ac47e100454151d8206ac91d543299a
test=develop

* parallel move shared data test=develop

* test=develop

* update readme of 1.8.2;test=document_fix

* test=develop;test=document_fix

* test=develop;test=document_fix

Add TSM as ProgramTranslator Unit Test. The TSM code is referred from PaddlePaddle/models#4229

* test=develop

* test=develop

* fix bug

* test=develop

* test=develop

* add MobileNet unittest test=develop

* fix cudnn random test=develop

* fix sync barrier with barrier monitor, test=develop

* add summary_env, test=develop

* update issue template, test=develop

* refine link, test=develop
Co-authored-by: Nroot <root@yq01-gpu-255-129-15-00.epc.baidu.com>

* enable load_program_state run in imperative mode; test=develop

* remove useless code; test=develop

[Dy2Static]Convert var.shape stmt and Convert the return variables of Tensor-dependent 'if' staments to Tensor if it not  (#24911)

* Support int and long: int or long -> six.integer_types. 

* Modify test_tensor_shape: fix bug and modify comment. 

* Support convert_var_shape to convert var.shape stmt

* Modify code in ifelse_simple_func.py because don't support return non-Tensor in Tensor-dependent 'if' stament currently. 

* Convert the return variables of Tensor-dependent 'if' staments to Tensor if it not. test=develop

* use allow list instead of white list, test=develop

* reduce include, test=develop

Support CMatchAucCalculator based on CMatchRankAucCalculator with a new parameter ignore_rank

[Dy2stat] decrease the batch size to decrease GPU usage.

* windows publish package scripts,test=develop

* windows publish package scripts,test=develop

* windows publish package scripts,test=develop

fix bug in CUDA_NVCC_FALS and CMAKE_CUDA_FLAGS