* disable test_parallel_executor_profiler in cuda 10.1

* update set_tests_properties

* fix unittst unstable issue on ci machine

* fix unittst unstable issue on ci machine

* fix unittst unstable issue on ci machine

* add service, remove ut on mac

* fix heter_profiler & add heter stop method

* fix code style

* fix compile problem when cuda_arch < 6000

* refine code

* refine code

* support roi_align & affine_channel for kunlun

* minor

[Dy2Stat] 1. Fix bug of for-range stmts. 2. Support that step value is negative in for-range stmts (#29519)

1. Fix error in _build_cond_stmt of for-range stmts. 

2. Support that step value is negative in for-range stmts

3. Fix code because of the diff between Py2 and Py3

Fix 3 Windows Unittests

test_fuse_all_reduce_pass: Paddle cannot run multiple-GPU on Windows so set single visible GPU flag
test_feed_data_check_shape_type: Paddle cannot run multiple-GPU on Windows so set single visible GPU flag
test_tsm: Winodws GPU size is not enough so decrease batch size and data size.

* Fix a bug when running on an operating system without "bash."

* add execution condition

* for ci-coverage

* get cpu information to check the precision problem

* Update compilation environment for musl version

* update dependencies

* remove test code

check cpu info

remove test code

review

* update alpine and third_party denpendencies

* add newline for ci Code format

* Sharding add hybrid-dp feature

* update sharding in distributed_strategy

* update sharding unitest

* revise code format for sharding

* improve drop out

* add VectorizedRandomGeneratorWithGenerator

* fix bug

* modify according to comments

* Add the strategy of skipping cc/cu test compilation and execution in CI, test=develop

* fix if error with CI_SKIP_TEST, test=develop

* fix add properties to test error on Linux/MAC, test=develop

* fix set test properties of test_code_generator error, test=develop

* remove test codes and advance judgment of file modification on Linux, test=develop

* rename CI_SKIP_TEST to CI_SKIP_CPP_TEST, test=document_fix

* Add branch judgement on Linux, test=develop

* Add more value to calculate hash key

* fix size_t

* polish code

* 1.fix matmul bug 2. add one hot

* add xpu error msg

* add fast path for p == 0 in dropout

* add ut

* - Added infrastructre for new test

 - Added UT for Multiple models prediction

- cosmetic fixes

- lint

- lint fixes

* - Removed timeout for MMP test

* fix random seed in nll_loss unitest test=develop

* Fix bf16 activations test for softmax and gelu

* Resolve conflict

fix p_norm with empty shape (#29500)

* layernorm fw opt

* layernorm bw opt

* fix typo, test=develop

* remove const dim3 for windows CI compatibility

* merge develop
Co-authored-by: Nzlsh80826 <zlsh80826@gmail.com>

* Add ReserveSpace in dygraph batch_norm.

* Add unittest for reservespace

* Flags assert condition more general, print output if pattern not found

* removed test_flags_use_mkldnn form skip list regarding #29080 descr

* add ps table

Change-Id: I468a04bd071d21ff52654926fcf4d5f3da19e178

* remove tensor copy in the update_loss_scaling op

* not use thrust.

* fix some cuda memory access error.