* - Added infrastructre for new test

 - Added UT for Multiple models prediction

- cosmetic fixes

- lint

- lint fixes

* - Removed timeout for MMP test

* Fix bf16 activations test for softmax and gelu

* Resolve conflict

fix p_norm with empty shape (#29500)

* layernorm fw opt

* layernorm bw opt

* fix typo, test=develop

* remove const dim3 for windows CI compatibility

* merge develop
Co-authored-by: Nzlsh80826 <zlsh80826@gmail.com>

* Flags assert condition more general, print output if pattern not found

* removed test_flags_use_mkldnn form skip list regarding #29080 descr

* add ps table

Change-Id: I468a04bd071d21ff52654926fcf4d5f3da19e178

* remove tensor copy in the update_loss_scaling op

* not use thrust.

* fix some cuda memory access error.

* support deepcopy for Layer/Tensor/Paramerbase

* fix some code

As the title

* vec softmax fw

* vec softmax bw

* add a message argument for compiler compatibility

fix increamental coverage script bug, WITH_INCREMENTAL_COVERAGE to DWITH_INCREMENTAL_COVERAGE, test=develop (#29509)

* add tensor_indices in AssignGroupBySize

* add rebuild group in reducer

Add Sleep Time for CUDA Retry, which is similar to our GPU retry logic. This is a try to avoid init GPU allocation random failure in unit test.

* test ccache hit statistics, test=develop

* test ccache hit statistics, test=develop

* add cache hit statistics, test=develop

* fix no percent symbol erro on windows, test=develop

* remove switch, test=develop

This reverts commit befd6d53.

* added external reorder to profiler

* added external and internal reorders to profiler

* added internal and external reorder to profiler

* added formatting to int/ext reorder commit

* removed unnecessary comment

* change hard_swish from plugin to layer

* add ut when threshold != scale

Co-authored-by: Nroot <root@bjhw-sys-rpm0223.bjhw.baidu.com>

* update reduce_sum op on xpu

* update reduce_sum op on xpu

* support running on xpu

* fix tensorrt unittest precision error

* fix unittest precision error. test_trt_subgraph_pass && test_trt_dynamic_shape_transformer_prune

* Compiling operator libraries with Unity Build on Windows CPU.

* Compiling operator libraries with Unity Build on Windows GPU, no_test, test=windows_ci

* Add option in windows ci script, no_test, test=windows_ci

* Optimize parallel compiling, test=develop

* remove limit of parallel compile and skip some ops in UB, test=develop

* remove changes of header file, test=develop

* remove changes of header file, test=develop

* fix test_eye_op unittest failed, test=develop

* Compiling operator libraries with Unity Build on Linux, test=develop

* set default WITH_UNITY_BUILD=OFF, test=develop

* Move unity build rules into a single file and add comment, test=develop

* optimize parallel compilation, test=develop

* fix undefined reference error on coverage ci, test=develop

* enhance array_to_lod_tensor_op lod_tensor_to_array_op errors information. test=develop

* fix format. test=develop

* format fix. test=develop

* add lod_rank_table. test=develop

* fix format. test=develop

* fix doc info. test=develop

* fix np error

* add unbind dygraph api. test=develop

* fix unbind doc.test=develop

* add complex64 and complex128 type; add +-*/@ and slice opreator for complex types

* add test cases for complex elementwise, matmul and getitem unittest

* add test cases for complex types

* add test cases for complex matmul unittest

* kron, reshape, transpose support complex types

* sum and trace op support complex types

* add test case of sum and trace op

* fix the bug of imag part of complex not initialized

* format file

* format code style

* kron support type promotion; modify test cases

* fix expand && concat/transpose to new api

* update uniform_random_op

* update xpu_header