* [Dy2St]Remove PE logic in @to_static

* fix typo

* fix infer_program

* fix typo

* fix op_size

* add approve rules

* add attr

* Add matmul_v2 to the quantization process and adjust Ernie model test

* Correct cpu_quantize_pass test

* Move op to fuse transformation to placement pass

* Correct test

* fix py::array_t calling bug

* polish test_phi_tensor

* stop fix inference bug in this PR

* polish unittest

* change int->int32_t

* fix unittest

* fix compile error

* modify cmake

* remove redundancy codes

* fix selectedRow unittest

* fix cmake relay

* declare kernel

* [dy2static-bugfix] fix backward gradient aggregation bugs
1. Yolov3 and Yolov5 all face the same problem.

* remove set_device

* code review fix

* New onednn test

* checkopoint

* added new test, fixed issue with onednn bias

* fix bias check

* remove prints, refactor code

* delete old test

* update python tests cmake

* Delete depracated conv bias

* Delete outdated bias from convolution test

* add logspace yaml

* update by comments

* resolve test framework conflicct

Add PTQ and exporting function
1. Add Post-Training Quantization
1.1 Abstract some functions from QAT to Quantization class
1.2 Add Post-Training Quantization by extending Quantization class
1.3 Add observers for PTQ
1.4 Add unittest for PTQ
2. Add exporting function for QAT and PTQ

* support xpu multi-card infer

* add ut

* clean code

* clean code

* fix

* fix

* fix

* fix

* polish namespace

* change static_tensor_operants

* polish namespace

* support add, subtract, divide

* add unit test

* polish unittest

* fix cmake error

* polish unittest

* [XPU] update xccl to 1.0.8

* update xdnn. add uint8 for concat and split.

* update xdnn to 20230215.

* [XPU] add group_norm kernel

* update

* add xpu sin, cos, randint, linspace kernels

* update

* update

* move layer_norm_kernel.cu.h to phi

* fix bugs

* fix namespace

* fix bugs

* fix CI-Windwos

* replace mutable_data

* fix bugs

* fix bugs

* Use StandaloneExecutor in FleetExecutor

* Update FLAGS

* Fix CI errors

* Update code

* Add force_root_scope_vars config

* Update code

* Fix CI errors

* Fix test_layer_new errors

* move variable_utils from phi_api_utils to fluid

* fix coment

* update include

* fix bugs

* fix bugs

* fix bugs

* fix bugs

* fix bugs

* update

* update

* fix CI-Windows-OpenBLAS

* fix bugs

* fix bugs

* fix bugs

* update include

* move variable_utils to phi_utils

* fix namespace

* disable unewanted dygraph tests

* mine_hard_exa

* beta

* small commit

* add batch_norm composite rule

move composite test case

remove unuseful var

add composite op blacklist

* small change v2

* finish the test_composite_mean and test_composite_mean_grad

* add ops assertion to the tests

* add cinn test

* fix the error and inappropriate usage in func: mean_composite

* remove the ref of outer lib in primtives.py

* modify sample code of reduce_sum

* fix composite mean op map

* modify testcases to test more float type

* remove cpu float16 test

* cinn test fix

* remove reduce_max

* change the name sum to sum_x

* change the use of reduce_sum to sum

---------
Co-authored-by: Ncyber-pioneer <chenzhuo@tju.edu.cn>

* make cinn_launch_op run interpretercore in tracing mode to reduce number of threads

* skip getWorkqueue in tracing mode

* Done

* Deleted old python test, fixed new python test, changed names in parallel_UT

* Revert parallel UT changes

* Revert parallel UT changes v2

* Review fixes and simplification of conv output shape calculation, disabled sqrt from conv_act_duse_pass

* delete sqrt from possible activations from conv_concat_relu test

* review refactor

* merge main

* delete sqrt from list of compatible activations

* Test with no outdated inputs

* auto parallel align tool

* modify function get_var's return

* add save and load in align_tool

* modify load function and save function

* add finding different ops in align tool

* full auto parallel align tool

add test file for auto parallel align tool

set timeout for test

modify get_backward_tmp_var function

add annotation for align tool

modify test file

modify code to restart CI

remove timeout

* set timeout

* map output from composite rule to origin op

add mean layer_norm dropout op map

add input map check

composite softmax support input shape []

* composite softmax support shape []

* polish log

* solve conflict

* polish code

* polish op map output

* add check dtype

* move profiler

* add file

* fix mac compile bugs

* fix ci bugs

* fix mac bugs

* fix ci bugs

* fix compile bugs

* perfect code according comment

* make FusedMultiTransformer supports variable-lengths.

* modify ffn2 when cuda_version >= 11.6 because of #49392.

* code style

* delete remove_padding

* remove incubate.data_generator

* modify the setup.py

* modifyt the setup.py.in