* polish namespace

* change static_tensor_operants

* polish namespace

* support add, subtract, divide

* add unit test

* polish unittest

* fix cmake error

* solve conflicts, merge auto code-gen

* add scalar operator in tensor.h

* tensorbase

* static prim full support more datatype

* fix prim unittest

* polish codes

* fix cmake error

* [Cpp Extension] Support optional type

* fix custom_extension.cc

* tmp gather vjp

* support gather

* remove useless code

* fix compiling error

* fix ut

* add eager test

* add eager test

* add seed

* fix cpu error

* fix transpose op compat

* remove tensor index case

* fix prim_cinn

* fix ut

* add gather composite

* kunlun support c_softmax_with_cross_entropy

* fix grad calc error

* replace mutable_data() and ShareDataWith()

* update xdnn

* update xpu toolchain to 20230215

* remove fluid from test file

* map output from composite rule to origin op

add mean layer_norm dropout op map

add input map check

composite softmax support input shape []

* polish log

* [prim] add dropout composite rule

---------
Co-authored-by: Ncyber-pioneer <chenzhuo@tju.edu.cn>

* [Cpp Extension] return Py_None if Tensor not initialized

* fix jit test

* remove with_data_parallel in unittest

* fix CI

* remove comment

* trigger CI

* revert part changes

* test_build_strategy_fusion_group_pass

* add enable_grad, reafctor no_grad, set_grad_enabled

* fix bug

* fix bug

* format

* fix bug

* format

* format

* fix doc

* fix

* fix

* fix bug

* fix comment

* Fix some typos.
Signed-off-by: Yulv-git <yulvchi@qq.com>

* pre-commit
Signed-off-by: Yulv-git <yulvchi@qq.com>

---------
Signed-off-by: Yulv-git <yulvchi@qq.com>

* tmp gather vjp

* support gather

* remove useless code

* fix compiling error

* fix ut

* add eager test

* add eager test

* add seed

* fix cpu error

* fix transpose op compat

* remove tensor index case

* fix prim_cinn

* fix ut

* support prim test in OpTest

* fix cmake

* fix op test

* fix test_input_spec

* disable cinn in reduce_sum unit test

* add bfloat16 dtype for sum

* polish code

* add clear jit program function

* convert grad out from tensor to numpy

* remove unnecessary code

* add only_prim flag

* fix flag

* fix op test

* fix optest comp inplace error

* fix op test

* fix op test with guard

* add initialization of check_comp flag

* fix comp inplace error in op test

* rename check_comp with check_prim and add bfloat16 dtype convert

* rename comp_op_type to prim_op_type

* rename comp to prim

* remove useless code

* skip ci check for only prim

* add no_grad_vars and grad_outputs in prim test

* fix var_dict

* fix op test for only_prim

* fix dy2static bugs

* polish some code

* testcase init commit

* skip sign conflict

* fix year

* process unit test matched test_p*

* fix ci bug

* fix ci bugs

* fix codestyle

* remove all tests about pe and restore some irrelated tests

* delete test_parallel_executor_test_while_train.py

* assert len(self.places) == 1

* remove with_data_parallel in unittest

* remove multi-card related checks

* remove with_data_parallel in test_multiprocess_dataloader*

* fix error hint

* fix typo

* fix composite mean op map

* fix composite check output

* init layer_norm

* init layer_norm

* map output from composite rule to origin op

* add dropout op map

* add input map check

* polish log

* modify rules

* success test_forward

* modify test without cinn

* modify cinn test

* modify cinn test

* except fp64

* except fp64

* delete flatten

* delete unused change

* review

* pass cpu test

* code style

* delete flatten fp16 error

* modify flatten test

---------
Co-authored-by: Ncyber-pioneer <chenzhuo@tju.edu.cn>

* Check -1 shape for input_spec and program when prim or cinn enabled

* Polish neg shape check

* Polish code

* Fix UT

* Fix UT in static

* [RM FLUID] trainer_pass&heter_trainer_pass
* [RM FLUID] rm distributed_strategy

* [dy2static] support fallback for whole graph. (stage 1)

* bug fix

* bug fix and add a new unittest

* fix code by code review

* fix coverage

* [dy2static] ParameterRecorder Part 2

* Parameter Recorder - 2 bug fix

* bugfix: fix the dygraph go into _jst.ld() errors.

* fix ci error.

* fix ci error

* update include directory

* fully support C++ extension, pass unittest

* fix include directory

* support both extension and operator in one file

* polish testcase

* add jit unittest

* update third_party.cmake, pass CI test

* fix cmake

* fix setup

* fix inference, fix unittest precision

* fix unittest precision

* fix inference_lib cmake

* try fix setup, try fix inference_lib

* try fix inference_lib pybind

* fix mix_op_extension, fix inference_lib

* fix mix_op_extension, fix inference_lib

* change cmake

* change cmake

* add compile flags

* add Python.h headerfile

* add test_custom_plugin_creater cmake

* comment compile flag

* pass all CI

* pass all CI

* comment compile flag

* try solve test_custom_plugin_creater link error

* try solve test_custom_plugin_creater link error

* polish codes

* remove windows compile flag

* remove python_include_path

* update pybind11, 2.4.3->2.6.0

* update pybind11, 2.6.0->2.10.0

* update pybind11, 2.10.0->2.6.0b1

* update pybind11, 2.6.0b1->2.6.0, start fix unittest

* fix pybind11 2.6.0 VarBase print error

* fix pybind11 2.6.0 VarBase print error

* handle PADDLE_ON_INFERENCE

* modify according to reviewer

* fix cmake

* cmake decouple pybind_util when not ON_INFER

* cmake decouple pybind_util when not ON_INFER

* remove copy of inference_lib.cmake

* change pybind.cc headerfile fluid->phi

* check win

* fix random error

* fix manage

* change error

* fix

* Add unittest for zero-dim kron.

* Fix zero dim kron.

* rename multi_tensor_adam to fused_adam

* fix some bugs

* fix CI coverage

* rename test_fused_adam.py

* fix some bug

* add test_fused_adam_op.py

* fix some bugs

* fix fused_adam_op.cc

* fix CI bugs

* fix CI bug

* fix CI bug