* add patterns

* update rule based tuner

* add forward sub program completion

* add unittest

* add bwd sub program completion

* [CustomOP Optional] CustomOP supports optional Tensor

* fix test_custom_concat, add pytest to CMakeLists

* remove super call with parameters

* fix bug

* migrate fill_constant to paddle.tensor

* move fill_constant to paddle.tensor and repalce the reference

* add missing fill_constant replacement

* fix typro

* remove unused import fill_constant

* fix zeros import error

* fix circle import

* fix layers.zeros

* fix unitest

* fix unitests

* fix unitest

* use paddle.full replace fill_constant in samplecode

* fix sample code

* recovery xpu test

* recovery xpu test

* fix circle import

* fix utils import error

* fix utils error

* fix circle import

* redo

* fix circle import

* fix prim fill constant import

* fix type error

* fix increase error

* fix test error

* fix fill_constant

* [Custom Op] Support extra_library_paths of load

* change API order

* change unittest parameter order

* [Custom Op] Add Python.h include dir path automatically

* add debug info

* fix expand str error

* fix install_check failure when multi cpu but no gloo

* fix: raise error when multi-card check fails

* move fluid.utils to paddle.utils.layers_utils

* fix error

* delete original fluid layers utils

* remove import and old utils

* remove more old utils import

* change import path of fill_constant in the layers_utils.py

* fix mistake

* fix error

* expose in __init__.py

* for comment

* when change the ref of func is_sequence, it should change to the root of is_sequence instead

* for codecheck

* modify install check: static graph parallel training to dynamic graph prallel training

* remove test code

* fix cyclic import

* fix typo

* update include directory

* fully support C++ extension, pass unittest

* fix include directory

* support both extension and operator in one file

* polish testcase

* add jit unittest

* update third_party.cmake, pass CI test

* fix cmake

* fix setup

* fix inference, fix unittest precision

* fix unittest precision

* fix inference_lib cmake

* try fix setup, try fix inference_lib

* try fix inference_lib pybind

* fix mix_op_extension, fix inference_lib

* fix mix_op_extension, fix inference_lib

* change cmake

* change cmake

* add compile flags

* add Python.h headerfile

* add test_custom_plugin_creater cmake

* comment compile flag

* pass all CI

* pass all CI

* comment compile flag

* try solve test_custom_plugin_creater link error

* try solve test_custom_plugin_creater link error

* polish codes

* remove windows compile flag

* remove python_include_path

* update pybind11, 2.4.3->2.6.0

* update pybind11, 2.6.0->2.10.0

* update pybind11, 2.10.0->2.6.0b1

* update pybind11, 2.6.0b1->2.6.0, start fix unittest

* fix pybind11 2.6.0 VarBase print error

* fix pybind11 2.6.0 VarBase print error

* handle PADDLE_ON_INFERENCE

* modify according to reviewer

* fix cmake

* cmake decouple pybind_util when not ON_INFER

* cmake decouple pybind_util when not ON_INFER

* remove copy of inference_lib.cmake

* change pybind.cc headerfile fluid->phi

* remove dygraph.parallel.ParallelEnv

* logger.py error: AttributeError: module 'paddle' has no attribute 'distributed'

* move the implenmentation to the root folder

* logger.py import ParallelEnv from paddle.parallel to avoid circular import

* add the comment of why import ParallelEnv from paddle.parallel in logger.py and remove the api interface in the paddle/parallel.py

* outdated Env and note removed

* decouple the logger.py and ParallelEnv

* remove another ref of parallel in init.py

* [Auto Parallel] Remove some fluid APIs

* [Auto Parallel] Fix the wrong import

* [Auto Parallel] Remove unnecessary comments

* [Auto Parallel] Fix the importing bug

* add pool flops

* add annotations and tests

* relu flops all

* add annotations and tests

* revision for codestyle

* 1219

* temporarily change the num_diff_files limit, test=document_fix

* Revert "temporarily change the num_diff_files limit, test=document_fix"

This reverts commit 8e70f00ef468d2dad0e38b3da06295ed62990d20.

* for codestyle

* remove duplicate license

* `static mode` -> `static graph mode`

* Update hybrid_parallel_inference.py

* Update layer_function_generator.py

* Update manipulation.py

* reset
Co-authored-by: NLigoml <39876205+Ligoml@users.noreply.github.com>
Co-authored-by: NSigureMo <sigure.qaq@gmail.com>

* rm legacy layers part6

* rm non_static_mode

* modify non_static

* minor change

* rm loss

* rm in_legacy part8

* minor change

* 修改了API文档的相关内容

对weight_norm进行修改

* Update python/paddle/profiler/utils.py

* Update python/paddle/utils/cpp_extension/cpp_extension.py

* Update python/paddle/device/__init__.py

* Update python/paddle/device/__init__.py

* test=document_fix

* for Hyperlink; test=document_fix

* Update dlpack.py

* test=document_fix
Co-authored-by: NLigoml <39876205+Ligoml@users.noreply.github.com>

* [CodeStyle][isort][F401] fix some regression issues

* add import paddle to fix eval call

[Fluid Clean]move inplace_apis_indygraph_only from paddle.flud.dygraph.inplace_utils to paddle.utils (#48744)

* move inplace_apis_indygraph_only from paddle.flud.dygraph.inplace_utils to paddle.utils

* modify conflict

* modify conflict

* modify conflict

* modify conflict

* modify conflict

* modify conflict

* modify conflict

* modify static-check ci error

* fix conflict

* modify failed tests

* fix conflict

* fix conflict

* fix pool2d examples

* modify conflict

* fix failed tests

* fix conflict

* fix failed tests

* modfiy problem of deleting pool2d

* add flops for layer

* hide api

* add unitest

* fix typo error

* pass CI-coverage

* c_embedding

* add annotations

* add annotations

* revision

* revise attrs

* isort all files

* revert conflicting files

* revert conflicting files

* revert conflicting files

* add matmul_flops

* add dropout,layer_norm ...

* add dropout,layer_norm ...

* add elementwise_flops

* add dict check

* add unitests

* add equation for flops computation

* regularized annotations

* attr ready

* op ip ready

* start dynamic

* end2end ok

* input shape to map, stat by op

* layer wip

* first version ready

* fix proto depds

* fix profiler deps

* fix flops typo, rm tuple shape

* fix flake8 CodeStyle E266

* fix comments

* [CodeStyle][py2][U004] unecessary explicit `object` inheritance in class definition

* fix an increment

* [CodeStyle][py2][U008] remove unnecessary args in `super()`

* remove remained args

* revert changes in test_pylayer_op

* Revert "revert changes in test_pylayer_op"

This reverts commit ff185a9ae738afac3b0264f61bde6c6b7f72e7c4.

* revert some changes in example code

* update config

* re-blacken python code

* temporarily disable date and diff_py_file

* skip a format

[CodeStyle][F401] remove unused imports in python_paddle/nn_tensor_reader_tests_distributed_distribution_dataset_utils. (#46721)