* extract sub-graph

* graph-engine merging

* fix

* fix

* fix heter-ps config

* test performance

* test performance

* test performance

* test

* test

* update bfs

* change cmake

* test

* test gpu speed

* gpu_graph_engine optimization

* add ssd layer to graph_engine

* fix allocation

* fix syntax error

* fix syntax error

* fix pscore class

* fix

* recover test

* recover test

* fix spelling

* recover

* fix

* fix linking problem

* remove comment

* fix bug for MultiplicativeDecay

* remove changes to test_lr_scheduler.py

* [Eager]Fix full_like/clip with np.generic type as attribute

* support numpy genertic

* remove usless code

* update gpu fp16 op blacklist

* update blacklist

* fix pad3d infer shape

* add dist reshape impl_idx=2

* fix cmakelist

[Phi]Separate AddKernel/DivideKernel/SubtractKernel/MultiplyKernel from ElementwiseKernel（Part1） (#41806)

* seperate add/div/sub/mul from elementwise

* delete code

* fix compile bugs

* deal with conflict

* fix bugs when compile

* fix windows unit test bug

* fix ci converage bugs

* [Phi]Fix expand_sig infershape BUG under static graph mode

* [Phi]Fix expand_sig infershape BUG under static graph mode

* [Phi]Fix unittest

* [Phi]Fix unittest

* add rename for heter_ps.cu

* update. test=develop

* update. test=develop

* fix. test=develop

* fix utest

* fix time

* [Eager] paddle.sort interface use final_state

* Add eager test case for paddle.sort()

* [Eager]Fix NeedTransformPlace behavior if set skip_transform in yaml

* add unittest for full_like

* fix unittest

* add dist_pnorm op

* update cmakelist

* fix cmakelist

* fix cmakelist

* [Eager] Fix numpy interface for constructing empty tensor

* Fix CI, construct empty tensor

* Modify empty tensor's shape from [] to [0]

* Add more test for constructing empty tensor

* update

* add conv yaml

* add backward

* remove useless code

* fix bug

* fix bug

* revert fluid dygraph conv2d

* remove useless infermeta function

* fix meta fn deluplicat error

* conv using custom impl

* remove amp include

* fix bug

* use final op in maskrcnn and hrnet

* refine
Co-authored-by: Nphlrain <phliuhongyu@126.com>

* create tensor by empty in custom op

* fix some bug

* add dist slice

* fix debug

* fix cmakelist

* [Auto Parallel] Add links for the reference codes.

* Update recorder.py

* Update trial.py

* Update test=document_fix

* Update test=document_fix

* shrink downstream map

* shrink last live ops of var

* add comment

* fix bug

* adapot dist op

* [Auto Parallel] Support the auto completion of while_op

* add dist_fill_constant_batch_size_like

* align infer  accuracy