* remove function sequence_conv_pool

* fix test_glu.py

* remove function scaled_dot_product_attention

* remove function img_conv_group

* remove function simple_img_conv_pool

* delete the nets.py

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* Update test_image_classification.py

* Update test_recognize_digits.py

* Update test_recommender_system.py

* Update test_image_classification_fp16.py

* fix bug

* fix bug

* fix bug

* remove the nets.py in fluid

* fix bug

* fix the codestyle

* fix conflict

* fix bug

* Fix TODO

* add clone for inpalce

* fix name

* add inplace pow

* fix typro

* add note

* fix typro

* fix typro

* fix bug

* fix test error

* add type error test

* adjust indentation

* add gc for multi jobs

* fix job.h

* update OpInfo to OpInOutInfo

* update get_skip_gc_vars algo order

* demo1

* add test cases

* modify the usage of StepDecay

* refine

* replace PiecewiseDecay(LearningRateDecay) with PiecewiseDecay(LRScheduler)

* fix bug

* fix bug

* replace the StepDecay,MultiStepDecay,LambdaDecay with 2.0 version

* add pos_weight in kernel

* fix unittest

* fix xpu

* fix bce unittest, change infermeta order

* [ROCM] fix cupti, hipcub

* update

* update

* [kunlun] fix the dataloader problem in RDMA env

When running multi-machine training with Paddle DataLoader, an
unexpected segmentfault will be raised in DataLoader Process,
where the traceback goes all back to a runtime error that dataloader
workers exit unexpectedly. Similar problems have been discussed
that lead to a misbehavior of OpenCV working in multiprocessing
environment.
See
https://stackoverflow.com/questions/54013846/pytorch-dataloader-stucked-if-using-opencv-resize-method

* code style

* fix 'RuntimeError: context has already been set'

* Update dataloader_iter.py

spawn method raise error 'Can't pickle local object' in some situations

* code format check

* code style

* modify eular_beam

* modify matmul infermeta

* add test

* modify timeout

* base rule

* add sharidng merge

* add sharidng axis merge

* define unified data class for inferencing dist_attr

* test wrap DistTensorSpec in dygraph mode

* matmul main logic done

* define unified data class for inferencing dist_attr

---------
Co-authored-by: NYichen Zhang <zhangyichen03@baidu.com>

* remove the CosineDecay in fluid

* Update test_basic_api_transformation.py

* remove the NaturalExpDecay in fluid

* fix bug

* remove the ExponentialDecay in fluid

* remove the InverseTimeDecay in fluid

* remove the InverseTimeDecay class

* fix bug

* add fetch kernel

* support fetch var in new ir

* fix bug

* polish code

* change array equal to np.testing

* support feed in new ir

* fix bug

* try to hack combine op

* add scope guard

* revert atan2 op

* polish code

* [XPU] support xpu runtime profiler: follow up

* fix compile issue

* auto parallel support pipeline scheduler with standalone executor

* rm check_fetch

* update cmakelist and flags env

* rm set micro batch id

* rm import

* update utils func

* raise error when merge tensor for return_numpy is False

* fix _pipeline_opt

* fix unittest

* add auto tuner

* compare and record module

* revert launch main

* add prune rule

* add unit test

* add auto tuner

* revert launch main

* add prune rule

* modify unit test script

* fix bug for dump nodes; fix bug for checking log file

* fix bug

---------
Co-authored-by: Ncaozhou <caozhou@radi.ac.cn>

* no endpoints in dy mode

* fix fleet api inconsistent

* Run plan in standalone executor

* Update codes

* Update atol and rtol for py3-CI

* Add scope to cache key

* Fix CI errors

* Fix code style

* Update codes

* Remove fetch_name in standalone executor

* Fix UT

* Update codes

* Fix new IR bug

* fix lamb always_adapt

* fix optest

* fix all optests

* fix for log xxx

* add int32/int64 for cpu/gpu; add float16/bfloat16 for cpu forward

* fix docstring

* fix bug

* fix bugs

* fix bugs

* fix bugs

* fix bugs

* fix bug

* using cast

* fix test

* fix api

* fix other bugs

* fix ci bug for not using dygraph guard

* add bfloat16 test

* fix ut

* bf16

* exp/expm1 support int32/int64

* fix ut

* fix ut

* fix ut

* fix api rename

* support amp logic for some prim ops

---------
Co-authored-by: Nkangguangli <kangguangli@hotmail.com>

* add auto tuner

* fix prune

* fix sharding prune and mbs candidates

* fix cfg

* fix launch

* fix launch

* add unittest

* fix code style

* move batch_norm prim test to op_test

* fix optest bug

* add test to cmake

* add cinn test case

* fix batch_norm prim grad bf16

* fix code

* add cuda check

* fix batch_norm bfloat16

* fix cpu bfloat16 bug

* skip non-bfloat16-supported platform

* fix code

* fix cinn rtol and atol in bfloat16

* fix name

* fix config

* [Zero-Dim] paddle.nanmedian support 0D Tensor

* fix CI