* init

* remove softmaxop

* merge dev

* correct dir

* style

* Convert split, pad and pad3d kernels

* Convert slice+grad oneDNN fluid kernels to PHI

* change out->mutable_data to dev_ctx.Alloc

* First approach

* Shape kernel corrected

* Compilation error fixed

* Resize corrected

* Registered types added

* Mistake corrected & types added

* sum kernel deleted

* update for py3.6.

* update for py_3.6

* Support matmul_v2 in PaddleTensorRT

* [Paddle Inference]support n lookup_tables fuse to embeddinglayernorm(2)

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* fl-ps v1.0

* .

* support N + N mode

* .

* .

* .

* .

* delete print

* .

* .

* .

* .

* fix bug

* .

* .

* fl-ps with coordinator ready

* merge dev

* update message parse only

* update fl client scheduler

* fix bug

* update multithreads sync

* fix ci errors

* update role_maker.py

* update role_maker.py

* fix ci error: windows py import error

* fix ci error: windows py import error

* fix windows ci pylib import error

* add dump fields & params

* try to fix windows import fleet error

* fix ps FLAGS error

* fix logging risk

* fix logging possible risk

* write trainer_desc file

* support split sparse params in local & remote

* fix import paddle.fluid.core.PSGPU

* fix import paddle.fluid.core.PSGPU

* add remote_sparse & local_sparse config

* fix unittest

* fix test_dist_fleet_geo table error

* fix PADDLE_ENFORCE error

* fix other's pr conflict

* forbidden ssd table

* .

* recover ssd table code

* recover file mode

* debug auc 0.5

* adapt for nn fl-ps

* adapt for nn fl-ps

* add learning_rate_0 intializer op

* recover ssd table

* modify file mode

* flps del fake-init op

* Move ITensor construction for Weight (persistable variable) from OpConvert to TensorRTEngine.

* move_merge_selected_rows

* update code

* [JitLayer]Erase out vars to avoid data rewrittinig

* Fix code comments

* remove no need grad allreduce communication when sharding-dp

* remove no need grad allreduce communication when sharding-dp

* bugfix

* bugfix

* bugfix

* [NPU] fix run_program_op, test=develop

* [NPU] fix matmul_v2 in cann502, test=develop

* fix linspace error in amp

* fix log

* fix amp error

* Revert "Simplify size op impl (#45808)"

This reverts commit c252b1de.

* fix_seg

* fix detection
Co-authored-by: NChen Weihang <sunny_cwh@163.com>

* add amp yaml

* fix ci bugs

* add config

* add config

* follow comments

* fix serial run

* fix linspace error in amp

* fix log

* fix amp error

* fix ocr error which caused by amp

* add more check

* rename dtype ns

* polish code comments

* polish data_device_transform.cc

* fix preln_residual_bias_fuse_pass bug in TNT_small model 

* python support pass external stream

* fix compile error