* [NPU] add run_program_op_npu

* add run_program_op_npu ut

* optimizer conv alog speed

* code polish

* remove useless code

* fix compile error

* fix cpu compile error

* not use cudnn alog t

* add search cache max number

* polish code

* fix cache test bug

* add groups data format to conv args

* fix cache test bug

* fix cudnn_deterministic bug

* fix test switch auto tune bug

* fix test swith autotune bug;

* fix conv cache bug

* fix cache test error

* fix cache test bug

* fix windows mac compile error

* fix workspace search error

* update cudnn cache

* fix cache test bug; test=develop

* fix autotune swith test error

* polish code

* oplish code

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* fl-ps v1.0

* .

* support N + N mode

* .

* .

* .

* .

* delete print

* .

* .

* .

* .

* fix bug

* .

* .

* fl-ps with coordinator ready

* merge dev

* update message parse only

* update fl client scheduler

* fix bug

* update multithreads sync

* fix ci errors

* update role_maker.py

* update role_maker.py

* fix ci error: windows py import error

* fix ci error: windows py import error

* fix windows ci pylib import error

* add dump fields & params

* try to fix windows import fleet error

* fix ps FLAGS error

* fix logging risk

* fix logging possible risk

* write trainer_desc file

* support split sparse params in local & remote

* fix import paddle.fluid.core.PSGPU

* fix import paddle.fluid.core.PSGPU

* add remote_sparse & local_sparse config

* fix unittest

* fix test_dist_fleet_geo table error

* fix PADDLE_ENFORCE error

* fix other's pr conflict

* forbidden ssd table

* .

* recover ssd table code

* recover file mode

* support high order differential with data parallel overlap

* update unitest

* add python final state

* fix bug

* fix bugs

* fix bug

* fix bug

* revert impl, final state mul not support selected rows

* fix softmax use cudnn error

* add softlable false unitest

* revert loss.py

* fix utest

* fix utest

* fix utest

* fix log

* fix random utest

* [DOC FIX]fix code demo of auc

* [doc fix] fix doc of auc

* add legacy_api.yaml

* set merged_momentum inplace only

* support inplace optional<vector<tensor>>

* add dygraph_mode api

* optimize TensorToConstDenseTensorPtr

* support beam_search operator on xpu. test=kunlun

* support beam_search operator on xpu. test=kunlun

* support beam_search operator on xpu. test=kunlun

* support beam_search operator on xpu. test=kunlun

* support beam_search operator on xpu. test=kunlun

* support fp16 of adam operator in xpu environment. test=kunlun

* support fp16 of adam operator in xpu environment. test=kunlun

* support fp16 of adam operator in xpu environment. test=kunlun

* support selected_rows kernel for multiply in dygraph

* refine the trace python api

* fix check input

* fix check input

* fix check input

* Adapt minlength attr for bincount

* fixed1

* fix 2

* fixre

* test complext var

* delete logic no needed

* fix to_tensor_static

* code style

* del

* while support for python container.
It is convenient to convert more dynamic graph codes into static graphs.

* cond support python container

* add quant pass

* update the document for the api multiply

* update the document for the api multiply; test=document_fix

* update the document for the api multiply; test=document_fix

* update the document for the api multiply; test=document_fix

* note;test=document_fix
Co-authored-by: NLigoml <39876205+Ligoml@users.noreply.github.com>

* update loss.py in nn.functional and nn.layer module

* update nn.Pad1D and 2D,3D class in common.py

* add code copy from function anchor for cn docs code alignemnt

* update pad class in common.py

* update common.py in functional and layer model

* fix format issue

* update format issue

* update pad;test=document_fix

* update NLLLoss;test=document_fix
Co-authored-by: NLigoml <39876205+Ligoml@users.noreply.github.com>

* bugfix

* remove scaling

* support rescale_grad opt

* add unitest

* new executor support program._graph

* fix program._program if program is Program()

* move distribute_fpn_proposals

* fix some code

* fix yaml bugs

* add set dtype

* move proposal_impl to funcs

* fix compile bugs

* [CustomDevice] add profiler apis

* migrate CalculateEstOccupancy into cuda_tracer

* update

* add ut

* Add int8 support for matmul+elementwiae_add fuse

* Corrections after review and ernie test fix

* merge conv_concat_relu to conv_act

* fix typo

* extend unit test

* reuse existing gpd

* codestyle

* enforce mkldnn conv

some python c api use final state