* add new API/OP(csr->csr) of SparseTensor softmax

* fix comment

* gpups default config and dataset

* codestyle

* add unittest

* code style

* add dymf to gpups

* codestyle

* add static.nn.cvm import

* PSERVER_DEBUG

* add fs config to worker desc

* update unittest

* unittest

* remove gpups unittest

* remove gpups unittest

* static check

* fix to_sparse_csr

* Support optional residual add in fused_attention and fused_feedforward.

* Add checkpoint and add the check of add_residual when pre_layer_norm is false.

* Add TODO and change the python api to add add_residual argument.

* [MLU]: add shape kernel

* [MLU]: set output from cpu to mlu in shape kernel

fix en docs of paddle.vision.transforms.Normalize, paddle.vision.models.alexnet, paddle.vision.models.mobilenet, ops apis  (#42380)

* Normalize; test=document_fix

* alexnet; test=document_fix

* alexnet; test=document_fix

* vgg; test=document_fix

* mobilenetv2; test=document_fix

* mobilenetv1; test=document_fix

* alexnet; test=document_fix

* PSRoIPool; test=document_fix

* psroi_pool; test=document_fix

* roi_align; test=document_fix

* RoIAlign; test=document_fix

* alexnet; test=document_fix

* MobileNetV1; test=document_fix

* mobilenetv2;test=document_fix

* vgg; test=document_fix

* psroi_pool;test=document_fix

* ops; test=document_fix

* Normalize;test=document_fix

* normlize;test=document_fix

* Update alexnet.py

* for ci;test=document_fix

* for ci;test=document_fix
Co-authored-by: NLigoml <39876205+Ligoml@users.noreply.github.com>

* 2022-04-28

* 2022-05-04

* 2022-05-05_V1

* 2022-05-05_V1

* Update loss.py

* Update loss.py

* 2022-06-01_hook

* 2022-06-05

* 2022-06-07

* 2022-06-07_V2

* 2022-06-07_V2

* 2022-06-17_codestyle

* update api in creation and search.py

* Update creation.py

* Update search.py

* Update search.py

* for ci;test=document_fix

* for ci;test=document_fix
Co-authored-by: NLigoml <39876205+Ligoml@users.noreply.github.com>

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* fl-ps v1.0

* .

* support N + N mode

* .

* .

* .

* .

* delete print

* .

* .

* .

* .

* fix bug

* .

* .

* add `Returns`

* refine en doc

* refine parameter `pretrained`, test=document_fix

* Update recommended members of CI-OP-Benchmark, test=document_fix

* update, test=document_fix

* shuffle_channel

* shuffle

* shuffle

* shuffle

* add copy-from label for code examples, test=document_fix

* refine docs, test=document_fix

* add some output for code example, test=document_fix

* add `optional`, test=document_fix

* add missing parameters, test=document_fix

* add missing links for `ProgBarLogger` and `ModelCheckpoint`, test=document_fix

* update eval_batch example, test=document_fix

* fix typos in stack_outputs, test=document_fix

* np.random -> paddle.random, test=document_fix

* add bilinear_interp_v2 converter

* make device_id=current_id when not given

* use tracer to get current device id

* add activation layer

* Load models and run PE

* Stash all code

* Fix C++ UT and refine code

* Fix string length error

* skip windows ci because windows do not have wget

* Just print out in layer_test because bce param file changed

* Refine code

* Fix pdiparam download error for layer_test

* Polish FunctionSchema and rename some arg

* New Exector only once

* Add value type for ivalue

* Read params from one pdiparam file

* Replace ivalue using Variable

* Remove ivalue file

* Fix inner_exe new

* Using DeserializeFromStream to load tensor

* Split .cc files

* Polish cmakelist

* 'triplet_margin_loss'

* 'test_file_corret'

* '2022_03_27'

* 2022_04_05

* 2022-04-17_1

* 2022-04-17

* 2022-04-17_2

* 2022-04-25

* 2022-05-02_V1

* 2022-05-06_V1

* 2022-05-07_V1

* Update loss.py

* Update loss.py

* Update loss.py

* Update loss.py

* Update loss.py

* Update loss.py

* Update loss.py

* Update loss.py

* Update loss.py

* Update test_triplet_margin_loss.py

* Update loss.py

* 2022-06-01_pre-commit

* 2022-06-05

* 2022-06-06

* 2022-06-06

* code_style_check

* code_style_check

* Update loss.py

* 2022-06-07_V2

* Update loss.py

* Update loss.py

* [CustomKernel] add custom kernel c api

* update

* update

* fix unable to export capi
Co-authored-by: Nronny1996 <524019753@qq.com>