* add fc, multihead_mul, shape tensor infer, slice

因此将N次前向共用一个 vec scope 换为了N次前向分别使用自己的一个vecscope

* test=gpups

* Fix some bugs about the usage of cinn lib.

* Fix some unit test errors.

* refine layer to

* refine code

* add ut

* consolidate conv act passes

* generalize conv_activation

* integrate conv+act tests

* code style format

* whitespaces

* remove timeout from old tests

* implement comments from review

* restore ut

* whitespace

* code style

* transpose

* fixes after review

* method for gettin act

* Change Paddle_enforce error type

* code format

* add missing opcompats

* [MLU] add mlu kernel for elementwise_max_grad

* [MLU] modify mlu kernel elementwise_min_grad impl

* add argmin and argsort ops (#800)

* add argmin and arsort ops

* Add dot bmm ops (#803)

* add bmm

* add dot op

* clean CreateConst

* clean CreateCast

* add activation ops (#808)

* add activation ops

* fix 1function-redefined error

* fix for layer_norm

* minor fix

* add new API/OP(csr->csr) of SparseTensor softmax

* fix comment

* gpups default config and dataset

* codestyle

* add unittest

* code style

* add dymf to gpups

* codestyle

* add static.nn.cvm import

* PSERVER_DEBUG

* add fs config to worker desc

* update unittest

* unittest

* remove gpups unittest

* remove gpups unittest

* static check

* fix to_sparse_csr

* Support optional residual add in fused_attention and fused_feedforward.

* Add checkpoint and add the check of add_residual when pre_layer_norm is false.

* Add TODO and change the python api to add add_residual argument.

* [MLU]: add shape kernel

* [MLU]: set output from cpu to mlu in shape kernel

fix en docs of paddle.vision.transforms.Normalize, paddle.vision.models.alexnet, paddle.vision.models.mobilenet, ops apis  (#42380)

* Normalize; test=document_fix

* alexnet; test=document_fix

* alexnet; test=document_fix

* vgg; test=document_fix

* mobilenetv2; test=document_fix

* mobilenetv1; test=document_fix

* alexnet; test=document_fix

* PSRoIPool; test=document_fix

* psroi_pool; test=document_fix

* roi_align; test=document_fix

* RoIAlign; test=document_fix

* alexnet; test=document_fix

* MobileNetV1; test=document_fix

* mobilenetv2;test=document_fix

* vgg; test=document_fix

* psroi_pool;test=document_fix

* ops; test=document_fix

* Normalize;test=document_fix

* normlize;test=document_fix

* Update alexnet.py

* for ci;test=document_fix

* for ci;test=document_fix
Co-authored-by: NLigoml <39876205+Ligoml@users.noreply.github.com>

* 2022-04-28

* 2022-05-04

* 2022-05-05_V1

* 2022-05-05_V1

* Update loss.py

* Update loss.py

* 2022-06-01_hook

* 2022-06-05

* 2022-06-07

* 2022-06-07_V2

* 2022-06-07_V2

* 2022-06-17_codestyle

* update api in creation and search.py

* Update creation.py

* Update search.py

* Update search.py

* for ci;test=document_fix

* for ci;test=document_fix
Co-authored-by: NLigoml <39876205+Ligoml@users.noreply.github.com>

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* fl-ps v1.0

* .

* support N + N mode

* .

* .

* .

* .

* delete print

* .

* .

* .

* .

* fix bug

* .

* .