* [Cherry-pick][Core] Add the graph optimization of subblocks for transformer model (#3947)
test=develop
* [Core][ARM] Fix beam_search, eltwise_mul supports broadcast and int64_t data type, add print op and kernel, add exeception
test=develop

* Fix the dims of parent idx of the arm kernel of beam_search op

* elementwise_mul supports int64_t data type with broadcasting

* Add print op and kernel for debugging

* Support throwing the exception when the internal error occurs

* Refine while and conditional_block op kernel

* Support the graph optimization on subblocks

* Pass program_desc and block_idx into the kernel of the control flow ops(while/conditional_block/subgraph), and create the RuntimeProgram online, it make it possiable to call the control flow ops recursively

*Add unit test for masked transformer model

* [NPU] enhance cache offline model, test=develop

* [arm]add 2x2s2p1 pooling  (#3705)

* fix pooling bug and speed

* add 2x2s2p1 pooling. test=develop

* fix conflict, test=develop

* fix conflict in wino

* [arm] add 3x3s1 Winograd int8 (#3767)

* fix: winograd support unsame pad
test=develop

* feat: add winograd int8 kernel
test=develop

* fix: style fix
test=develo

* fix winograd_int8 ut sgement default. test=develop

* close basic_test, test=develop
Co-authored-by: NMyPandaShaoxiang <txg4794@163.com>

* fix xiaodu crash in gemm prepacked

* in huwen phone, 3x3s2p0 avg pooling will rand crash, other phone does not have this feature

* [arm] update con int8 kernel choose (#3834)

* fix conv int8 kernel choose and sooftmax compute bug

* change axis_size = 4 kernel choose, test=develop

* fix format. test=develop

* fix format.test=develop

* fix build test=develop

* fix buiild error test=develop

* fix wino_int8 computte erroor. test=develop

* Update the link to debug, test=develop, test=document_fix (#3870) (#3871)
Co-authored-by: NMyPandaShaoxiang <txg4794@163.com>
Co-authored-by: Ncc <52520497+juncaipeng@users.noreply.github.com>

fix the demo of opt saved can't work on windows

 fix the doc

[Cherry-pick] [Compile] [fluid-lite-subgraph] Fix fluid-lite compile error, because of not defined LITE_WITH_LOG (#3611)

1. fix clang android log warning.
2. remove an unused event.

fix cv v8 build error, test=develop

* fxi ff, test=develop

* delete bgr_flip, test=develop

* fix memory leaky, test=develop

*fix yuv resize bug, test=develop

* fix format, test=develop

* fix build error, test=develop

* fix resize, test=develop

* move anakin rst, test=develop

* fix conv 2-pad to 4-pad

* fix compute conv shape

* fix pad, test=develop

* change conv_depthwise_3x3s1_fp.cc name to conv3x3s1p01_depthwise_fp32.cc to distinguish between conv3x3s1_depthwise_fp32.cc

* delete printf note in conv3x3s1, test=develop

* delete printf note, test=develop

* delete gem_sdot.h, test=develop

it is coped from __gemm_sdot_meta_.h

* update compute padding, test=develop

* fix padding size, must be 2 or 4. test=develop

* fix format in operators/conv_op.cc, test=develop

* change #if 0 to #if 1, test=develop

* put 2-pad to 4-pad in AttachImpl, test=develop

* fix clang-format error inn tests/math/connv_compute_test, test=develop

* fix x86 test result error, test=develop

* add asymmetric padding test case in liite/tests/math/conv_compute.cc, test=develop

* change paddings type to support dynamically modify, test=develop

* fix x86 build error in connv_compute_test, test=develop

* fix opencl build error, test=develop

* fix oopencl build error, test=develop

* fix  opencl/conv_compute build error, test=develop

* fix  opencl/conv_compute build error, test=develop

* fix format in kernels/opencl/conv_computte_ttest,test=develop

* fix build error, test=develop

fix build error in kernels/x86/conv_compute.h

* fix ccompute shape error in ooperators/conv_op.h, test=develop

* add opencl concat kernell

* fix

* fix

* add model input test

* fix build error

* fix builld error

* add ut in opencl

* add ut

* fix kernel name

* fix kernel namedd

* fix ut

* add concat ut, test=develop

* fix axis compute, test=develop

* add other axis, test=develop

* fix ut. test=develop

* fix format

* delete extra files, test=develop

* fix origin, test=develop

* fix format. test=develop

* fix format2 test=develop

* add leakyrelu and tanh compute

* add init val

* fix leakyrelu and tanh compute error, test=develop

* fix leakyrelu and tanh compute error, test=develop

* delete extra file, test=develop

* delete file

* fix format

* delete extra file, test=develop

* fix format， test=develop

* fix format. test=develop

* add grid sampler

* reset act

* fix conflict and readme, test=develop

* fix ios run error, test=develop

* fix ios run error

* fix ios v8 run error

* fix grid_sampler compute error. test=develop

* fix exp act run error, test=develop

* fix format, test=develop

* fix format， test=develop

* fix redefine error

* fix format, test=develop

* add bilinear interp

* fix formart

* fix build error

* fix pad2d error

* fix format

* fixr

* fix

* fix format. test=develop

* fix format, test=develop

* fix resize error

* fix format. test=develop

* fix format, test=develop

* fix format

* note log(4) << x_image. test=develop

* note x_image printf. test=develop

* fix v7 clang bug. test=develop

* fix format, test=develop

* fix .a build bug, test=develop

* fix resize bug

* fix resize bug

* test=develop

* add cvv ut

* fix clang v7 error

* fix cv errorr, test=develop

* fix conv test bug, test=develop

* fix ut

* fix ut , test=develop

* fix format, test=develop

* change ut, test=develop

* change ut, test=develop

* fix conv ut, test=develop

* fix format, test=develop

* fix resie bug

* fix format, test=develop

* fix compute error

* fix format, test=develop

* fix format, test=develop

* fix memory bug, test=develop

* fix format. test=develop

* improve conv_dw profile with rel relu6 leakyrelu, test=develop

* add depthwise, test=develop

* fix ci error, test=develop

* fix cv demo print, test=develop

* test=develop

* fix build error, test=develop

* fix resie bug

* fix format, test=develop

* fix memory bug, test=develop

* fix format. test=develop

* fix clang v7 error
* change ut, test=develop
* fix conv ut, test=develop

* set arm_lang default is off. test=develop

* fix resize error, test-develop

* add lrn op

* fix v7 build error, test=develop

* fix

* fix format. test=develop

* fix format, test=develop

* fix resize error

* fix format. test=develop

* fix format, test=develop

* fix format

* note log(4) << x_image. test=develop

* note x_image printf. test=develop

* add grid sampler

* reset act

* fix conflict and readme, test=develop

* fix ios v8 run error

* fix grid_sampler compute error. test=develop

* fix exp act run error, test=develop

* fix format, test=develop

* fix leakyrelu and tanh compute error, test=develop

* delete extra file, test=develop

* reset act

* fix conflict and readme, test=develop

* fix ios run error, test=develop

fix tiny_publish link error when open LOG

* add cv image process

* fix arm liunx build error

* add LITE_WITH_CV defien to make cv, test=develop

* fix cv format, annd add describe in utils/cv

* set LITE_WITH_CV=OFF in build.sh, test=develop

* delete cv_enum.h in utils/cv, push the contents in cv_ennum.h to paddle_image_preprocess.h, test=develop

* according to reviews to redefine paddle_image_preprocess.h, test=develop

* add detailed note of flipParam, test=develop

* fix format in paddle_image_preprocess.h, test=develop

* fix cmake error in llite/CMakeLists.txt, missing mkdir cxx, test=develop

* according to review change, test=develop

* add elemetnwise mul constant elimination and deconv+relu, deconv+batchnorm fusion, test=develop

* fix format, test=develop

* fix model_optimize bug, update concat and split op, speed up, test=develop

* update split speed, test=develop

* fix format, test=develop

* add classify demo inn demo/cxx/ , test=develop

* fix formart inn mobile_classify, test=develop

* delete some note and extra code, test=develop

* remove test.jpg and labels.txt, test=develop

* add test_cv in cxx/demo

* add test_cv READMEE, test=develoop

* add note info, flip only support x, y, xy;rotate only support 90, 180, 270; test=develop

* fix build error, paddle_cv_arm , test=develop

* add GRAY to RGBA(BGRA) convert and RGBA(BGRA)_to_Tensor, test=develop

* fix format from review, test=develop

* fix makefile format. test=devellop

* fix bbuuild v7 error, test=develop

-fix fluid-lite-subgraph x86 compile error
    - Replace FLAGS with environment variables

[Model Optimize Tool] enhance model optimize tool to supported specific tailoring test=develop (#2480)

* add cv image process

* fix arm liunx build error

* add LITE_WITH_CV defien to make cv, test=develop

* fix cv format, annd add describe in utils/cv

* delete some Meaningless comments, test=develop

* set LITE_WITH_CV=OFF in build.sh, test=develop

* delete cv_enum.h in utils/cv, push the contents in cv_ennum.h to paddle_image_preprocess.h, test=develop

* according to reviews to redefine paddle_image_preprocess.h, test=develop

* add detailed note of flipParam, test=develop

* fix format in paddle_image_preprocess.h, test=develop

* fix error when build x86. test=develop

lite_with_X86 does not contain lite_with_cv

* fix cmake error in llite/CMakeLists.txt, missing mkdir cxx, test=develop

* according to review change, test=develop

* chang grb to rgb, test=develop

Modify stream.cc make armlinux can compile success in develop branch
test=develop