[cherry-pick] [NPU] apply npu cache offline model to other devices, test=develop (#3925), test=release/v2.6 (#3933)

* [NPU] enhance cache offline model, test=develop

* fix opencl fc kernel caused int16 model weight abnormal. test=develop

* [arm]add 2x2s2p1 pooling  (#3705)

* fix pooling bug and speed

* add 2x2s2p1 pooling. test=develop

* fix conflict, test=develop

* fix conflict in wino

* [arm] add 3x3s1 Winograd int8 (#3767)

* fix: winograd support unsame pad
test=develop

* feat: add winograd int8 kernel
test=develop

* fix: style fix
test=develo

* fix winograd_int8 ut sgement default. test=develop

* close basic_test, test=develop
Co-authored-by: NMyPandaShaoxiang <txg4794@163.com>

* fix xiaodu crash in gemm prepacked

* in huwen phone, 3x3s2p0 avg pooling will rand crash, other phone does not have this feature

* [arm] update con int8 kernel choose (#3834)

* fix conv int8 kernel choose and sooftmax compute bug

* change axis_size = 4 kernel choose, test=develop

* fix format. test=develop

* fix format.test=develop

* fix build test=develop

* fix buiild error test=develop

* fix wino_int8 computte erroor. test=develop

* Update the link to debug, test=develop, test=document_fix (#3870) (#3871)
Co-authored-by: NMyPandaShaoxiang <txg4794@163.com>
Co-authored-by: Ncc <52520497+juncaipeng@users.noreply.github.com>

* update cuda demo.

* Fix Places of CXX Config for OpenCL. test=develop

* fix shared ptr as unqiue ptr. test=develop

* fix bilinear opencl kernel. test=develop

* [LITE][OPENCL] replace map with memsync. test=develop

* [GIT] Ehance ignore. test=develop

* replace map of Fc with MemCpySync. test=develop

* comment for mul of opencl. test=develop

* Fix opencl miscs. test=develop

* Fix activation act_type default value. test=develop

* Fix enum value. test=develop

* Fix conv test for relu. test=develop

* improve 3x3s1 direct profile

* fix format, test=develop

1. fix clang android log warning.
2. remove an unused event.

* [lite][opencl] remove event with clfinish, add strict check for cl warning. add conv 3x3opt fallback opt layout cast ,test=develop

* [LITE][OPENCL]rm event in element_add_buffer_compute test=develop

* [LITE][OPENCL]suite cl_functions_test.cc test=develop

* [LITE][OPENCL] suite cl_common.sh lint check test=develop

* [LITE][OPENCL] suite conv_image_compute.cc lint check test=develop

* [LITE][OPENCL] suite cl_wait_list() lint check test=develop

* fix bilinear opencl kernel. test=develop

* [LITE][OPENCL] replace map with memsync. test=develop

refactor(*): reduce Wsign-compare warning

* Optimize matmul for size(x_dims)=2  size(y_dims)>2

* [NPU] add shape bridge

move shape arm kernel to host

* enhance compare arm kernel

* [NPU] add gather op bridge

* enable reshape arm ut

* [NPU] add lookup_table bridge

* [LITE][OPENCL][Image] lazy init cl::event , test=develop

* [LITE][OPENCL][Image] lazy init cl::event , test=develop

[LITE][OPENCL][Image] use unique_ptr to wrap filter and bias in conv image compute , test=develop (#3388)

* [LITE][BM] fix reshape infer shape issue, test=develop

* [LITE][BM] with testing=on, test=develop

1. clean code;
2. change `cl::Kernel` from unique to shared ptr;
3. `reset` `cl::Program` and `clear` `device_info_` in destroyed of CLRuntime;
4. remove clFlush in destroyed of CLRuntime.

* [LITE][OPENCL] fix OpenCL global static resources. test=develop

* Fix Cxx and light api. test=develop

[MLU] add some basic support for MLU, including related passes, kernels, gtests and some api in padddle_api.h
Passes：mlu_subgraph_pass ,mlu_postprocess_pass
Kernels:  act，batch_norm, concat, conv, elementwise, fc, interpolate, pool, scale, softmax

* Add hard_swish, ctc_align and reciprocal op, test=develop
* Move some activation ops to extra, test=develop