* for inference checkpoint

Change-Id: I36c979240ffa55bf1ef0c9315402960762af6be4

* for inference checkpoint

Change-Id: I82025365d5b792cbea1ead506df685aecc8ac198

* register instance norm, test=op_version

Co-authored-by: Nzhoushunjie <zhoushunjie@baidu.com>

* Register op version for linspace,test=op_version

* Register op version for linspace,test=op_version

* Register op version for linspace,test=op_version

* Register op version for linspace,test=op_version

* Register op version for linspace,test=op_version

* test=develop, add op_register_version for roll_op

* dot op support complex types

* matmul support complex types

* add test case

* matmul broadcast gradient support complex

* move conjFunctor to complex_functor.h

* fix rank_attention, test=op_version

* Add operator checkpoints for new attributes.

* Fix adding subsequent checkpoint to quantize op.

* Add mkldnn nearest_interp and bilinear_interp op
* don't run mkldnn interpolate in default
* add interpolate_mkldnn_pass

* add the support the op version check for matmul, test=op_version

* add the op version check for the elementwise ops, test=op_version

* add the support check for elementwise_ops, test=op_version

* fix momentum op register

* upgrade instance_norm, test=op_version

* fix

Add moving_average_abs_max_scale op_register_version

register op version for conv2d_transpose, conv3d_transpose and depthwise_conv2d_transpose, test=op_version (#29937)

test=develop
test=op_version

* add gru op_register_version; test=op_version;

* Update fc,mul version;test=op_version;

* add op version for fake_quant and fake_dequant ops, test=op_version, test=develop

* Support MIPS arch.

* register op version for grid_sampler

* enable bilateral_slice unittest on windows platform

* reduce max threads

* try to add fwd op input dtypes

* refactor base impl

* return tmp_ins after dygraph prepare data

* fix typo found in debug

* polish comment & add complex net test

* revert detail change

* fix unittest failed

* add complex kernel condition control

* fix xpu test failed & polish comment

* polish details by review comments

* add support for complex grad accumulated

* add unittest for coverage

* update test dtype

* remove useless blank line

* support some shape in matmul and cast

* modify matmul

* feat: support check_nan_inf for kunlun device

* support kunlun stack

* minor

* oneps (3/4)
Co-authored-by: NMrChengmo <cmchengmo@163.com>
Co-authored-by: Nmalin10 <malin10@baidu.com>
Co-authored-by: Nchengmo <chengmo@baidu.com>

1. Type of index: int, slice(step must be 1).

2. Type of value: 
 (1) int32, int64, float32, bool; 
 (2) numpy.array(int32, int64, float32, bool);<Note: float64 is not supported>
 (3) paddle.Tensor(int32, int64, float32, float64, bool);

* 　add heter box

* add trainer, worker, wrapper...

* format

* for ci

* format

* remove boost get

* boost & copyright

* rename

* 　rename

* format

* format

* format
Co-authored-by: Nyaoxuefeng6 <yaoxuefeng@baidu.com>

* test=develop, optimize roll_op_cuda_kernel

* Using VisitDataTypeTiny and put CastOP after ReduceOP, test=develop

* remove changes of reduce_op.h, test=develop

* add conj op for complex types

* add conj for complex types

* add more test case

* add conj_op test

* modify conj api and impl

* add complex type for fill_constant_op xpu

* add setConstant for complex type

* remove complex conj test file

* user define grad for test_conj_op

* add test case for static mode of conj api

* modify conj doc

* change input args name to x

* remove useless codes

* conj support real types

* add conj test case for real number

* delete no need to calculate inputs in dygraph op_test

* delete no need to calculate inputs in dygraph op_test

* modify grad of mul for complex types

* fix the grads of inputs args order not match bug