* add new API: MultiStepDecay, a new learing rate strategy, test=develop

* add new API: MultiStepDecay, a new learing rate strategy,test=develop

* add new API: MultiStepDecay, a new learing rate strategy,test=develop

* add base class of LearningRateEpochDecay, and MultiStepDecay, and StepDecay, test=develop

* fix doc to add coverage,test=develop

* Start implementing int8 eltwise add

test=develop

* - Fix to Michal PR

* - Fix

test=develop

* - Lint fixes

test=develop

* - Added checking if elementwise_mul can be used

test=develop

* - Added attribs to skip_attrs_set

test=develop

* - Improved broadcasting

test=develop

- fixes to compilation

- fix

- fix

- Lint fixes

test=develop

* - removed redundant condition

test=develop
Co-authored-by: NMichal Gallus <michal.gallus@intel.com>

* fix bug of prelu when rank not equal 4, test=develop

* fix prelu inference, test=develop

* fix api, test=develop

* fix shape when mode is chennel, test=develop

* remove debug code, test=develop

* add unittest, test=develop

[Dy2Static]Convert var.shape stmt and Convert the return variables of Tensor-dependent 'if' staments to Tensor if it not  (#24911)

* Support int and long: int or long -> six.integer_types. 

* Modify test_tensor_shape: fix bug and modify comment. 

* Support convert_var_shape to convert var.shape stmt

* Modify code in ifelse_simple_func.py because don't support return non-Tensor in Tensor-dependent 'if' stament currently. 

* Convert the return variables of Tensor-dependent 'if' staments to Tensor if it not. test=develop

Fix the bug for elementwise_div op, when the first var is scalar; Use the shape 1 replace the -1 in shape.

* Support LoDTensorArray in reverse_op test=develop

* polish en doc and unittest code test=develop

* refine sample code test=develop

* add example of LoDTensorArray test=develop

* fix typo test=develop

* rewrite the sigmoid_focal_loss code example. test=develop

* fix spelling mistake in comments of code example.test=develop

* [dy2stat] Support len

* add convert_call func

* refine code test=develop

* support NHWC in Pool2D, test=develop

* add unittest, test=develop

* fix unittest, test=develop

* fix typo, test=develop

* follow comments, test=develop

* refine comments, test=develop

* test=develop update interpolate & upsample api

API/OP(sequence_first_step, sequence_last_step, sequence_mask, beam_search, beam_search_decode) error message enhancement (#24590)

* Support to create LoDTensorArray in control flow (cond and while_loop)

* Fix bug: return LoDTensorArray in while_loop

* Change code in list_transformer.py to accommodate the new features. 

* API/OP(sequence_expand_as) error message enhancement.
test=develop
Co-authored-by: NFrostML <380185688@qq.com>

* dynamic_gru err_msg enhancement, test=develop

* chunk_eval err_msg enhancement and fix crf_decoding output type, test=develop

* BeamSearchDecoder err msg enhancement, test=develop

* fix doc for chunk_eval, test=develop

* refine lod err msg for chunk_eval, test=develop

* Compatible int32 and int64 for attr in op slice/strided_slice. test=develop

* Polish code in nn.py  test=develop

* Fix bug: set the same dtype for the inputs of elementwise_add. test=develop

* Convert int32 to int64 in slice op to avoid data overflow. test=develop

* Convert int32 to int64 in strided_slice_op to avoid data overflow. test=develop

* improve error reporting message

* test=develop, test=document_fix

* test=develop, test=document_fix
Co-authored-by: Nswtkiwi <1208425345@qq.com>

* fix error message, test=develop

* error message of cross_entropy_op, test=develop
* fix bug : can't use platform::errors::InvalidArgument in HOSTDEVICE, test=develop
* fix bug: recovery the check_variable_and_dtype for rank_loss and bpr_loss, test=develop

* fix error check of stack and space_to_depth
* test=develop

* Format error message for ops, test=develop

* Fix check in sequence_expand, test=develop

fix check info for flatten hash is_empty op; test=develop

* update err msg for dynamic_lstm and dynamic_lstmp, test=develop

test=develop

Fix the elementwise_ops axis bug, make elementwise_ops has the same the op function for override ops

* polish some sl api error message, test=develop

* polish python input check of stride slice, test=develop

* fix unittest bugs, test=develop

* enhance rank_loss error message, test=develop

* enhance similarity_focus error message, test=develop

* enhance squeeze error message, test=develop

* add scale_x_y for yolo_box, test=develop

* refine eps in iou_similarity, test=develop

* fix error log: resahpe, range, reverse.