* fix trt_dynamic_shape_ernie_deserialize_test

* support when opt cache dir does not exist

* improve err report, test=develop

* bug fix, test=develop

Fix conv deepwise bug when in_channels=1.

Enhance the error messages for  files in operators/math

* add check for sparse parameters with weight_decay

* move sparse check to adam.py

* move worker loop to top level

* move reader process loop to top level

* fix failed unittests

Update amp_check_finite_and_scale_op and add an updating_loss_scaling op for static graph amp training. (#26240)

* update amp_check_finite_and_scale_op for static_amp.

* use amp_check_finite_and_scale in static graph amp.

* update grads to zero when grads own infinite values(as for amp_checkout_finite_and_scale op).

* add update_loss_scaling op in cpp.

* add update_loss_scaling_op unit test.

* update the doc of the check_finite_and_unscale op

* Update the process of gradients updating skipping if the gradients have infinite values.

* update the way to zero grads.

* update test_update_loss_scaling_op.py

* add log info when find infinite grads.

* add the unit test for UpdateLossScaling Layer.

* rm auto from localsgd

* Add int8 GRU kernel with UTs

* Lint fixes

* More lint fixes

Error description optimize for math dir

* Fix the lookup_table_v2 failed on GRU mkldnn kernel issue
test=develop

* fix according to reviews, removed x_num_col_dims
test=develop

* update gru model. change according to reviews
test=develop

* change according to reviews
test=develop

* Add details to the summary and test it, test=document_fix

* Add set +e before example, test=document_fix

* Remove test code, test=document_fix

* Optimize summary information and test it, test=document_fix

* Remove test code, test=document_fix

* temporally disable zero_copy

* add test

* follow comments

* fix calcu_gradients

* fix code place

* fix embedding interface usage

* support to_static(model)

* add warning and unittest

* Use the single GPU card to execute the test_fuse_bn_act_pass UT.

* add double grad for tile, test=develop

* add double grad for expand_v2 op, test=develop

* add double grad for expand, test=develop

[UT] fix run type of ut test cases of test_train_recognize_digits and test_api_impl, test=develop (#27218)

* - introducing oneDNN 1.6

test=develop

* - Removed redundant code

test=develop

* add some unittest cases ot verify jit.save, no_test

* add more unittests

* add test with example inputs

* polish implement details

* remove useless blank

* fix fetch random error