* remove the NaturalExpDecay in fluid

* fix bug

* remove the ExponentialDecay in fluid

* remove the InverseTimeDecay in fluid

* remove the InverseTimeDecay class

* fix bug

* fix batch_norm grad kernel nhwc error

* fix batch_norm bias_grad loss in cinn

* disable cinn

* fix cinn_atol

* no endpoints in dy mode

* fix fleet api inconsistent

* fix lamb always_adapt

* fix optest

* fix all optests

* fix for log xxx

* add int32/int64 for cpu/gpu; add float16/bfloat16 for cpu forward

* fix docstring

* fix bug

* fix bugs

* fix bugs

* fix bugs

* fix bugs

* fix bug

* using cast

* fix test

* fix api

* fix other bugs

* fix ci bug for not using dygraph guard

* add bfloat16 test

* fix ut

* bf16

* exp/expm1 support int32/int64

* fix ut

* fix ut

* fix ut

* modify tensorrt ci timeout

* activation ci bug fix

* comment out  int8 mode test_trt_dynamic_shape_groupnorm

* Fix bug of reduce_sum op. When input.numel() > INT32_MAX, its result
is wrong.

* Remove climits.

* Fix problem of pickle and NCCL_P2P_DISABLE in distributed testcases in
cuda12.

* Fix problem of TimeOut of distributed testcases under cuda12.

* Fix bug of test_sync_batch_norm_op_static_build accuracy problem under
cuda12.

* Remove useless code modification.

* Fix bug of reduce_sum op. When input.numel() > INT32_MAX, its result
is wrong.

* Remove climits.

* Fix problem of pickle and NCCL_P2P_DISABLE in distributed testcases in
cuda12.

* Fix problem of TimeOut of distributed testcases under cuda12.

* Remove useless modification.

* Remove useless modification.

* move batch_norm prim test to op_test

* fix optest bug

* add test to cmake

* add cinn test case

* fix batch_norm prim grad bf16

* fix code

* add cuda check

* fix batch_norm bfloat16

* fix cpu bfloat16 bug

* skip non-bfloat16-supported platform

* fix code

* fix cinn rtol and atol in bfloat16

* fix name

* fix config

* [Zero-Dim] paddle.nanmedian support 0D Tensor

* fix CI

* update

* update

[BugFix]: Fix ci test bugs in test_fuse_gemm_epilogue_pass.py and test_fused_gemm_epilogue_op.py (#54519)

* fix ci bugs in fused_linear

* fix code style

* fix A100 CUDA12 ut

* fix ci uts

* fix test_sync_batch_norm_op

* fix sync bn op ut again by separating 2 files

* fix codestyle ci

* combine other PRs

* fix codestyle

* fix codestyle ci

* Enable check_cinn on atan2, tile, top_k and where

* Update cmakelists in legacy_test

* Reformat code

* Enable check_cinn on op take_along_axis legacy test

* Enable check_cinn on pool2d

* Remove check_cinn=False

* Try fix tile test error

* Rename enable_cinn to test_cinn

* Refactor test_tile_op

* Replace all enable_cinn to check_cinn

* Revert pool2d test timeout

* Remove check_prim and use enable_cinn

* fix a100 cuda12 timeout

* fix cuda12 pickle loads problem

* fix ist_sharding_save ut

* fix for log xxx

* add int32/int64 for cpu/gpu; add float16/bfloat16 for cpu forward

* fix docstring

* fix bug

* fix bugs

* fix bugs

* fix bugs

* fix bugs

* fix bug

* using cast

* fix test

* fix api

* fix other bugs

* fix ci bug for not using dygraph guard

* add bfloat16 test

* fix ut

* bf16

* support add(x_float32, bfloa16_) or add(x_float32, y_float16)

* polish

* fix test

* bump ruff to 0.0.271 and update config

* exclude third_party

* bump ruff to 0.0.272

* refine config

* support some prim ops bf16 dtype

* fix cmake

* support some prim ops for bf16 dtype

* remove useless code

* Add outputs to check_numerics_kernel.

* Add check_numerics to yaml.

* Add API and unittest.

* Add check_nan_inf_level as argument of check_numerics_kernel.

* Add more unittests.

* Fix static API implementation and unittest.

* Move the implementation of check_numerics to paddle.amp.

* Fix import error.

* [CINN] reopen mean/cumsum/instance_norm op's prim+CINN test

* remove repeat test_mean_op in cmake

* add ldexp api

* fix ldexp

* Update math.py

fix math.py

* rewrite the ldexp

* Simplify ldexp implementation

* fix codestyle

* Update math.py

* Update math.py

* modify the test_ldexp.py

* fix the input bug of np.ldexp

* fix the bug of np.ldexp in windows

* modify the ldexp function and add the dtype check of output

* Update test_ldexp.py

* fix the dtype

* fix codestyle

* Update python/paddle/tensor/math.py

add note for code description
Co-authored-by: Nzachary sun <70642955+sunzhongkai588@users.noreply.github.com>

---------
Co-authored-by: Nzachary sun <70642955+sunzhongkai588@users.noreply.github.com>