* move batch_norm prim test to op_test

* fix optest bug

* add test to cmake

* add cinn test case

* fix batch_norm prim grad bf16

* fix code

* add cuda check

* fix batch_norm bfloat16

* fix cpu bfloat16 bug

* skip non-bfloat16-supported platform

* fix code

* fix cinn rtol and atol in bfloat16

* fix name

* fix config

* [Zero-Dim] paddle.nanmedian support 0D Tensor

* fix CI

* fix A100 CUDA12 ut

* fix ci uts

* fix test_sync_batch_norm_op

* fix sync bn op ut again by separating 2 files

* fix codestyle ci

* combine other PRs

* fix codestyle

* fix codestyle ci

* construct dist tensor

* move constructor to header

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* use global group to pass meta

* use batch isend irecv

* add partial send/recv

* remove communication group

* remove p2p on npu and xpu

* remove virtual pp ut

* fix for log xxx

* add int32/int64 for cpu/gpu; add float16/bfloat16 for cpu forward

* fix docstring

* fix bug

* fix bugs

* fix bugs

* fix bugs

* fix bugs

* fix bug

* using cast

* fix test

* fix api

* fix other bugs

* fix ci bug for not using dygraph guard

* add bfloat16 test

* fix ut

* bf16

* add phi option in cmake

* modify default option

* fix windows bugs

* perfect log

* change default mode

* change phi so on for py3

* support add(x_float32, bfloa16_) or add(x_float32, y_float16)

* polish

* fix test

* bump ruff to 0.0.271 and update config

* exclude third_party

* bump ruff to 0.0.272

* refine config

* [CINN] add paddle.device.is_run_with_cinn() api for running check

* for pass ci converge

* add check whl should compiled with cinn

* fix ci coverage bug

* remove exposed API

* import is_run_with_cinn explicitly

* eager call all2all to avoid p2p hang in lazy init

* update

* Add outputs to check_numerics_kernel.

* Add check_numerics to yaml.

* Add API and unittest.

* Add check_nan_inf_level as argument of check_numerics_kernel.

* Add more unittests.

* Fix static API implementation and unittest.

* Move the implementation of check_numerics to paddle.amp.

* Fix import error.

* [CustomDevice] add sarding support

* update

* replace requests with httpx

* set timeout=3

* replace requests with httpx

* replace request with httpx

* test

* repalce requests with httpx

* test

* replace requests with httpx

* replace requests with httpx

* modify paddle_build.sh

* fix bug

* add ldexp api

* fix ldexp

* Update math.py

fix math.py

* rewrite the ldexp

* Simplify ldexp implementation

* fix codestyle

* Update math.py

* Update math.py

* modify the test_ldexp.py

* fix the input bug of np.ldexp

* fix the bug of np.ldexp in windows

* modify the ldexp function and add the dtype check of output

* Update test_ldexp.py

* fix the dtype

* fix codestyle

* Update python/paddle/tensor/math.py

add note for code description
Co-authored-by: Nzachary sun <70642955+sunzhongkai588@users.noreply.github.com>

---------
Co-authored-by: Nzachary sun <70642955+sunzhongkai588@users.noreply.github.com>

* [AutoParallel] fix sharding for 0D tensor and amp-o1

* add amp for sharding unittest

* sharding pp overlap

* bug fix

* update

* rename function

* update code logic