* use global group to pass meta

* use batch isend irecv

* add partial send/recv

* remove communication group

* remove p2p on npu and xpu

* remove virtual pp ut

* fix for log xxx

* add int32/int64 for cpu/gpu; add float16/bfloat16 for cpu forward

* fix docstring

* fix bug

* fix bugs

* fix bugs

* fix bugs

* fix bugs

* fix bug

* using cast

* fix test

* fix api

* fix other bugs

* fix ci bug for not using dygraph guard

* add bfloat16 test

* fix ut

* bf16

* support add(x_float32, bfloa16_) or add(x_float32, y_float16)

* polish

* fix test

* bump ruff to 0.0.271 and update config

* exclude third_party

* bump ruff to 0.0.272

* refine config

* [CINN] add paddle.device.is_run_with_cinn() api for running check

* for pass ci converge

* add check whl should compiled with cinn

* fix ci coverage bug

* remove exposed API

* import is_run_with_cinn explicitly

* eager call all2all to avoid p2p hang in lazy init

* update

* Add outputs to check_numerics_kernel.

* Add check_numerics to yaml.

* Add API and unittest.

* Add check_nan_inf_level as argument of check_numerics_kernel.

* Add more unittests.

* Fix static API implementation and unittest.

* Move the implementation of check_numerics to paddle.amp.

* Fix import error.

* [CustomDevice] add sarding support

* update

* replace requests with httpx

* set timeout=3

* replace requests with httpx

* replace request with httpx

* test

* repalce requests with httpx

* test

* replace requests with httpx

* replace requests with httpx

* modify paddle_build.sh

* fix bug

* add ldexp api

* fix ldexp

* Update math.py

fix math.py

* rewrite the ldexp

* Simplify ldexp implementation

* fix codestyle

* Update math.py

* Update math.py

* modify the test_ldexp.py

* fix the input bug of np.ldexp

* fix the bug of np.ldexp in windows

* modify the ldexp function and add the dtype check of output

* Update test_ldexp.py

* fix the dtype

* fix codestyle

* Update python/paddle/tensor/math.py

add note for code description
Co-authored-by: Nzachary sun <70642955+sunzhongkai588@users.noreply.github.com>

---------
Co-authored-by: Nzachary sun <70642955+sunzhongkai588@users.noreply.github.com>

* [AutoParallel] fix sharding for 0D tensor and amp-o1

* add amp for sharding unittest

* sharding pp overlap

* bug fix

* update

* rename function

* update code logic

* feat: added polygamma init code

* feat: added polygamma unittest code

* test: added more test cases

* refactor: added forward impl

* refactor: added backward impl

* test: updated cases

* refactor: updated test cases

* refactor: added more case and fixed some bugs

* test: updated ref func

* refactor: updated code style

* refactor: move the code

* refactor: updated test

* refactor: updated test

* docs: updated en doc
Co-authored-by: Nzachary sun <70642955+sunzhongkai588@users.noreply.github.com>

* docs: updated math eq

---------
Co-authored-by: Nzachary sun <70642955+sunzhongkai588@users.noreply.github.com>

* add fp&bf16 bernoulli

* add check_dtype & fix error

* fix rocm error

* floor div support float/double/bfloat16/float16

* add ut

* fix bug

* fix fft.ifftshift for floor_divide upgrade

* fix comment

* fix bugs

* fix bug

* [IR] delete_wrapper

* [IR] modify the ast_transformer core logic

* [fix] modify the test_origin_info

* [AutoParallel] add 1F1B

* rm amp

* support master_grad for adam and momentum

Co-authored-by: zhangting_2017@163.com <zhangting2020>

* support layer_norm prim op bf16 dtype

* polish code

* resolve conflict

* static graph autogen code for check_finite_and_unscale_ op

* bug fixed