* fix sharding_pass stage3 precision problem

* delete 'stage3 has precision problem' comment

* add dp2 training after load dp_engine

* unset grad_clip=clip for opt

* add submodule openblas

* add submodule openblas

* refine code

* refine code

* refine code

* add reference of lbfgs

* add reference of lbfgs

* [CustomOP] InferDtypeFn supports attrs

* Update paddle/fluid/framework/custom_operator.cc

* update cmake list

* fix cpu device

* change unittest time

* fix proxy problem

* fix leveldb bug

* fix proxy problem

* input.py

* Update python/paddle/nn/functional/input.py

* Update input.py

* Update all_gather.py

* Update all_gather.py

[xdoctest][task 123] Reformat example code with google style in python/paddle/quantization/quanters/abs_max.py (#56234)

[xdoctest][task 107]reformat example code with google style in python/paddle/optimizer/lamb.py test=docs_preivew (#56223)

* op_vjp generate template

* op_vjp_gen templete

* delete print
Co-authored-by: NAurelius84 <zhangliujie@baidu.com>

---------
Co-authored-by: NAurelius84 <zhangliujie@baidu.com>

* [AMP] add fp16 op detection for custom device

* resolve conflicts

* add code

* fix bug

* fix bug

* delete unused code

* refine code

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* [CINN] Fix compile error

* delete useless env

* fix gflags conflict

* fix args used by ut

---------
Co-authored-by: NZzSean <18818272991@163.com>

[xdoctest][task 106] Reformat example code with google style in python/paddle/optimizer/adamw.py (#56222)

* [xdoctest][task 106]reformat example code with google style in python/paddle/optimizer/adamw.py

* fix word typo test=docs_preview

* fix word typo test=docs_preview

* fix whitespace test=docs_preview

[xdoctest][task 110] Reformat example code with google style in python/paddle/optimizer/momentum.py (#56226)

* [xdoctest][task 110] test=docs_preview

* fix whitespace test=docs_preview

[xdoctest][task 111] Reformat example code with google style in python/paddle/optimizer/rmsprop.py (#56227)

* [xdoctest][task 111] test=docs_preview

* fix whitespace test=docs_preview

[xdoctest][task 112] Reformat example code with google style in python/paddle/optimizer/sgd.py (#56228)

* add ir output check in OpTest

* add ir grad check in op test

* fix bug in output check

* trigger CI

* test gpu ci

* trigger CI

* trigger CI

* add white list to relax precision check for some tests

* relax timeout of test_concat_op

* relax timeout of test_concat_op

* temp commit

* distribute best cfg

* update metric extracting

* fix bugs of prune and reading log

* fix adding cfg bug

* reset status

* remove alarm and set logdir

* deepcopy ctx

* change alarm

* fix restart bug

* best no need alarm

* add gbs search, add gpu memory to history csv, add memory detect

* fix bug

* fix memory read bug; fix etcd connection bug

* fix memory read bug, add oom detection for all ranks

* fix read log and oom detaction, add error code for read log

* add unit test

* Update master.py

---------
Co-authored-by: Ncaozhou <caozhou@radi.ac.cn>

* weight_norm_hook

* Update weight_norm_hook.py

* Update weight_norm_hook.py

* Update python/paddle/nn/utils/weight_norm_hook.py

* Update python/paddle/nn/utils/weight_norm_hook.py

* Update python/paddle/nn/utils/weight_norm_hook.py
Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>

---------
Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>

* add rmsnorm residual bias add and quant

* refine python interface

* add rmsnorm unittest

* Add layernorm

* fix layernorm unittest

* refine unittest

* fix example code

* fix review comment