* format correction

* variable names adjustment

* variable names adjustment, name-->type, value-->sub_program

replace the AdagradOptimizer 、adamaxOptimizer、AdadeltaOptimizer、RMSPropOptimizer、LambOptimizer and Momentum (#54152)

* replace the AdadeltaOptimizer with Adadelta

* replace the RMSPropOptimizer with RMSProp

* replace the LambOptimizer with lamb

* replace the momentum in contrib/optimizer.py with Momentum in python/paddle/optimizer/momentum.py

* fix bug

* fix bug

* fix bug

* fix bug of Lamp

* fix bug of Lamp

* fix bug of import

* replace the AdamaxOptimizer with Admax and change the optimizer base for AdagradOptimizer

* fix bug

* fix bug

* Update optimizer.py

* fix bug

* fix bug

* add rmsnorm kernel
* add static graph test
* fix round type
* use alignas to avoid msvc compile error
* remove redundant headerfile to avoid rocm compile error
* fix rocm compile not found cub
* Add document

* suport optional input in new_ir

* polish code

* add coverate test

* update

* update

* add unitest

* remove reduplicate code

* udpate

* fix assign error

* revert test arg min max

* update

* fix bug

* polish code

* update

* fix unique and close op bug

* update

* update

* revert test code

* revert unique test

* polish code

* remove useless code

---------
Co-authored-by: Nzhangbo9674 <zhangbo54@baidu.com>

* fix bug

* fix bug

* fix bug

* rename weight_only/llm.int8

* [尝试] 给tensor增加一个属性, 这个属性是一个定值 1

* 暴露gradnode 并构建gradnode新的方法(用来测试)进行暴露给python python端可以访问

* 开发grad_fn、next_functions两个API 并暴露到python端- 做一些规范化处理

* 增加一个单元测试

* 优化 code-style

* [NewIR]Refine IrPrinter and basic Concept Interface for const Object

* update polygama

* udpate compact

* format yaml file

* move ut of auto_parallel

* fix ut

* add stop_gradient attribute for defining op

* modify by reviews

* fix

* fix affine grid bug

* revert cummax

* add inplace interface

* support inplace

* refine code

* fix bug

* fix bug

* refien code

Co-authored-by: NSigureMo <sigure.qaq@gmail.com>

* fix exception bug

* update

* fix attribute translator bug

* remove usless code

* add reduction spmd rule for auto parallel

* fix the logic of handling partial

* fix code style

* fix the partial handling

* [jit] add copy-from; test=document_fix

* [jit] add copy-from; test=document_fix

* fix TracedLayer

* [IR&PASS] add conv + elementwise_add fuse pattern

* add conv2dAddPattern to pass

* remove the extend_optimizer_with_weight_decay function

* Update __init__.py

* fix bug

* fix bug

* add ir output check in OpTest

* add ir grad check in op test

* fix legacy name converter bug

* add more unittest

* fix

* fix warprnn op bug

* add whit list

* polish code

* polish code

* fix cummin cummax bug

---------
Co-authored-by: Nkangguangli <kangguangli@hotmail.com>

This PR delete middle ir_visitor class and thus we can avoid middle virtual function call and codes look more clean
pcard-72718

* fix index_put bug when index is multi-dim bool tensor

* fix name error