* fix bug

* fix bug

* fix bug

* [尝试] 给tensor增加一个属性, 这个属性是一个定值 1

* 暴露gradnode 并构建gradnode新的方法(用来测试)进行暴露给python python端可以访问

* 开发grad_fn、next_functions两个API 并暴露到python端- 做一些规范化处理

* 增加一个单元测试

* 优化 code-style

* [NewIR]Refine IrPrinter and basic Concept Interface for const Object

* move ut of auto_parallel

* fix ut

* add stop_gradient attribute for defining op

* modify by reviews

* fix

* add inplace interface

* support inplace

* refine code

* fix bug

* fix bug

* refien code

* fix exception bug

* update

* fix attribute translator bug

* remove usless code

* add reduction spmd rule for auto parallel

* fix the logic of handling partial

* fix code style

* fix the partial handling

* add ir output check in OpTest

* add ir grad check in op test

* fix legacy name converter bug

* add more unittest

* fix

* fix warprnn op bug

* add whit list

* polish code

* adagrad modify

* recover

* polish code

* review

---------
Co-authored-by: Nkangguangli <kangguangli@hotmail.com>
Co-authored-by: Nphlrain <phliuhongyu@126.com>

* add some basic functions

* add elementwise rule for auto parallel

* add unit test for elementwise rule

* fix the lib name in spmd rule test cmake file

* fix some bugs

* add unit tests for elementwise spmd rule in python

* bug fix

* delete cpp unit test for elementwise spmd rule (use python ut now)

* add cpp unit test for elementwise rule

* use concrete op name in unit test

* fix typo

* fix code style

* delete cpp unit test

* add more details in log

* fix WITH_SHARED_IR option type

* rename WITH_INFERENCE_NVTX to WITH_NVTX and fix compile bug

* update

* add ir output check in OpTest

* add ir grad check in op test

* fix legacy name converter bug

* add more unittest

* fix

* fix warprnn op bug

* add whit list

* polish code

* polish code

---------
Co-authored-by: Nkangguangli <kangguangli@hotmail.com>

* commit

* del inplace op in memory_optimize_pass.cc

* check code style

* add layernorm spmd rule

* add ut

* follow comments

* optimize expr operator = implementation

* fix codestyle

* fix bug

* fix bug

* refien code

* refien code

* fix bug

* refine code

* [NewIR]Fix VLOG Ptr display problem and decrease amp log level

* fix codestyle

* add local scope

* refine code

* refien code

* refine code

* support local scope for BuildFuncList

* fix bug

* add log

* fix bug

* polish code

* fix bug

* suport optional input in new_ir

* polish code

* add coverate test

* update

* update

* add unitest

* remove reduplicate code

* udpate

* fix assign error

* revert test arg min max

* update

* fix bug

* polish code

* configure elementwise_pow op_version

* support auto generate for static op elementwise_pow

* pre-commit run

* add program pybind

* rename file

* fix compile bugs

* base rule

* add sharidng merge

* add sharidng axis merge

* define unified data class for inferencing dist_attr

---------
Co-authored-by: NYichen Zhang <zhangyichen03@baidu.com>

* Fix build error on rocm4.5/rocm5 on ubuntu18.04

* declear new rccl api in paddle/fluid
* Fix build error:free(): invalid pointer by pick the fix:
https://github.com/skarupke/flat_hash_map/pull/26
* Filter to check codestyle for flash_hash_map.h
Signed-off-by: Njiajuku <jiajuku12@163.com>

* Apply suggestions from code review
Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>

---------
Signed-off-by: Njiajuku <jiajuku12@163.com>
Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>

* suport optional input in new_ir

* polish code

* add coverate test

* update

* update

* add unitest

* remove reduplicate code

* set test timeout