* tanh_double_grad_rules

* delete log got api_base

* modify composite yaml

* optimize rules

Co-authored-by: Njzhang533 <jzhang533@gmail.com>

* test

* rollback

* move some abvious import into head part

* rollback

* reduce utils_helper.py

* MOVE INTO DEVELOP

* add from paddle.nn import Layer

* codestyle

* update

* update

* update full_like and dropout

* update

* update

* update

* remove check_grad

* add fuse adamw pass

* fix some bugs

* fix CIbug

* change chunk_size

* fix CI bug

* rm test_fused_adam_op.py

* fix CI bugs

* fix fuse_adamw_op_pass.cc

* change code style

* fix CI bug

* fix ut bug and use_adamw_op_pass.cc

* fix test_fuse_adamw_pass.py

* fix CI bug

* remove fluid

* fix ci bug

* fix CI bug

* Support ignore_index for c_softmax_with_cross_entropy_op.

* Polish code. Remove useless comments and add Testcase.

* Polish code for TestCase.

* Polish code.

* Polish code style.

* Polish code.

* Change loss calculation formula and ignore_index dtype.

* Polish TestCase.

* update

* update

* [kunlun] support min/max in dygraph mode

* update xccl to 1.0.13

* fix kp compile

* test

* Revert "test"

This reverts commit 3a1cbfaa0f23e6e06d3dcd8d0b0c28aa63a98e70.

* update copyright

* update cmake

* update cmake

* update cmake

* update cmake

* [Test Mv] asp_test

* [Test Mv] cmake add py_test_modules

* [Move Test] rm py_test_modules

* fix PLR1722

* fix issue

* fix error

* use list instead of List for type annotations

* delete import of List

* Fix jetson conv2d_fusion not found error

* Fix jetson conv2d_fusion not found error

* Add comment test=document_fix

* [AMP OP&Test]numel op fp/bf 16 support

* dtype update

* remove err case

* fix generate_kernels.py in CUDA 12.0

* fix attrs bug

Add basic functionalities to support Scalar & Scalars in operator attribute.

1. extend allowed types in operator's attribute type, add `paddle::experimental::Scalar`, add corresponding protobuf Message types;
2. Scalar enhancement, add formatting, equality;
3. add code to handle Scalar & Scalars in opmaker, conversion from  paddle operator to phi kernel, opdesc construction and manipulation,  tensorrt converter, tracer, operator construction, etc;
4. bind `paddle::experimental::Scalar` to python, as `libpaddle.Scalar`;
5. add functionality to canonicalize attribute map according to OpProto(if the op the attribute map used for has an OpProto);
6. add code to manipulate Scalar proto message via protobuffer python API;

Add unittests.

1. add test cases for formatting, equality for Scalars, and WrapAsScalars;
2. add test cases for 'casting' between different morphs of attributes;
3. add test cases for extracting scalar & scalars from attribute;
4. add test cases for CanonicalizeScalarAttrs(and fix a bug in type index offset);
5. fix gmock's library filename on windows platform.
6. clean code: use canonicalize_attrs instead of inlining the function;
7. add test cases for libpaddle.Scalar in python code.
8. add test cases for `make_scalar_proto`, which manipulate proto message `Scalar` via protobuffer python API.

* Remove log about fluid
* Remove useless forward declarations
* Fix uninitialization warning (trt onehot)

* remove api `class ParallelExecutor`

* remove other references

* mv cumprod

* add attrs

* Update backward.yaml

* Update backward.yaml

* delete old dygraph op test

* support layer_norm prim and cinn test

* enable cinn test

* fix merge conflict

* polish input for check_output_with_place

* fix merge conflict

* add more test case

* fix merge conflict

* polish test case

* polish op_test

* change ln_g rules

* modify scale is none case

* modify scale is none case

* add public_python_api for check prim

* modify setoutputgrad and fp64bug

* add todo & delete log

* delete Single***varname

* delete get varname

* modify FP64 bug

* delete op test

* recover

* fix conflict

---------
Co-authored-by: NWeilong Wu <veyron_wu@163.com>

* add flag to set chunk size

* use the flag

* add vlog

* add ut

* rename ut

* add overflow check in memory efficient attention

* fix ci compile error

* fix ci compile error

* fix int8 support for full kernel

* fix ut.