* revert 40531

* update

* record memory and op supplement info

* update

* update

* fix a bug

* fix memory recording

* fix a bug

* update

* update

* fix a bug

* update

* fix a bug

* fix a bug

* fix a bug

* Revert "fix a bug"

This reverts commit c1d4df52762ba9ae7c7e27cd2ba4fc3a7ed9c7a5.

* fix a bug

* fix format

* fix

* Remove unnecessary including for pstring.h

* Fix typos

* fix bugs

* update

* update

* update

* code style

* code style check

* fix or backend many inputs bug

* fix or backend many inputs bug

* fix or backend many inputs bug

* fix or backend many inputs bug

* code format

* code format

* make device_id=current_id when not given

* use tracer to get current device id

* [CustomKernel] add custom kernel c api

* update

* update

* fix unable to export capi
Co-authored-by: Nronny1996 <524019753@qq.com>

* fix custom op error

* fix code error

* support set_grad_ivar for eager

* support set_grad_ivar for eager

* support set_grad_ivar for eager

* fix pylayer forward output code

* refine

* modify paddle2onnx cmake

* modify paddle2onnx cmake

* modify export interface

* modify paddle2onnx export

* paddle2onnx add mac windows

* modify paddle2onnx mac windows cmake

* modify paddle2onnx mac windows cmake

* modify paddle2onnx cmake support windows

* modify paddle2onnx cmake support windows

* modify paddle2onnx cmake support windows
Co-authored-by: Nxiegegege <xiege01@baidu.com>

* clear_gradient use set_constant but not zeros_like

* new general transformer inference support

* support CUDAGraph for partial graph

* add ut

* fix ci

* fix ut again because of eager mode

* fix kunlun ci

* fix win ci

* polish append op using

* fix var error

* fix group norm impl

* add fused_bias_dropout_residual_ln op and layer.

* support is empty

* fix error

* fix code error

* change to fake empty

* using fake empty first

* using fake empty first

* refactor the optional tensor

* remove optiona<MetaTensor> in InferMeta

* fix bug

* fix optional<vector<Tensor>>

* fix bug

* fix rmsprop

* fix amp of eager_gen

* polish code

* fix deleted code

* fix merge conflict

* polish code

* remove is_nullopt_

* fix merge conflict

* fix merge conflict

* Support memory stats for CPU

* Add UTs

* Fix typos

* Fix typos

* remove storage

* add glog include

* add glog include

* add glog include

* remove is_init_py of RandomGenerator, and use Global Generator if not OP seed

* fix comment

* fix Wtype-limits

* fix

* remove -Wno-error=type-limits

* remove shared_storage

* fix bug

* fix rnn bug

* refine enforce code

* refine enforce code

* fix compile failed

* fix infrt failed

* enable graph-engine to return all id

* change vector's dimension

* change vector's dimension

* enlarge returned ids dimensions

* add actual_val

* change vlog

* fix bug

* bug fix

* bug fix

* fix display test

* singleton of gpu_graph_wrapper

* change sample result's structure to fit training

* recover sample code

* fix

* secondary sample

* add graph partition

* fix pybind

* optimize buffer allocation

* fix node transfer problem

* remove log

* support 32G+ graph on single gpu

* remove logs

* fix

* fix

* fix cpu query

* display info

* remove log

* remove empyt file

* distribute labeled data evenly in graph engine
Co-authored-by: NDesmonDay <908660116@qq.com>

* adapt faster tokenizer op

* add eager test

* add unittest

* [Eager] Fix test_model.py under eager in windows-openblas ci

* Use || in this case

* recover _in_eager_mode_