* remove outer comment when dy2stat

* remove all comment

* add unit test

* polish for zip in dy2stat

* polish comment

* polish is_builtin_len

* fix comment

* optimize dygraph probl

* refine code

* fix convert dtype error

* fix import datafeeder error

* run dy2stat pure fp16 in Linear model

* no use self._pure_fp16_inputs

* add test and fix Adam error in dy2stat pure fp16 training

* use paddle.optimizer.Adam

* run test in gpu

* change test time for CI

* enlarge atol for test_resnet_pure_fp16

* refine code and enlarge atol

* make custom_white_list and custom_black_list take effect for AMP and pure fp16

* check tracer is not None

* use default atol

* change filter_size

* change atol and add some NOTE

[Dy2stat]Allow users to switch eval/train mode when using @to_static to decorate a function (#37383)

* Allow users to switch eval/train mode when using @to_static to decorate a function

* refine code for train() and eval()

* support `for i in [1,2,3]` statements in dy2stat

* add test case

* fix ci

* remove wrong code

* Support Py3 type annotations in @to_static

* support type hint for args in func

* support type hint assign

* if annotation and value(Constant) are diffent type, we use value type

* polish type_from_annotation()

* code format

* code format

* remove useless commentary

* fix review
Co-authored-by: NAurelius84 <zhangliujie@baidu.com>

* remove no_value using var.name

* fix unit test for CI

* fix unit test

* add test case

* fix test case

* add more test case

* catch the generatorfunction and intercept it.

* add test generator

* add test case

* refine the testcase

* change time to remove static tempfile

* delete remove_static_file() function

* fix no_grad context error in dy2stat

* remove useless comments

* fix error by drop_kids in python

* add test and fix review

* dy2stat_error: add revise suggestion for two error cases

* fix test_error

* fix review

* modify dy2stat error message in compile time

* fix variable name

* Support append method and initialized value for List in ControlFlow

* polish error msg and en doc

* fix code style

* integrated gast library

* integrated gast library

* fix unittest and remove ast2.py

* remove 'gast' from __all__ in __init__.py

* add copyright in other files

* fix copyright

* Support Mixed Precision training in @to_static

* fix block.vars logic

* fix GPU training loss diff

* remove unused code

* Add build_strategy in @to_static to support open pass

* fix os.environ

* add timeout

* disable test_build_strategy on openblas

Revert "Revert "[Dy2Stat] Refactor ExecutorCache logic and pre-support BuildStrategy for pass (#34181)" (#34348)" (#34384)

This reverts commit 577fdde5.

Revert "[Dy2Stat] Refactor ExecutorCache logic and pre-support BuildStrategy for pass (#34181)" (#34348)

This reverts commit 609f8225.

* modify into program_id

* fix cache_info declare problem

* fix python int to C long problem

* modify point to reference

* add ENVS

* support Nest sequtial container

* rename model path

* cache core.ops, test=develop

* refine, test=develop

* fix paddle.no_grad

* fix paddle.no_grad

* refine temp_scope_vec logic

* polish partial_program

* fix fake var

* add stop_gradient in spec

* fix fake_var

* fix unittest

* support type hint

* fix unittest

* del py2 code2

* fix test timeout

* support non-tensor type

* fix unittest failed

* add unittest with prune

* rm unused code

* coverage

* fix two or

* Modify into core.ops.run_program

* add DDout in core.ops.run_program

* fix typo

* add DOut

* fix typo

* put DOut last

* move data to CUDAPlace in advance

This PR made these changes to support double grad:

1. Translate `paddle.grad` to `paddle.static.gradients` to support double grad for dy2stat.
2. Fix IfElseTransformer bug which may not change value if "Store before Load" variable is in "Store" statement is in IfElse conditional statement
3. Add `DOut` to support double grad variables in `run_program_op`
4. Add support for renaming for double grads for `jit.save/load`

* Support convert sublayers in Sequential Container

* remove paddle.jit.set_code_level

* BugFix StaticAanlysis with gast.Subscript

* remove codes

Dy2stat failed when user writes return paddle.to_tensor(xxx), the reason is that visit_Expr doesn't work when the Expr is in return. Some other statements may trigger same bug. To fix it, we re-wrote a transformer to transform paddle.to_tensor to paddle.assign for all Call nodes.

* fix undefind var in For

* fix code style