* Refine ProgramCache.last and Return recent one

* add comment

* fix unittest

* refine Assign

* add UT

* close enable_inplace PASS for PE, and test dy2st pure fp16 training stability

* add some comment

* enlarge atol

* fix error when set buffer in forward

* add unittest

* refine class name

* refine not framework.in_dygraph_mode() in if

* fix UT error

* add comment

* refine code

* remove useless import

* fix error when calling sublayer's non-forward func in dy2stat

* fix circular import using an inelegant way

* deal with parameters

* remove param_guard in __call__

* remove comment

* fix error when jit.load

* rename block var

* remove wrong code

* add unit test

* Consider InputSpec.name to calculate Cachekey hash id

* fix function

* fix error when tensor_shape_transformer. Before in stmt like `if len(paddle.shape(x)[0]) > 0`, `paddle` will be used as a variable

* handle other call like `fluid.layers.mean` and `fluid.layers.shape`

* add unit test

* allow ifelse return `int` in paddle cond

* add test and refine code

* polish code, add test

* code format

* remove outer comment when dy2stat

* remove all comment

* add unit test

* polish for zip in dy2stat

* polish comment

* polish is_builtin_len

* fix comment

* fix test_mnist_pure_fp16

* change batch_id

* run dy2stat pure fp16 in Linear model

* no use self._pure_fp16_inputs

* add test and fix Adam error in dy2stat pure fp16 training

* use paddle.optimizer.Adam

* run test in gpu

* change test time for CI

* enlarge atol for test_resnet_pure_fp16

* refine code and enlarge atol

* make custom_white_list and custom_black_list take effect for AMP and pure fp16

* check tracer is not None

* use default atol

* change filter_size

* change atol and add some NOTE

[Dy2stat]Allow users to switch eval/train mode when using @to_static to decorate a function (#37383)

* Allow users to switch eval/train mode when using @to_static to decorate a function

* refine code for train() and eval()

* support `for i in [1,2,3]` statements in dy2stat

* add test case

* fix ci

* remove wrong code

* Support Py3 type annotations in @to_static

* support type hint for args in func

* support type hint assign

* if annotation and value(Constant) are diffent type, we use value type

* polish type_from_annotation()

* code format

* code format

* remove useless commentary

* fix review
Co-authored-by: NAurelius84 <zhangliujie@baidu.com>

* remove no_value using var.name

* fix unit test for CI

* fix unit test

* add test case

* fix test case

* add more test case

* catch the generatorfunction and intercept it.

* add test generator

* add test case

* refine the testcase

* fix no_grad context error in dy2stat

* remove useless comments

* fix error by drop_kids in python

* add test and fix review

* dy2stat_error: add revise suggestion for two error cases

* fix test_error

* fix review

* open test_resnet_amp on Windows

* disable on Windows CPU CI for timeout

* disable on Windows CPU CI for timeout

* fix code style

* modify dy2stat error message in compile time

* fix variable name

* Support append method and initialized value for List in ControlFlow

* polish error msg and en doc

* fix code style

* Add model for ResNet50 for Dy2stat AMP training

* fix timeout

* fix dataloader

* integrated gast library

* integrated gast library

* fix unittest and remove ast2.py

* remove 'gast' from __all__ in __init__.py

* add copyright in other files

* fix copyright

* support bool dtype for paddle.sum

* Support Mixed Precision training in @to_static

* fix block.vars logic

* fix GPU training loss diff

* remove unused code

* supplement the function of slice

* edit unittest

* strided_slice_op support .

* polish error message.

* polish error message.

* polish code.

* polish unittest.

* polish code.

* polish code

* polish error message.

* Add build_strategy in @to_static to support open pass

* fix os.environ

* add timeout

* disable test_build_strategy on openblas

Revert "Revert "[Dy2Stat] Refactor ExecutorCache logic and pre-support BuildStrategy for pass (#34181)" (#34348)" (#34384)

This reverts commit 577fdde5.

Revert "[Dy2Stat] Refactor ExecutorCache logic and pre-support BuildStrategy for pass (#34181)" (#34348)

This reverts commit 609f8225.

* modify into program_id

* fix cache_info declare problem

* fix python int to C long problem

* modify point to reference

* add ENVS

* support Nest sequtial container

* rename model path

* change strided_slice when step<0.

* add unittest for paddle.strided_slice

* polish unittest

* Refine Constructor logic of ParallelExecutor

* Replace executor into ParallelExecutor in run_program_op