* add index sample fp16 support

* remove fluid APIs in distributed_strategy.py and role_maker.py

* Revert "remove fluid APIs in distributed_strategy.py and role_maker.py"

This reverts commit 223bbee990d3bf69e252fc3c0f19e3873550a264.

* remove fluid APIs in distributed_strategy.py and role_maker.py

* remove index sample op changes

* remove fluid APIs under fleet.base

* remove fluid APIs under fleet.layers.mpu

* remove fluid APIs under fleet.meta_optimizers

* fix fluid error

* fix util_factory.py

* reset fluid.io.load_inference_model API

* remove dygraph.parallel.prepare_context

* remove fluid.dygraph.StaticModelRunner API

* remove split_lod_tensor merge_lod_tensor

* remove unittests

* delete FLAGS_enable_eager_mode

* 修改.gitigore文件，把ljd_sh文件忽略掉

* 取消ljd_sh文件忽略

* fix ci bug

* fix windows ci bug

* fix bug ci

* fix bug test

* fix bug test

* set parallel_job according to CUDA memory

* fix bug: add whitespace between conten and [] or condition wont work

* Add dependency for read op in standalone executor

* Fix CI errors

* Add UT

* add_dependency -> dependency_utils

* Fix CI errors

* Enable test_tesnsordot

* Fix CI errors

* Disable windows inference test

* Fix typos

* Fix typos

* Fix CI errors

* Remove disable_wingpu11_test

* copy onnxruntime.dll to c++ test folder in windows

* remove ut that failed due to onnxrumtime.dll

* test_api_impl failed of diff

* use TARGET to make sure if the test exist; use POST_BUILD to add copy command

* open ut in windows-inference;test=document_fix;test=windows_ci_inference

* test=document_fix;test=windows_ci_inference;disable failed tests temporarily in windows-inference

* open inference_ut;test=windows_ci_inference

* inference_ut need onnx;test=windows_ci_inference

* disable trt_split_converter_test; use higher parallel level

* too high parallel will cause ut timeout

Enhance vjp/jvp/Jacobian/Hessian API for supporting dynamic, static graph and batched, unbatched mode (#40692)

* modify vjp/jvp for both dynamic and static graph

* enforce jacobian class for supporting first/last batch

* add unittest for jvp, jacobian withlast batch, jacobian with first batch

* fix the incorrect shape when multi-index Jacobian

* enforce Hessian class for supporting dynamic graph

* add Hessian class unittest

* bugfix, jvp double_backward_trick zeros_like return stop_gradient=True in static graph

* add API beta warnnings

* add white_list for cuda11.x ci windows.

* optimize some code snippets and documments

* set unittest timeout to 100 seconds

* move vjp,jvp,Jacobian,Hessian to incubate

* fix vjp,vjp import path of sample code

* fix code style error of augtograd/__init__ file

* test inference_api_test when run in windows-inference ci

* test if test failed the code run correctly

* put the failed test back

* modify for wincheck-inference case

* modify according to zhouwei's comment

* open with_trt and block failed unittests in windows

* test

* for pure fp16

* opt topk

* modify for wincheck-inference case

* modify according to zhouwei's comment

* modify according to zhouwei's comment 2nd time
Co-authored-by: Nzhangkaihuo <zhangkaihuo@baidu.com>

* modify unittest's parallel num

* modify unittest's parallel num

* open test_resnet_amp on Windows

* disable on Windows CPU CI for timeout

* disable on Windows CPU CI for timeout

* fix code style

* Add model for ResNet50 for Dy2stat AMP training

* fix timeout

* fix dataloader

* Add build_strategy in @to_static to support open pass

* fix os.environ

* add timeout

* disable test_build_strategy on openblas

* Refine Constructor logic of ParallelExecutor

* Replace executor into ParallelExecutor in run_program_op

* Optimizing prec process on windows

* fix bug

* fix windows CI

* fix windows CI

* clear CUDA compile environment on windows

* fix Windows CI

* fix Windows CI

* fix Windows CI

* fix error for long args

* remove unneccessary code

* test,test,notest,test=windows_ci

* test,notest,test=windows_ci

* test,notest,test=windows_ci

* test,notest,test=windows_ci

* remove test code

* delete some unnecessary logs

* fix format error

* turn on added ut check on windows

* added ut check on windows,notest,test=windows_ci

* debug,notest,test=windows_ci

* debug,notest,test=windows_ci

* fix bug,notest,test=windows_ci

* added ut check

* test for new ut add on windows

* test,notest,test=windows_ci

* fix bug,notest,test=windows_ci

* test

* test

* test

* test,notest,test=windows_ci

* test,notest,test=windows_ci

* check added ut on windows

* only fetch upstream develop

* modified according comment

* Update run_unittests.sh

* Update run_unittests.sh

* use busybox run test on windows openblas

* fix error

* fix disable_quick and nightly lable issue

* add retry on windows openblas

* fix bug

* use one file to run cpu and gpu tests

* fix with grep warning

* fix syntax error

* change run_unittest to run_unittest_gpu

* Update run_unittests.sh

fix error

* [Parallel UT]improve Parallel UT level on Windows/Linux

* [Parallel UT]improve Parallel UT level on Windows/Linux

* [Parallel UT]Improve Parallel UT level on Windows/Linux

* [Parallel UT]Improve Parallel UT level on Windows/Linux

* fix CI

* Second optimization of retry method

* fix show_ut_retry_result repeat execuate

* fix wget with no proxy on windows

* modified import packages

* fix format error

* fix bug

* fix format error

* fix format error

* add precision test for windows ci exclude check_added_ut

* fix error

* added PRECISION_TEST parameters

* fix format error

* fix modified_retry_method_only_win

* fix bug

* fix retry bug on windows