* set parallel_job according to CUDA memory

* fix bug: add whitespace between conten and [] or condition wont work

* Add dependency for read op in standalone executor

* Fix CI errors

* Add UT

* add_dependency -> dependency_utils

* Fix CI errors

* Enable test_tesnsordot

* Fix CI errors

* Disable windows inference test

* Fix typos

* Fix typos

* Fix CI errors

* Remove disable_wingpu11_test

* copy onnxruntime.dll to c++ test folder in windows

* remove ut that failed due to onnxrumtime.dll

* test_api_impl failed of diff

* use TARGET to make sure if the test exist; use POST_BUILD to add copy command

* open ut in windows-inference;test=document_fix;test=windows_ci_inference

* test=document_fix;test=windows_ci_inference;disable failed tests temporarily in windows-inference

* open inference_ut;test=windows_ci_inference

* inference_ut need onnx;test=windows_ci_inference

* disable trt_split_converter_test; use higher parallel level

* too high parallel will cause ut timeout

Enhance vjp/jvp/Jacobian/Hessian API for supporting dynamic, static graph and batched, unbatched mode (#40692)

* modify vjp/jvp for both dynamic and static graph

* enforce jacobian class for supporting first/last batch

* add unittest for jvp, jacobian withlast batch, jacobian with first batch

* fix the incorrect shape when multi-index Jacobian

* enforce Hessian class for supporting dynamic graph

* add Hessian class unittest

* bugfix, jvp double_backward_trick zeros_like return stop_gradient=True in static graph

* add API beta warnnings

* add white_list for cuda11.x ci windows.

* optimize some code snippets and documments

* set unittest timeout to 100 seconds

* move vjp,jvp,Jacobian,Hessian to incubate

* fix vjp,vjp import path of sample code

* fix code style error of augtograd/__init__ file

* test inference_api_test when run in windows-inference ci

* test if test failed the code run correctly

* put the failed test back

* modify for wincheck-inference case

* modify according to zhouwei's comment

* open with_trt and block failed unittests in windows

* test

* for pure fp16

* opt topk

* modify for wincheck-inference case

* modify according to zhouwei's comment

* modify according to zhouwei's comment 2nd time
Co-authored-by: Nzhangkaihuo <zhangkaihuo@baidu.com>

* modify unittest's parallel num

* modify unittest's parallel num

* open test_resnet_amp on Windows

* disable on Windows CPU CI for timeout

* disable on Windows CPU CI for timeout

* fix code style

* Add model for ResNet50 for Dy2stat AMP training

* fix timeout

* fix dataloader

* Add build_strategy in @to_static to support open pass

* fix os.environ

* add timeout

* disable test_build_strategy on openblas

* Refine Constructor logic of ParallelExecutor

* Replace executor into ParallelExecutor in run_program_op

* Optimizing prec process on windows

* fix bug

* fix windows CI

* fix windows CI

* clear CUDA compile environment on windows

* fix Windows CI

* fix Windows CI

* fix Windows CI

* fix error for long args

* remove unneccessary code

* test,test,notest,test=windows_ci

* test,notest,test=windows_ci

* test,notest,test=windows_ci

* test,notest,test=windows_ci

* remove test code

* delete some unnecessary logs

* fix format error

* turn on added ut check on windows

* added ut check on windows,notest,test=windows_ci

* debug,notest,test=windows_ci

* debug,notest,test=windows_ci

* fix bug,notest,test=windows_ci

* added ut check

* test for new ut add on windows

* test,notest,test=windows_ci

* fix bug,notest,test=windows_ci

* test

* test

* test

* test,notest,test=windows_ci

* test,notest,test=windows_ci

* check added ut on windows

* only fetch upstream develop

* modified according comment

* Update run_unittests.sh

* Update run_unittests.sh

* use busybox run test on windows openblas

* fix error

* fix disable_quick and nightly lable issue

* add retry on windows openblas

* fix bug

* use one file to run cpu and gpu tests

* fix with grep warning

* fix syntax error

* change run_unittest to run_unittest_gpu

* Update run_unittests.sh

fix error

* [Parallel UT]improve Parallel UT level on Windows/Linux

* [Parallel UT]improve Parallel UT level on Windows/Linux

* [Parallel UT]Improve Parallel UT level on Windows/Linux

* [Parallel UT]Improve Parallel UT level on Windows/Linux

* fix CI

* Second optimization of retry method

* fix show_ut_retry_result repeat execuate

* fix wget with no proxy on windows

* modified import packages

* fix format error

* fix bug

* fix format error

* fix format error

* add precision test for windows ci exclude check_added_ut

* fix error

* added PRECISION_TEST parameters

* fix format error

* fix modified_retry_method_only_win

* fix bug

* fix retry bug on windows

* set WITH_INFERENCE_API_TEST=ON on Windows with GPU, notest, test=windows_ci

* disable lite_mul_model_test, test=develop

* disable test_analyzer_int8_resnet50, test=develop

Try to remove test_fuse_elewise_add_act_pass from the black list of running unittest on windows. (#30282)