Co-authored-by: Ncmikeh2 <connorholmes@microsoft.com>

Add blob storage to CI runners and enable for transformers cache on inference tests

* Correctly detect CPU optimizer usage

* Update nv-transformers-v100.yml (#2259)
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>

Refactor Distributed unit tests

re-enable AMD CI with some modifications

Fix for distributed tests
Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>

Co-authored-by: NJeff Rasley <jerasley@microsoft.com>

* assert no FP16 with AMD CPUs

* add unit test for AMD assert error

* missing import

* downgrade assert to warning

* fix to catch assert error for inference test imports

* fix wrong syntax

* changed to sequential inf tests

* fix for lm_eval import

* added environment check fixture

* added expected torch and cuda version

* check various version depth for cuda/torch
Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>

Co-authored-by: NReza Yazdani <reyazda@microsoft.com>
Co-authored-by: NMichael Wyatt <michaelwyatt@microsoft.com>
Co-authored-by: NReza Yazdani <44502768+RezaYazdaniAminabadi@users.noreply.github.com>

Co-authored-by: NJeff Rasley <jerasley@microsoft.com>

Co-authored-by: NJeff Rasley <jerasley@microsoft.com>

* added concurrency to github actions

* fixed problem where one workflow can cancel another workflow

* added tmp file to help test concurrency policy on CI

* removed tmp file to finish testing concurrency policy

Co-authored-by: NJeff Rasley <jerasley@microsoft.com>

Co-authored-by: NConglong Li <conglong.li@gmail.com>
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>

Co-authored-by: NJeff Rasley <jerasley@microsoft.com>

Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>
Co-authored-by: NJithun Nair <jithun.nair@amd.com>
Co-authored-by: Nrraminen <rraminen@amd.com>
Co-authored-by: NJeff Daily <jeff.daily@amd.com>
Co-authored-by: Nokakarpa <okakarpa@amd.com>
Co-authored-by: Nrraminen <rraminen@amd.com>
Co-authored-by: NJithun Nair <37884920+jithunnair-amd@users.noreply.github.com>
Co-authored-by: NJeff Daily <jeff.daily@amd.com>
Co-authored-by: Nokakarpa <okakarpa@amd.com>
Co-authored-by: NRamya Ramineni <62723901+rraminen@users.noreply.github.com>

* Add a very simple PyTorch Lightning test

* Run for just one epoch

* Swap to using the plugin API till the strategy API makes it to 1.6

Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>

force set lf instead of crlf (https://github.com/pre-commit/pre-commit-hooks#mixed-line-ending) (#1598)

* [squash] Staging autotuning v4
Co-authored-by: NCheng Li <pistasable@gmail.com>
Co-authored-by: NMinjia Zhang <minjiaz@microsoft.com>
Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>

* add new extra, guard xgboost, cleanup dead files (#268)

* Fix autotuning docs (#1553)

* fix docs

* rewording the goal

* fix typos

* fix typos (#1556)

* fix typos

* fix format

* fix bug (#1557)

* fix bug
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
Co-authored-by: NMinjia Zhang <minjiaz@microsoft.com>
Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>

Co-authored-by: NJeff Rasley <jerasley@microsoft.com>

HF tests `image-classification` requirements have been fixed to not require pt-1.9

Co-authored-by: NJeff Rasley <jerasley@microsoft.com>

* install HF w. dev extra to get all required packages

* switch ds.init to use param dict instead of json file on disk

* switch back to 'testing' extra

Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
Co-authored-by: NStas Bekman <stas00@users.noreply.github.com>
Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>

Co-authored-by: NReza Yazdani <reyazda@microsoft.com>