- 08 10月, 2022 2 次提交
-
-
由 lekurile 提交于
Update the isinstance check inside the `replace_wo_policy` function to `tuple` and `str` instead of `dict`, since the layers are provided as a `tuple` type. Co-authored-by: NLev Kurilenko <lekurile@microsoft.com> Co-authored-by: NMolly Smith <mosm@microsoft.com> Co-authored-by: NLok Chand Koppaka <lokoppak@microsoft.com> Co-authored-by: NAmmar Ahmad Awan <ammar.awan@microsoft.com>
-
由 Michael Wyatt 提交于
-
- 06 10月, 2022 1 次提交
-
-
由 Thomas-MMJ 提交于
-
- 05 10月, 2022 2 次提交
-
-
由 Arash Bakhtiari 提交于
-
由 Michael Wyatt 提交于
* batch of refactored tests * more test refactoring * fp16 test refactor * more refactors * added DistributedFixture class * applied DistributedFixture to first batch of tests as a trial * added DistributedFixture test and documentation * last tests * fixes for refactored tests * remove subdirs in workflow files * fix pytest syntax error * fix another syntax error * update imports * use DistFixture with elastic checkpoint test * missing import * update to shared class tmpdir for elastic test * moved test files * avoid duplicate test file name * last refactor and moving test files * formatting * fix broken import * testing forked AMD tests * update abstract method * use blob storage for accelerate and transformers tests * upgrade torch for acclerate CI Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>
-
- 30 9月, 2022 1 次提交
-
-
由 Matt Smith 提交于
-
- 28 9月, 2022 4 次提交
-
-
由 Molly Smith 提交于
* Collect error messages in results.csv Co-authored-by: NMichael Wyatt <michaelwyatt@microsoft.com> Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>
-
由 Arash Bakhtiari 提交于
Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>
-
由 Arash Bakhtiari 提交于
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
-
由 Arash Bakhtiari 提交于
Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com> Co-authored-by: NMichael Wyatt <michaelwyatt@microsoft.com>
-
- 27 9月, 2022 5 次提交
-
-
由 Guanhua Wang 提交于
* format * remove round fn
-
由 Jeff Rasley 提交于
-
由 Jeff Rasley 提交于
-
由 Arash Bakhtiari 提交于
Co-authored-by: NReza Yazdani <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
-
由 Michael Wyatt 提交于
Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>
-
- 26 9月, 2022 3 次提交
-
-
由 Jean-Louis Queguiner 提交于
Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>
-
由 Saeyeol Lee 提交于
Co-authored-by: NSaeyeol Lee <sylee@si-anlaytics.ai> Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>
-
由 Connor Holmes 提交于
* Unify macro definitions and constants in a single file * Conversion utility implementation. * Fix reversion from formatting * Bugfixes after testing with correct DeepSpeed * Inline markers are available on both HIP + CUDA
-
- 24 9月, 2022 2 次提交
-
-
由 Ammar Ahmad Awan 提交于
Co-authored-by: NJeff Rasley <jerasley@microsoft.com> Co-authored-by: NMichael Wyatt <michaelwyatt@microsoft.com>
-
由 Jeff Rasley 提交于
-
- 23 9月, 2022 3 次提交
-
-
由 Connor Holmes 提交于
Co-authored-by: NReza Yazdani <44502768+RezaYazdaniAminabadi@users.noreply.github.com> Co-authored-by: NReza Yazdani <reyazda@microsoft.com> Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
-
由 Jeff Rasley 提交于
-
由 Guanhua Wang 提交于
* mem access for quantize kernel * format * format fp32 * modify quant kernel * modify quant kernel2 * modify format * format * fix comments in pytest * fix comments in pytest * format * rerun Co-authored-by: NAmmar Ahmad Awan <ammar.awan@microsoft.com> Co-authored-by: NConnor Holmes <connorholmes@microsoft.com>
-
- 22 9月, 2022 2 次提交
-
-
由 Arash Bakhtiari 提交于
Co-authored-by: NAmmar Ahmad Awan <ammar.awan@microsoft.com>
-
由 Sam Ade Jacobs 提交于
* Fix formatting * Remove redundant variable
-
- 20 9月, 2022 2 次提交
-
-
由 Sam Ade Jacobs 提交于
MOE residual matmul unit tests Co-authored-by: NMichael Wyatt <michaelwyatt@microsoft.com> Co-authored-by: NAmmar Ahmad Awan <ammar.awan@microsoft.com>
-
由 Jeff Rasley 提交于
-
- 17 9月, 2022 1 次提交
-
-
由 Michael Wyatt 提交于
-
- 15 9月, 2022 2 次提交
-
-
由 Jeff Rasley 提交于
-
由 Guanhua Wang 提交于
* add quant unit test * add codeowner * format fix * fix undefined symbol: curandSetPseudoRandomGeneratorSeed * modify ref fn name and add comment * add comments * add 4bit quant 16groups * fix * modify groups in ref code * parameterize tensor shape * single param * detach tensor * remove -lcurand flag * add back -lcurand flag Co-authored-by: NAmmar Ahmad Awan <ammar.awan@microsoft.com>
-
- 14 9月, 2022 4 次提交
-
-
由 Michael Wyatt 提交于
-
由 Olatunji Ruwase 提交于
-
由 Olatunji Ruwase 提交于
-
由 Olatunji Ruwase 提交于
* ZeRO-Inference blog * ZeRO-Inference blog * Format fixes * Apply feedback * Feedback * Update docs/_posts/2022-08-27-zero-inference.md Co-authored-by: NStas Bekman <stas00@users.noreply.github.com> * Update docs/_posts/2022-08-27-zero-inference.md Co-authored-by: NStas Bekman <stas00@users.noreply.github.com> * Address feedback * Format fixes * More tweaks * long sequence, nvme offload * Add image Co-authored-by: NStas Bekman <stas00@users.noreply.github.com> Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
-
- 13 9月, 2022 4 次提交
-
-
由 Michael Wyatt 提交于
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
-
由 Jeff Rasley 提交于
-
由 Arash Bakhtiari 提交于
-
由 Arash Bakhtiari 提交于
-
- 10 9月, 2022 2 次提交
-
-
由 Michael Wyatt 提交于
Co-authored-by: NReza Yazdani <44502768+RezaYazdaniAminabadi@users.noreply.github.com> Co-authored-by: NJeff Rasley <jerasley@microsoft.com> Co-authored-by: NSam Ade Jacobs <samjacobs@microsoft.com>
-
由 Molly Smith 提交于
-