- 14 7月, 2020 1 次提交
-
-
由 Jeff Rasley 提交于
* add amp docs
-
- 12 7月, 2020 1 次提交
-
-
由 Jeff Rasley 提交于
* add amp support for deepspeed (non-ZeRO) * tests for amp mode
-
- 07 7月, 2020 1 次提交
-
-
由 Olatunji Ruwase 提交于
* Load non-DeepSpeed checkpoints into ZeRO optimizer * Handle parameters smaller than DP * Formatting fixes * Handle empty partitions * Fix perf bug Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
-
- 30 6月, 2020 1 次提交
-
-
由 Jeff Rasley 提交于
-
- 26 6月, 2020 1 次提交
-
-
由 Jeff Rasley 提交于
-
- 24 6月, 2020 2 次提交
-
-
由 Conglong Li 提交于
* syntax/typo fix * add README for documentation * fix links * update navigation * typo fix * docs readme fix
-
由 Olatunji Ruwase 提交于
* Load non-DeepSpeed checkpoints into ZeRO optimizer * Handle parameters smaller than DP * Formatting fixes
-
- 20 6月, 2020 4 次提交
-
-
由 Shaden Smith 提交于
-
由 Samyam Rajbhandari 提交于
* Removing handle_overflow debugging code in deepspeed_utils.py * Removing handle_overflow debugging code in deepspeed_zero_optimizer.py Removing unnecessary overflow handle code. Not sure why it was there in the first place.
-
由 Shaden Smith 提交于
This reverts commit 54c0267e.
-
由 Tunji Ruwase 提交于
-
- 18 6月, 2020 2 次提交
-
-
由 Shaden Smith 提交于
-
由 Jeff Rasley 提交于
-
- 17 6月, 2020 2 次提交
-
-
由 Shaden Smith 提交于
-
由 RezaYazdaniAminabadi 提交于
* add the fine-tuning results * updating tutorial and blog-post * updated the tutorials and links
-
- 12 6月, 2020 1 次提交
-
-
由 Chunyang Wen 提交于
-
- 10 6月, 2020 1 次提交
-
-
由 Jeff Rasley 提交于
* install update: no-sudo + clean build files Co-authored-by: NShaden Smith <Shaden.Smith@microsoft.com>
-
- 09 6月, 2020 1 次提交
-
-
由 eltonzheng 提交于
-
- 06 6月, 2020 1 次提交
-
-
由 Olatunji Ruwase 提交于
* Debugging * Fix step() bug; Make step timing optional * Remove unnecessary changes * Format fixes * Replace list with scalar variable * Remove redundant code * Fix typo
-
- 05 6月, 2020 4 次提交
-
-
由 Jeff Rasley 提交于
-
由 Vidush Vishwanath 提交于
-
由 Chunyang Wen 提交于
* Add log util * replace all occurrences of print and logging * address format * disable propagate to avoid duplicate log
-
由 Shaden Smith 提交于
* links and formatting
-
- 04 6月, 2020 2 次提交
-
-
由 Ammar Ahmad Awan 提交于
Co-authored-by: NAmmar Ahmad Awan <ammar.awan@microsoft.com> -
由 eltonzheng 提交于
-
- 30 5月, 2020 9 次提交
-
-
由 Jeff Rasley 提交于
-
由 Samyam Rajbhandari 提交于
-
由 Shaden Smith 提交于
-
由 Jeff Rasley 提交于
-
由 Shaden Smith 提交于
-
由 Shaden Smith 提交于
-
由 Jeff Rasley 提交于
-
由 Jeff Rasley 提交于
-
由 Jeff Rasley 提交于
* Transformer kernels release Co-authored-by: NShaden Smith <ShadenTSmith@gmail.com> Co-authored-by: NElton Zheng <eltonz@microsoft.com> Co-authored-by: NReza Yazdani <reyazda@microsoft.com> Co-authored-by: NRezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com> Co-authored-by: NTunji Ruwase <olruwase@microsoft.com> Co-authored-by: NShaden Smith <ShadenTSmith@gmail.com> Co-authored-by: NShaden Smith <Shaden.Smith@microsoft.com> Co-authored-by: NSamyam Rajbhandari <samyamr@microsoft.com> Co-authored-by: NShaden Smith <ShadenTSmith@gmail.com> Co-authored-by: NJeff Rasley <jerasley@microsoft.com> Co-authored-by: NSamyam Rajbhandari <samyamr@microsoft.com> Co-authored-by: NShaden Smith <ShadenTSmith@gmail.com> Co-authored-by: NElton Zheng <eltonz@microsoft.com> Co-authored-by: NReza Yazdani <reyazda@microsoft.com> Co-authored-by: NRezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com> Co-authored-by: NTunji Ruwase <olruwase@microsoft.com> Co-authored-by: NShaden Smith <Shaden.Smith@microsoft.com> Co-authored-by: NSamyam Rajbhandari <samyamr@microsoft.com>
-
- 29 5月, 2020 1 次提交
-
-
由 Chunyang Wen 提交于
* fix: typo in code docs * more pythonic code
-
- 28 5月, 2020 5 次提交
-
-
由 Chunyang Wen 提交于
Co-authored-by: NShaden Smith <Shaden.Smith@microsoft.com> Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
-
由 Jeff Rasley 提交于
-
由 Jeff Rasley 提交于
* add support for predivide as a flag * add predivide json config, remove allgather_disable (as it's not currently used anymore)
-
由 Samyam Rajbhandari 提交于
Contiguous Gradients should be set to false by default. Its not useful unless the model is very large
-
由 Samyam Rajbhandari 提交于
* Fix for CPU memory Bloating Issue caused by pyorch backward graph creation in allgather. Fixed by calling detach on tensors before calling all_gather * Fix for CPU memory Bloating Issue caused by pyorch backward graph creation in allgather. Fixed by calling detach on tensors before calling all_gather * Fix for CPU memory Bloating Issue caused by pyorch backward graph creation in allgather. Fixed by calling detach on tensors before calling all_gather
-