提交 · 7ddfda85263890615791b63955b9f5ed28ea2eff · Greenplum / DeepSpeed

15 10月, 2020 1 次提交
- J
  Add support for p100 in transformer kernels (#470) · 7ddfda85
  由 Jeff Rasley 提交于 10月 14, 2020
```
add compute cap of 6.0, support p100
```
  7ddfda85
13 10月, 2020 3 次提交
- J
  
  revert previous (accidental) change · 1afca8f7
  由 Jeff Rasley 提交于 10月 12, 2020
  
  1afca8f7
- J
  add compute cap of 6.0 to transformer kernels · b8eb40eb
  由 Jeff Rasley 提交于 10月 12, 2020
```
add compute cap of 6.0 to transformer kernels
```
  b8eb40eb
- R
  
  fixing typo (#460) · e25f2a23
  由 Reza Yazdani 提交于 10月 12, 2020
  
  e25f2a23
11 10月, 2020 1 次提交

Add DeepSpeed_Adam optimizer (#468) · 23fc48f3

由 Olatunji Ruwase 提交于 10月 10, 2020

* Update installation instructions

* Format fix

* ZeRO tutorial

* Format fixes

* ZeRO-Offload

* ZeRO and ZeRO-Offload tutorials

* Update navigation page

* Format fixes

* Add yuxhe feedback

* Fix blog post link

* Fix OneBit-Adam link
Tweak scheduler example

* Fix date link

* Add DeepSpeed_Adam
Co-authored-by: NShaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>

23fc48f3

08 10月, 2020 1 次提交

Fix printing momentum for non-deepspeed optimizer (#464) · c39a76fe

由 Sylwester Klocek 提交于 10月 08, 2020

* Fix printing momentum for non-deepspeed optimizer

Fix printing momentum for non-deepspeed optimizer

* fix momentum access for Adam

fix momentum access for Adam

c39a76fe

07 10月, 2020 3 次提交
- N
  gan tutorial (#462) · 2efea694
  由 niumanar 提交于 10月 06, 2020
```
* gan tutorial

* formatting fix

* adding pointer to repo; adding navigation link
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
```
  2efea694
- J
  
  turning off different tests (temp) · 679fc135
  由 Jeff Rasley 提交于 10月 06, 2020
  
  679fc135
- J
  
  temporarily disable lr unit tests · 11cf47ef
  由 Jeff Rasley 提交于 10月 06, 2020
  
  11cf47ef
06 10月, 2020 1 次提交
- S
  Update engine.py (#458) · 67176383
  由 Sylwester Klocek 提交于 10月 05, 2020
```
Do not load optimizer states for fp32 if flag set to False.
```
  67176383
01 10月, 2020 1 次提交

Use parentesis around min and max to enable Windows build (#449) · 95575579

由 Bruno 提交于 10月 01, 2020

* Towards Windows build

* formatting
Co-authored-by: NBruno Cabral <bruno@potelo.com.br>
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>

95575579

30 9月, 2020 1 次提交
- O
  Disable default installation of CPU Adam (#450) · 7b8be2a7
  由 Olatunji Ruwase 提交于 9月 29, 2020
```
* Disable default installation of CPU Adam

* Handle cpufeature import/use errors separately
```
  7b8be2a7
28 9月, 2020 1 次提交
- H
  
  fix typos (#446) · 6f28ea30
  由 Haibin Lin 提交于 9月 28, 2020
  
  6f28ea30
25 9月, 2020 5 次提交
- S
  
  unit test rename (#442) · 5412a334
  由 Shaden Smith 提交于 9月 25, 2020
  
  5412a334
- S
  
  link fix part two :-) (#441) · 6d176c45
  由 Shaden Smith 提交于 9月 25, 2020
  
  6d176c45
- H
  
  Update pipeline.md (#439) · 0ca82156
  由 Haibin Lin 提交于 9月 24, 2020
  
  0ca82156
- C
  
  Update azure.md (#437) · 192cf7c8
  由 Conglong Li 提交于 9月 24, 2020
  
  192cf7c8
- C
  Fix urls in tutorial (#436) · 5d40f006
  由 Conglong Li 提交于 9月 24, 2020
```
* url fix

* revert absolute path but keep some actual fix

* add real readme
```
  5d40f006
22 9月, 2020 2 次提交
- R
  support dynamic sequence length in transformer kernels (#424) · f0f2a702
  由 RezaYazdaniAminabadi 提交于 9月 21, 2020
```
Co-authored-by: NConglong Li <conglong.li@gmail.com>
```
  f0f2a702
- S
  
  DSE bump (#427) · 71f7df39
  由 Shaden Smith 提交于 9月 21, 2020
  
  71f7df39
21 9月, 2020 1 次提交
- R
  
  Add configurable intermediate size to transformer kernels (#423) · a148bd33
  由 RezaYazdaniAminabadi 提交于 9月 21, 2020
  
  a148bd33
19 9月, 2020 3 次提交
- S
  
  Fix activation checkpoint unit tests for GPU systems (#421) · a825f996
  由 Shaden Smith 提交于 9月 18, 2020
  
  a825f996
- J
  Revert "Activation checkpointing bugfix and unit tests (#420)" (#422) · a74a604a
  由 Jeff Rasley 提交于 9月 18, 2020
```
This reverts commit 01b6e27e.
Co-authored-by: NShaden Smith <ShadenTSmith@gmail.com>
```
  a74a604a
- S
  Activation checkpointing bugfix and unit tests (#420) · 01b6e27e
  由 Shaden Smith 提交于 9月 18, 2020
```
* Activation checkpointing bugfix and unit tests.

* Activation checkpointing bugfix and unit tests.
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
```
  01b6e27e
18 9月, 2020 1 次提交
- J
  
  Remove pip --use-feature (#419) · 5bc7d4e1
  由 Jeff Rasley 提交于 9月 17, 2020
  
  5bc7d4e1
17 9月, 2020 6 次提交

G

Fix few typos in the docs (#418) · c66f3881
由 Gowtham Prudhvi 提交于 9月 17, 2020

c66f3881
S
readthedocs yaml configuration (#410) · 5812e845
由 Shaden Smith 提交于 9月 16, 2020
```
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
```
5812e845
H
Fix a typo in comments (#415) · 4fef478f
由 Haibin Lin 提交于 9月 16, 2020
```
* Update stage2.py
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
```
4fef478f
S
Overflow fix (#416) · f5cce75e
由 Shaden Smith 提交于 9月 16, 2020
```
* Switches fused_optimizer overflow calculation
```
f5cce75e

Minor doc fixes (#417) · 7d91be97

由 Olatunji Ruwase 提交于 9月 16, 2020

* Update installation instructions

* Format fix

* ZeRO tutorial

* Format fixes

* ZeRO-Offload

* ZeRO and ZeRO-Offload tutorials

* Update navigation page

* Format fixes

* Add yuxhe feedback

* Fix blog post link

* Fix OneBit-Adam link
Tweak scheduler example

* Fix date link
Co-authored-by: NShaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>

7d91be97

O
Add Linear warmup+decay lr schedule (#414) · 0e942df0
由 Olatunji Ruwase 提交于 9月 16, 2020
```
Update lr schedule unit tests
```
0e942df0

16 9月, 2020 2 次提交
- J
  
  add cpu-adam, reformat, add colors (#413) · a9e8325f
  由 Jeff Rasley 提交于 9月 15, 2020
  
  a9e8325f
- J
  
  fix bug related to stitching reduced grads across communication partitions (#318) · 55ed1057
  由 Jeff Rasley 提交于 9月 15, 2020
  
  55ed1057
15 9月, 2020 1 次提交
- J
  pytest skips for tests requiring certain ops (#411) · 91b4a93d
  由 Jeff Rasley 提交于 9月 15, 2020
```
* add pytest skips around tests that require certain ops to be installed
```
  91b4a93d
14 9月, 2020 1 次提交
- S
  
  scales throughput by logging freq (#408) · 473ff985
  由 Shaden Smith 提交于 9月 13, 2020
  
  473ff985
12 9月, 2020 1 次提交
- J
  Revert "supporting different intermediate sizes other than 4 * hidden_dim (#389)" (#404) · 4ac9bf60
  由 Jeff Rasley 提交于 9月 11, 2020
```
This reverts commit e549be60.
```
  4ac9bf60
11 9月, 2020 4 次提交
- R
  supporting different intermediate sizes other than 4 * hidden_dim (#389) · e549be60
  由 RezaYazdaniAminabadi 提交于 9月 11, 2020
```
* supporting different intermediate sizes other than 4*hidden_dim

* run precommit

* uncommnet the unit tests
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
```
  e549be60
- S
  
  readthedocs upgrade (#402) · c82756cd
  由 Shaden Smith 提交于 9月 10, 2020
  
  c82756cd
- J
  
  remove old pt file · 15ca99c6
  由 Jeff Rasley 提交于 9月 10, 2020
  
  15ca99c6
- O
  Update ZeRO-Offload blog post link (#401) · d15015e9
  由 Olatunji Ruwase 提交于 9月 10, 2020
```
Co-authored-by: NShaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
```
  d15015e9

Greenplum / DeepSpeed 上一次同步 大约 1 年

Greenplum / DeepSpeed
上一次同步大约 1 年