Skip to content

D
DeepSpeed

Greenplum / DeepSpeed
上一次同步 11 个月

通知 10
Star 0
Fork 0
D
DeepSpeed

前往新版Gitcode，体验更适合开发者的 AI 搜索 >>

提交 932268a4 编写于 作者: O Olatunji Ruwase
浏览文件
操作

Update configuration jsons for new apex

上级 5ac1848c
隐藏空白更改
内联 并排
Showing with 6 addition and 0 deletion
tests/model/Megatron_GPT2/ds_config_func_bs4.json
浏览文件 @ 932268a4
......@@ -5,6 +5,7 @@
"zero_optimization": true,
"optimizer": {
"type": "Adam",
"legacy_fusion": false,
"params": {
"lr": 0.00015,
"max_grad_norm": 1.0
......
tests/model/Megatron_GPT2/ds_config_func_bs8.json
浏览文件 @ 932268a4
......@@ -5,6 +5,7 @@
"zero_optimization": true,
"optimizer": {
"type": "Adam",
"legacy_fusion": false,
"params": {
"lr": 0.00015,
"max_grad_norm": 1.0
......
tests/model/Megatron_GPT2/ds_config_func_scheduler.json
浏览文件 @ 932268a4
......@@ -5,6 +5,7 @@
"zero_optimization": true,
"optimizer": {
"type": "Adam",
"legacy_fusion": false,
"params": {
"lr": 0.00015,
"max_grad_norm": 1.0
......
tests/model/Megatron_GPT2/ds_config_perf_bs16.json
浏览文件 @ 932268a4
......@@ -6,6 +6,7 @@
"disable_allgather": true,
"optimizer": {
"type": "Adam",
"legacy_fusion": false,
"params": {
"lr": 0.00015,
"max_grad_norm": 1.0
......
tests/model/Megatron_GPT2/ds_config_perf_bs32.json
浏览文件 @ 932268a4
......@@ -6,6 +6,7 @@
"disable_allgather": true,
"optimizer": {
"type": "Adam",
"legacy_fusion": false,
"params": {
"lr": 0.00015,
"max_grad_norm": 1.0
......
tests/model/Megatron_GPT2/ds_config_perf_bs8.json
浏览文件 @ 932268a4
......@@ -6,6 +6,7 @@
"disable_allgather": true,
"optimizer": {
"type": "Adam",
"legacy_fusion": false,
"params": {
"lr": 0.00015,
"max_grad_norm": 1.0
......
Markdown is supported
0% 或 .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑！
想要评论请 注册 或