Configure for legacy optimizer fusion

109a5147 · Olatunji Ruwase · a87ab905 · 109a5147
隐藏空白更改
内联并排

Showing with 2 addition and 2 deletion

tests/model/Megatron_GPT2/ds_config_func_bs8_no_zero.json tests/model/Megatron_GPT2/ds_config_func_bs8_no_zero.json +2 -2

未找到文件。
--- a/tests/model/Megatron_GPT2/ds_config_func_bs8_no_zero.json
+++ b/tests/model/Megatron_GPT2/ds_config_func_bs8_no_zero.json
@@ -5,9 +5,9 @@
  "zero_optimization": false,
  "optimizer": {
    "type": "Adam",
+    "legacy_fusion": false,
    "params": {
-      "lr": 0.00015,
-      "max_grad_norm": 1.0
+      "lr": 0.00015
    }
  },