diff --git a/docs/_pages/config-json.md b/docs/_pages/config-json.md index 3efc2ced025f420bfe997cebf3c53edce15d034c..d5ca5fbbb6d0ed2a84d40d6ea30c8f7eeb932cd4 100755 --- a/docs/_pages/config-json.md +++ b/docs/_pages/config-json.md @@ -34,7 +34,7 @@ title: "DeepSpeed Configuration JSON" | Fields | Value | Example | | ------ | ------------------------------------------------------------ | ------------------------------ | -| type | The optimizer name. DeepSpeed natively supports **Adam**, **OneBitAdam**, and **Lamb** optimizers and will import other optimizers from [torch](https://pytorch.org/docs/stable/optim.html). | `"Adam"` | +| type | The optimizer name. DeepSpeed natively supports **Adam**, **AdamW**, **OneBitAdam**, and **Lamb** optimizers and will import other optimizers from [torch](https://pytorch.org/docs/stable/optim.html). | `"Adam"` | | params | Dictionary of parameters to instantiate optimizer. The parameter names must match the optimizer constructor signature (e.g., for [Adam](https://pytorch.org/docs/stable/optim.html#torch.optim.Adam)). | `{"lr": 0.001, "eps": 1e-8}` | Example of ***optimizer*** with Adam