diff --git a/docs/_pages/config-json.md b/docs/_pages/config-json.md index 423dc5f85d233194b40764a90e5edb80613ca0cf..0d049b57c6a29507c07f879a0dd84789aad69929 100755 --- a/docs/_pages/config-json.md +++ b/docs/_pages/config-json.md @@ -373,7 +373,7 @@ Enabling and configuring ZeRO memory optimizations | Description | Default | | --------------------------------------------------------------------------------------------------------- | ------- | -| Enable ZeRO memory optimization wrapper for FP16 Training. Currently compatible only with Adam optimizer. | `false` | +| Enable ZeRO memory optimizations, compatible with FP16/BF16/FP32 and the Adam optimizer. | `false` | **stage**: [integer]