From 76de924b93e5c3b4790d15b106e16bb5eaeb80be Mon Sep 17 00:00:00 2001 From: Jeff Rasley Date: Fri, 23 Sep 2022 13:08:38 -0700 Subject: [PATCH] fix zero docs (#2350) --- docs/_pages/config-json.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/_pages/config-json.md b/docs/_pages/config-json.md index 423dc5f8..0d049b57 100755 --- a/docs/_pages/config-json.md +++ b/docs/_pages/config-json.md @@ -373,7 +373,7 @@ Enabling and configuring ZeRO memory optimizations | Description | Default | | --------------------------------------------------------------------------------------------------------- | ------- | -| Enable ZeRO memory optimization wrapper for FP16 Training. Currently compatible only with Adam optimizer. | `false` | +| Enable ZeRO memory optimizations, compatible with FP16/BF16/FP32 and the Adam optimizer. | `false` | **stage**: [integer] -- GitLab