From 79b411b912d536b57a940232565172e3036dbe63 Mon Sep 17 00:00:00 2001 From: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> Date: Wed, 12 Apr 2023 04:10:16 +0800 Subject: [PATCH] fix typo (#3183) --- docs/_tutorials/bert-pretraining.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/_tutorials/bert-pretraining.md b/docs/_tutorials/bert-pretraining.md index 87d4e871..cef60540 100755 --- a/docs/_tutorials/bert-pretraining.md +++ b/docs/_tutorials/bert-pretraining.md @@ -130,7 +130,7 @@ The `model` returned by `deepspeed.initialize` is the DeepSpeed _model engine_ that we will use to train the model using the forward, backward and step API. Since the model engine exposes the same forward pass API as `nn.Module` objects, there is no change in the forward pass. -Thus, we only modify the the backward pass and optimizer/scheduler steps. +Thus, we only modify the backward pass and optimizer/scheduler steps. Backward propagation is performed by calling `backward(loss)` directly with the model engine. -- GitLab