diff --git a/docs/10.md b/docs/10.md index 79143e76e9f38d9ed9099c9bb30382b4796f8be0..2b91ece246bef643dc7214ff857d1139cb0382f1 100644 --- a/docs/10.md +++ b/docs/10.md @@ -470,6 +470,7 @@ $$ $$ 这里 + $$ L_{\pi}(\pi') = \mathbb_{s\sim d^{\pi},a\sim\pi(\cdot|s)} [\frac{\pi'(a|s)}{\pi(a|s)} A^{\pi}(s,a)], $$