From eeda2bb7837e4cfa7c9f8e4fea9c34f666d7421e Mon Sep 17 00:00:00 2001 From: xiaowei_xing <997427575@qq.com> Date: Fri, 8 Nov 2019 14:38:56 +0900 Subject: [PATCH] test --- docs/10.md | 6 +----- 1 file changed, 1 insertion(+), 5 deletions(-) diff --git a/docs/10.md b/docs/10.md index 868935d..eb6162a 100644 --- a/docs/10.md +++ b/docs/10.md @@ -21,11 +21,7 @@ $$ 我们将目标函数记为 $J(\theta)$,可以用蒙特卡洛方法估计 $J(\theta)$。我们用 $r(\tau)$ 来代表轨迹 $\tau$ 的衰减奖励总和。 $$ -J(\theta) = \mathbb{E}_{\tau\sim \pi _{\theta}(\tau)}[\sum_t \gamma^t r (s_t,a_t)] = \int \pi _ {\theta} (\tau) r(\tau) \text{d} \tau \approx \frac{1}{N}\sum_{i=1}^N \sum_{t=1}^T \gamma^t r(s_{i,t},a_{i,t}) -$$ - -$$ -\int \pi_\theta (\tau) r(\tau) \text{d} \tau +J(\theta) = \mathbb{E}_{\tau\sim \pi _{\theta}(\tau)}[\sum_t \gamma^t r (s_t,a_t)] = \int \pi _{\theta} (\tau) r(\tau) \text{d} \tau $$ $$ -- GitLab