* test rnd

* fix mz config

* fix config

* fix(pu): fix r2d2

* fix(puyuan): fix r2d2

* feature(puyuan): add minigrid r2d2 config

* polish minigrid config

* modified as review

* fix(pu): fix bugffor compatibility

* polish(pu): add annotations and polish slice operation

* style(pu): run format.sh

* style(pu): correct yapf format

* fix(pu): fix config

* fix(pu): fix done slice bug and lstm reset bug

* style(pu): format config

* polish(pu): polish config params for cartpole, lunarlander and minigrid

* polish(pu): polish minigrid config params

* Update r2d2.py

* polish(pu): polish rnn reset problem

* fix(pu): fix merge error

* polish(pu): polish cartpole config

* polish(nyz): polish cartpole r2d2 config for faster convergence

* test(nyz): enable r2d2 algotest
Co-authored-by: Nniuyazhe <niuyazhe@sensetime.com>

* test rnd

* fix mz config

* fix config

* fix(pu): fix r2d2

* feature(puyuan): add minigrid r2d2 config

* polish minigrid config

* modified as review

* fix(pu): fix bugffor compatibility

* polish(pu): add annotations and polish slice operation

* style(pu): run format.sh

* style(pu): correct yapf format