* add tutorials

* yapf

* yapf

* copyright

* yapf

* update tutorial lesson5

* delete drawing code

* yapf

* remove action_mapping

* update dqn and add README

* update

* update

* yapf

* add toturials homework

* fix compatibility of batch_norm layer

* fix yapf

% `python3.8`
```
>>> 0 is 0
<stdin>:1: SyntaxWarning: "is" with a literal. Did you mean "=="?
>>> 'Double' is 'Double'
<stdin>:1: SyntaxWarning: "is" with a literal. Did you mean "=="?
```

* add docs

* add docs

* typo

* Update Overview.md

* update docs

* yapf

* yapf

* fix error with cpu version paddle in the GPU envrionment.

* update tutorials

* add ppo

* fix bugs

* yapf

* redirect stdout to log file while initializing the remote actor instance

* add test for catching output in  `Actor.__init__`

* add tutorials

* yapf

* yapf

* copyright

* yapf

* update tutorial lesson5

* delete drawing code

* yapf

* remove action_mapping

* update dqn and add README

* update

* update

* yapf

* catch `TypeError` in `remote.__del__`

* `log_server_test.py` windows compatibility

* add logger for remote actors

* resolve issues

* `get_free_tcp_port` and `is_port_available` move to utils.py

* add information for user in the remote log web UI

* yapf formatting

* fix unittest error

* yapf formatting

* update remote job web UI

* add option for log server port

* fix windows support

* fix `os.devnull` in windows

* fix port argument passing

* fix bug

* fix kill log_server

* fix log server not started

* add log_server_test
Co-authored-by: NHongsheng Zeng <zenghongsheng@baidu.com>

* upgrade DQN's lr interface compatibility

* yapf

* update example DQN

* fix the bug of recursive creating actors

* add comment

* update comment

* rename test files

* fix workspace bug

* fix the bug of distributing files

* update comment

* ban passing a absolute path

* Update README.md

* Update README.cn.md

* use kill_process

* Update utils.py

* version 0.1

* fix bug

* Update README.md

* Update README.md

* fix yapf
Co-authored-by: NTomorrowIsAnOtherDay <2466956298@qq.com>

Co-authored-by: NTomorrowIsAnOtherDay <2466956298@qq.com>

* stop using pickle cloud to transmit the remote class

* add VisualDL as summary logging backend

* yapf

* copyright

* using visualdl as the default logging tool

* only support linux at the moment

* yapf

* yapf

* remove dependency on six

* unittest

* yapf

* ping the master before connection

* yapf

* fix comments

* remove the useless library

* install ping for the docker environment

* remove protobuf intallation

* remove evokit test

* replace tensorboard with summary to support VDL in the future

* unittest

* rename keys for record

* yapf

* Update getting_started.rst

* compile doc with chinese

* yapf

* Update utils.py

* Update utils.py

* update ddpg

* Update train.py

* use cartpole-v0 in dqn

* Update README.md

* state to obs

* yapf & update softlink in offline-q-learning

* first version; unittest in parl/remote is passed

* add windows local unittest shell; fix some incompatible problem

* fix save api

* refine comments and remove log of xparl stop

* fix bug

* Update scripts.py

* Update utils.py

* Update agent_base_test.py