* first pr

* start a worker when the master is started.

* First PR & Fix logger bugs.

* update docs for a2c, impala and ga3c

* update doc

* yapf modification

* update logger

* yapf correct

* yapf

* setup.py

* old setup.py

* worker 86

* add docs for the cluster

* mispelling issues

* minor change

* fix comment

* fix comments from yuxiang

* fix comment

* fix the bug of hyperlink

* rename

* release version 1.1.1

* add version requirement of tensorboard

* new feature: save params

* add unittest for save()/retore()

* add an example demonstrating the usage

* rename the variable

* yapf

* fix comment

* fix the bug in building  the the docs

* update the version of the required Paddle

* fix the compatibility issue

* fix the comment issue

* support paddle 1.5.1 and replace PE with compiler

* yapf&copyright

* yapf

* fix the teamcity problem

* fix the teamcity problem

* fix comment

* only support paddle 1.5.1

* Cmake

* fix comment

* add documentaion for basic classes

* change the order of three basic classes

* fix commemt & yapf

* comment #2

* yapf#3

* fix commemt@zhs

* minor change

* modify comment

* Update algorithm.py

* Update agent.py

* Update algorithm.py

* fix issue#101

* yapf

* fix some problems of tensorboard

* yapf

* fix the compatibility issue

* fix the comment issue

* support paddle 1.5.1 and replace PE with compiler

* yapf&copyright

* yapf

* fix the teamcity problem

* fix the teamcity problem

* fix comment

* only support paddle 1.5.1

* Cmake

* fix comment

* fix the compatibility issue

* fix the comment issue

* add the tutorial: getting started

* fix commemt

* minor change

* remove previous algorithms; use the forward function in parl.Model

* remove abundant lines

* yapf

* intra-version: move parl.framework into parl.core.fluid

* add folder: parl.core

* remove former test folders

* yapf

* yapf0.24

* add tensorboardX

* yapf

* Code License

* Update model-based.md

* make the quickstart more compact

* remove args in the main function

* yapf

* add gif

* remove render

* Update README.md

* Update README.md

* Update README.md

* add unittest for compling the docs

* record the time of change

* remove unused requirements

* reduce font size of the changelog

* Update README.cn.md

* Update README.md

* Update README.md

* Update README.cn.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* test

* add installation of the current package

* remove the dependencies file

* test_docs

* Create index.md

* Delete index.md

* check yapf

* remove source

* Update conf.py

* update requirements

* add a new line at the end

* Fix End of Files

* fix-end-of-line

* remove requirements.txt

* Update .readthedocs.yml

* refine A2C example

* fix unittest in python2; fix codestyle

* fix codestyle

* refine comment

* add traceback of remote function calling

* assert traceback information

* support serialize/deserialize instance of custom class

* update version requirement of dependences

* remove requirements of unittest which are included in parl

* use fashion style of pyarrow serialization context; add thread safe unittest of serialize/deserialize

* add thread-safe test of remote module; add more exception tips of serialize/deserialize

* refine comment

Now we can check the parl version by calling parl.__version__

* add test for import parl

* fix error of check_style

* change pip source

* refine naming

* add benchmark of GA3C

* fix bug of import parl without paddle

* fix codestyle

* add A2C benchmark; add more information in PyPI homepage

* filter picture in PyPI homepage

* Update README.md

* Update Dockerfile

* Update build.sh

* add compatible queue definition

* fix typo

* Update README.md

* Update README.md

* Update README.md

* soft depend on fluid; add module to monitor client status

* improve performance of IMPALA example

* fix bug of some client cannot exit normally

* refine comment

* .

* Update README.md

* Create README.cn.md

* Update README.cn.md

* Update README.cn.md

* Update README.cn.md

* Update README.cn.md

* Update README.cn.md

* Update README.cn.md

* Update README.cn.md

* Update README.cn.md

* Update README.cn.md

* Update README.cn.md

* Update README.md

* Update README.md

* Update README.md

* Update README.cn.md

* add IMPALA algorithm and some common utils

* update README.md

* refactor files structure of impala algorithm; seperate numpy utils from utils

* add hyper parameter scheduler module; add entropy and lr scheduler in impala

* clip reward in atari wrapper instead of learner side; fix codestyle

* add benchmark result of impala; refine code of impala example; add obs_format in atari_wrappers

* Update README.md

* add a3c algorithm, A2C example and rl_utils

* require training in single gpu/cpu

* only check cpu/gpu num in learner

* refine Readme

* update impala benchmark picture; update Readme

* add benchmark result of A2C

* move get_params/set_params in agent_base

* add GA3C example

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* refine Readme

* add benchmark

* add default safe eps in numpy logp calculation

* refine document; make unittest stable

* add IMPALA algorithm and some common utils

* update README.md

* refactor files structure of impala algorithm; seperate numpy utils from utils

* add hyper parameter scheduler module; add entropy and lr scheduler in impala

* clip reward in atari wrapper instead of learner side; fix codestyle

* add benchmark result of impala; refine code of impala example; add obs_format in atari_wrappers

* Update README.md

* add a3c algorithm, A2C example and rl_utils

* require training in single gpu/cpu

* only check cpu/gpu num in learner

* refine Readme

* update impala benchmark picture; update Readme

* add benchmark result of A2C

* move get_params/set_params in agent_base

* fix shell script cannot run in ubuntu

* refine comment and document

* Update README.md

* Update README.md

* Update remote_decorator.py

* Update README.md

* add an figure for the demonstration about parallelization

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* add a link to IMPALA

* add IMPALA algorithm and some common utils

* update README.md

* refactor files structure of impala algorithm; seperate numpy utils from utils

* add hyper parameter scheduler module; add entropy and lr scheduler in impala

* clip reward in atari wrapper instead of learner side; fix codestyle

* add benchmark result of impala; refine code of impala example; add obs_format in atari_wrappers

* Update README.md