* replace tensorboard with summary to support VDL in the future

* unittest

* rename keys for record

* yapf

* Update utils.py

* Update utils.py

* first version; unittest in parl/remote is passed

* add windows local unittest shell; fix some incompatible problem

* fix save api

* refine comments and remove log of xparl stop

* fix bug

* Update scripts.py

* Update utils.py

* Update agent_base_test.py

* mac compatibility

* refine import trick

* add maddpg example

* format with yapf

* fix coding style

* fix coding style

* unittest without import multiagent env

* update maddpg code

* update maddpg readme

* add copyright comments

* add pytorch a2c

* add set/get_weights test & copyright

* yapf....

* Update model_base_test_torch.py

* update

* Delete banma.py

* Update model_base_test_torch.py

* update

* Update model.py

* update torch tests

* Update model_base_test_torch.py

* git commit -m torchdqn

* yapf

* fix bugs

* fix bugs

* fix bugs

* yapf

* remove fstring format

* torch_test yapf

* yapf

* Add torch in unittest.requirements

* update torch_unittest

* Torch and FLUID conflict problem in __init__.py

* Unittest fail for torch when both torch and fluid exists.

* cluster_test fail in the unittest, add timeout seconds.

* Torch backend for PARL

* add sleep time for unit test send_job_test.py

* Unit test for send_job_test.py

* use multiple try for unit test

* Fix compatibility for python2.7.

* fix send_job_test.py bugs

* check file exist before send_job_test.py

* Modify send_job_test.py

* Limit impala to single GPU training

* refine comment of scheduler

* refine comment

* clear the directory for the function

* add the unit test

* unit test bug

* yapf

* Add `files` argument when creating a client.

* Add `distributed_files` to parl.connect

* yapf

* Add try exception for `cls=cloudpickle.loads()`

* yapf

* unittest cluster_status_test.py `address is used`.

* Solve port address duplicate problem.

* combine two try except

* check monitor for xparl status

* yapf

* fix bugs

* fix bugs

* More sleep in cluster_test.py.

* yapf

* add debug mode

* add debug model

* Fix reset_job_test.py timeout problem.

* remove time decorator

* Add timeout_decorator

* fix minor probmels in the docs

* typo

* remove pip source

* fix monitor

* add performance of A2C

* Update README.md

* modify logger for GPU detection

* fix a number of bug

* update comments

* paddle license

* revert the change on client_not_init_test.py

* fix timeout bug & unnitest

* add unit test for potential bugs

* yapf

* unit test

* logger

* logger#2

* fix job's bug that will cause dead-lock

* fix bug

* add missing files

* solve hanging

* fix comments; exit job completely

* hanging problem

* hanging problem#2

* hanging_program#3

* CMAKE

* remove unused variables

* fix the vital issue on compatibility

* resolve the warning log

* yapf

* yapf

* first pr

* start a worker when the master is started.

* First PR & Fix logger bugs.

* update docs for a2c, impala and ga3c

* update doc

* yapf modification

* update logger

* yapf correct

* yapf

* setup.py

* old setup.py

* worker 86

* fix issue#101

* yapf

* fix some problems of tensorboard

* yapf

* fix the compatibility issue

* fix the comment issue

* support paddle 1.5.1 and replace PE with compiler

* yapf&copyright

* yapf

* fix the teamcity problem

* fix the teamcity problem

* fix comment

* only support paddle 1.5.1

* Cmake

* fix comment

* intra-version: move parl.framework into parl.core.fluid

* add folder: parl.core

* remove former test folders

* yapf

* yapf0.24

* add tensorboardX

* yapf

* Code License

* refine A2C example

* fix unittest in python2; fix codestyle

* fix codestyle

* refine comment

* support serialize/deserialize instance of custom class

* update version requirement of dependences

* remove requirements of unittest which are included in parl

* use fashion style of pyarrow serialization context; add thread safe unittest of serialize/deserialize

* add thread-safe test of remote module; add more exception tips of serialize/deserialize

* refine comment

* add benchmark of GA3C

* fix bug of import parl without paddle

* fix codestyle

* fix typo

* Update README.md

* Update README.md

* Update README.md

* soft depend on fluid; add module to monitor client status

* improve performance of IMPALA example

* fix bug of some client cannot exit normally

* refine comment

* .

* add IMPALA algorithm and some common utils

* update README.md

* refactor files structure of impala algorithm; seperate numpy utils from utils

* add hyper parameter scheduler module; add entropy and lr scheduler in impala

* clip reward in atari wrapper instead of learner side; fix codestyle

* add benchmark result of impala; refine code of impala example; add obs_format in atari_wrappers

* Update README.md

* add a3c algorithm, A2C example and rl_utils

* require training in single gpu/cpu

* only check cpu/gpu num in learner

* refine Readme

* update impala benchmark picture; update Readme

* add benchmark result of A2C

* move get_params/set_params in agent_base

* fix shell script cannot run in ubuntu

* refine comment and document

* Update README.md

* Update README.md

* add IMPALA algorithm and some common utils

* update README.md

* refactor files structure of impala algorithm; seperate numpy utils from utils

* add hyper parameter scheduler module; add entropy and lr scheduler in impala

* clip reward in atari wrapper instead of learner side; fix codestyle

* add benchmark result of impala; refine code of impala example; add obs_format in atari_wrappers

* Update README.md

* refine remote module, add heartbeat machanism and unittest

* yapf

* yapf

* support get ip address in CentOS, add dependence

* yapf

* add dependence in Dockerfile

* refine message_tag, Compatible with Python2 and python3

* refine unittest and comments

* remove ParlError, use to_pybytes api to compatible with Python 2 and python 3

* Not need to use to_pybytes

* use parl-test docker image for unittest, which has python2 and python3 env

* test different release order of sockets

* test for different closing way fo context and socket

* tmp commit for debug in teamcity

* tmp commit for debug in teamcity

* tmp commit for debug in teamcity

* use zmq.context destroy to close multi-thread socket, refine RemoteError

* set linger=0 for command socket in RemoteObject

* remove close context unittest

* fix codestyle

* fix codestyle

* rename parl.remote to parl.remote_class; will not exit client when having errors in function call; use sepereate server port in unittest to avoiding closing server manually

* rename parl.remote to parl.remote_class; will not exit client when having errors in function call; use sepereate server port in unittest to avoiding closing server manually

* fix typo

* remove unnecessary try/except in reply loop of client

* import RemoteManager to parl; refine comment

* first version of network communication

* fix code styple problems

* add a script to get machine's information

* code styple problems#2

* fix unit test problems

* update dockfile to fix the installation issue of cmake

* thread-saftey ensurance & copright

* resolve comments

* NeurIPS2018-AI-for-Prosthetics-Challenge training code

* remove model_zoo, provide download link

* remove model_zoo, provide download link

* add restore_from_one_head api, refine README, fix logger bug

* fix test bug

* fix rpm bug, refine ddpg train script

* fix rpm bug, refine Readme

* add PPO example

* Update Readme

* Update Readme

* fix codestyle

* Update Readme

* refine action mapping

* add more unitest case

* remove unnecessary params initialize, add more comments, add benchmark result

* rename

* remove PARL dependence in readme of examples

* add DDPG example, fix some tiny bug

* add license

* unify code structure

* unify code structure

* refine gputils, fix seed in QuickStart

* use white noise in DDPG

* fix codestyle

* add DQN example, add Agent unittest

* refine readme

* refine  code

* simplify code

* sync paras in program, fix deepcopy bug, python3 compatibility

* refactor code, add plutil directory, clean import order

* remove old comment

* refine comment

* fix codestyle

* cache sync program, add gputils module, refine model_base unittest

* fix codestyle

* refine sync params cache

* add fetch_value module

* add logger module

* refine comment

* add license

* refine set_level api

* refine unittest

* fix codestyle with yapf

* add termcolor dependency

* redesign basic class in PARL

* code style fixed

* update yaml's version

* update yaml's version & update code to fix style problem

* add debug message for  function

* delete test code

* rename function: has_fun -> has_func