* support to distribute a folder alongwith its subfiles/subfolders

* job_shutshown check

* remove outdated annotation

* len(dirs)

* yapf

* add get_subfiles_recursively function to parl.utils

* hmm...

* modify a little

* rewrite

* modify

* first commit

* remove the default setting that unables GPUs in the job node

* Update job.py

* update paddle_gpu_test.py

* check remote attribute in local

* update the attribute keys after calling remote functions, add more unnittests

* modify lock realease position

* yapf..

* yapf

* yapf

* remove bracket

* add support of RegExp input of distributed_files[]

* add support of RegExp input of distributed_files[]

* add RegExp input of distributed files (together with unittest)

* support RegExp input of distributed files (failing case unittest added)

* support RegExp input of distributed files, update setup.py

* support RegExp input of distributed files

* add RegExp support for distributed files input

* add more test cases

* add support of RegExp input of distributed_files[]

* add support of RegExp input of distributed_files[]

* add the function to get and set attributes of remote models

* get_set_attributes, not finished

* get_set_atributes, not finieshed yet

* add function to get and set attributes of remote model

* add function to get and set attributes of remote models

* add more unnitest cases, together with several comments

* make codes reusable

* fix #370

* add unit tests for importting submodule in xparl

* add comment

* revert scripts.py

* yapf

* unit test

* fix relative path bug

* read files using relative path

* remove print

* update CMake

* add try times

* fix the bug in log_server_test.py

* fix relative path bug&add unit test

* update utils.py

* update Cmake

* fix pyc bug

* Update utils.py

* fix test_monitor_query_log_server

* update requirements.txt

* fix check style

* update version

* fix setup.py

* redirect stdout to log file while initializing the remote actor instance

* add test for catching output in  `Actor.__init__`

* catch `TypeError` in `remote.__del__`

* `log_server_test.py` windows compatibility

* add logger for remote actors

* resolve issues

* `get_free_tcp_port` and `is_port_available` move to utils.py

* add information for user in the remote log web UI

* yapf formatting

* fix unittest error

* yapf formatting

* update remote job web UI

* add option for log server port

* fix windows support

* fix `os.devnull` in windows

* fix port argument passing

* fix bug

* fix kill log_server

* fix log server not started

* add log_server_test
Co-authored-by: NHongsheng Zeng <zenghongsheng@baidu.com>

* fix the bug of recursive creating actors

* add comment

* update comment

* rename test files

* fix workspace bug

* fix the bug of distributing files

* update comment

* ban passing a absolute path

* stop using pickle cloud to transmit the remote class

* ping the master before connection

* yapf

* fix comments

* remove the useless library

* install ping for the docker environment

* remove protobuf intallation

* remove evokit test

* first version; unittest in parl/remote is passed

* add windows local unittest shell; fix some incompatible problem

* fix save api

* refine comments and remove log of xparl stop

* fix bug

* Update scripts.py

* Update utils.py

* Update agent_base_test.py

* add sac

* git commit -m torchdqn

* yapf

* fix bugs

* fix bugs

* fix bugs

* yapf

* remove fstring format

* torch_test yapf

* yapf

* Add torch in unittest.requirements

* update torch_unittest

* Torch and FLUID conflict problem in __init__.py

* Unittest fail for torch when both torch and fluid exists.

* cluster_test fail in the unittest, add timeout seconds.

* Torch backend for PARL

* add sleep time for unit test send_job_test.py

* Unit test for send_job_test.py

* use multiple try for unit test

* Fix compatibility for python2.7.

* fix send_job_test.py bugs

* check file exist before send_job_test.py

* Modify send_job_test.py

* Add `files` argument when creating a client.

* Add `distributed_files` to parl.connect

* yapf

* Add try exception for `cls=cloudpickle.loads()`

* yapf

* unittest cluster_status_test.py `address is used`.

* Solve port address duplicate problem.

* combine two try except

* check monitor for xparl status

* yapf

* fix bugs

* fix bugs

* More sleep in cluster_test.py.

* yapf

* add debug mode

* add debug model

* Fix reset_job_test.py timeout problem.

* remove time decorator

* Add timeout_decorator

* fix the thread-safe problem of  parl.client

* yapf

* Add total CPU nums to monitor

* fix unittest keyerro

* yapf

* test_max_memory error, add more sleep time

* Add more sleep time in job._reply_client_heartbeat

* Try sleep 6 times to check actor number.

* fix minor probmels in the docs

* typo

* remove pip source

* fix monitor

* add performance of A2C

* Update README.md

* modify logger for GPU detection

* add favicon

* Sleep longer for unittest.

* fix unittest bugs

* increase sleep seconds after job_memory error

* fix css max-width bug

* check if monitor_port is used

* change master log dir to .parl_data/master/port

* Add docs/parallel_training/features.rst

* rename feature.rst to overview.rst

* Add xparl status & @remote_class(max_memory)

* fix yapf error

* use new remote/tests

* reply job_memory_info to client heartbeat

* add cluster_status_test.py

* update overview.rst

* Update docs

* upgrade unit test to reduce test time

* minor change

* fix the bug in unit tests

* fix the bug in build.sh

* Update build.sh

* Update test.sh

* fix a potential bug that will hung the test

* then

* solve the problem in documentation

* make remote client support multiprocessing

* refine unittest

* refine unittest

* refine comment

* Add parl monitor.

* Add clustermonitor.py

* Fix thread safety bug.

* Fix js bugs.

* Fix End of Files.

* fix cluster_test bug

* yapf error

* fix bugs in tests/job_center_test.py

* fix bugs in tests/job_center_test.py

* add test_cluster_monitor.py

* add worker.exit in test_cluster_monitor.py

* fix a number of bug

* update comments

* paddle license

* revert the change on client_not_init_test.py

* fix timeout bug & unnitest

* add unit test for potential bugs

* yapf

* unit test

* logger

* logger#2

* fix job's bug that will cause dead-lock

* fix bug

* add missing files

* solve hanging

* fix comments; exit job completely

* hanging problem

* hanging problem#2

* hanging_program#3

* CMAKE

* remove unused variables

* fix bug: removing the job from the cluster twice; add test scripts

* fix attribute error

* fix comment

* rename

* fix the bug in unit test

* remove queue

* first pr

* start a worker when the master is started.

* First PR & Fix logger bugs.

* update docs for a2c, impala and ga3c

* update doc

* yapf modification

* update logger

* yapf correct

* yapf

* setup.py

* old setup.py

* worker 86

* add traceback of remote function calling

* assert traceback information

* support serialize/deserialize instance of custom class

* update version requirement of dependences

* remove requirements of unittest which are included in parl

* use fashion style of pyarrow serialization context; add thread safe unittest of serialize/deserialize

* add thread-safe test of remote module; add more exception tips of serialize/deserialize

* refine comment

* refine remote module, add heartbeat machanism and unittest

* yapf

* yapf

* support get ip address in CentOS, add dependence

* yapf

* add dependence in Dockerfile

* refine message_tag, Compatible with Python2 and python3

* refine unittest and comments

* remove ParlError, use to_pybytes api to compatible with Python 2 and python 3

* Not need to use to_pybytes

* use parl-test docker image for unittest, which has python2 and python3 env

* test different release order of sockets

* test for different closing way fo context and socket

* tmp commit for debug in teamcity

* tmp commit for debug in teamcity

* tmp commit for debug in teamcity

* use zmq.context destroy to close multi-thread socket, refine RemoteError

* set linger=0 for command socket in RemoteObject

* remove close context unittest

* fix codestyle

* fix codestyle

* rename parl.remote to parl.remote_class; will not exit client when having errors in function call; use sepereate server port in unittest to avoiding closing server manually

* rename parl.remote to parl.remote_class; will not exit client when having errors in function call; use sepereate server port in unittest to avoiding closing server manually

* fix typo

* remove unnecessary try/except in reply loop of client

* import RemoteManager to parl; refine comment