1. 08 4月, 2019 1 次提交
    • H
      implement of IMPALA with the newest parallel design (#60) · b28289ac
      Hongsheng Zeng 提交于
      * add IMPALA algorithm and some common utils
      
      * update README.md
      
      * refactor files structure of impala algorithm; seperate numpy utils from utils
      
      * add hyper parameter scheduler module; add entropy and lr scheduler in impala
      
      * clip reward in atari wrapper instead of learner side; fix codestyle
      
      * add benchmark result of impala; refine code of impala example; add obs_format in atari_wrappers
      
      * Update README.md
      b28289ac
  2. 07 3月, 2019 1 次提交
    • H
      new feature: parl.remote (#54) · 348db1fb
      Hongsheng Zeng 提交于
      * refine remote module, add heartbeat machanism and unittest
      
      * yapf
      
      * yapf
      
      * support get ip address in CentOS, add dependence
      
      * yapf
      
      * add dependence in Dockerfile
      
      * refine message_tag, Compatible with Python2 and python3
      
      * refine unittest and comments
      
      * remove ParlError, use to_pybytes api to compatible with Python 2 and python 3
      
      * Not need to use to_pybytes
      
      * use parl-test docker image for unittest, which has python2 and python3 env
      
      * test different release order of sockets
      
      * test for different closing way fo context and socket
      
      * tmp commit for debug in teamcity
      
      * tmp commit for debug in teamcity
      
      * tmp commit for debug in teamcity
      
      * use zmq.context destroy to close multi-thread socket, refine RemoteError
      
      * set linger=0 for command socket in RemoteObject
      
      * remove close context unittest
      
      * fix codestyle
      
      * fix codestyle
      
      * rename parl.remote to parl.remote_class; will not exit client when having errors in function call; use sepereate server port in unittest to avoiding closing server manually
      
      * rename parl.remote to parl.remote_class; will not exit client when having errors in function call; use sepereate server port in unittest to avoiding closing server manually
      
      * fix typo
      
      * remove unnecessary try/except in reply loop of client
      
      * import RemoteManager to parl; refine comment
      348db1fb
  3. 27 2月, 2019 1 次提交
    • B
      first version of network communication (#49) · bbde58fb
      Bo Zhou 提交于
      * first version of network communication
      
      * fix code styple problems
      
      * add a script to get machine's information
      
      * code styple problems#2
      
      * fix unit test problems
      
      * update dockfile to fix the installation issue of cmake
      
      * thread-saftey ensurance & copright
      
      * resolve comments
      bbde58fb
  4. 15 1月, 2019 1 次提交
    • H
      NeurIPS2018-AI-for-Prosthetics-Challenge training code (#40) · cdb50056
      Hongsheng Zeng 提交于
      * NeurIPS2018-AI-for-Prosthetics-Challenge training code
      
      * remove model_zoo, provide download link
      
      * remove model_zoo, provide download link
      
      * add restore_from_one_head api, refine README, fix logger bug
      
      * fix test bug
      
      * fix rpm bug, refine ddpg train script
      
      * fix rpm bug, refine Readme
      cdb50056
  5. 26 11月, 2018 1 次提交
    • H
      sync paras in program, fix deepcopy bug, python3 compatibility (#28) · e11b40c5
      Hongsheng Zeng 提交于
      * sync paras in program, fix deepcopy bug, python3 compatibility
      
      * refactor code, add plutil directory, clean import order
      
      * remove old comment
      
      * refine comment
      
      * fix codestyle
      
      * cache sync program, add gputils module, refine model_base unittest
      
      * fix codestyle
      
      * refine sync params cache
      
      * add fetch_value module
      e11b40c5
  6. 20 11月, 2018 1 次提交
    • B
      redesign basic class in PARL (#26) · 1a1e1f03
      Bo Zhou 提交于
      * redesign basic class in PARL
      
      * code style fixed
      
      * update yaml's version
      
      * update yaml's version & update code to fix style problem
      
      * add debug message for  function
      
      * delete test code
      
      * rename function: has_fun -> has_func
      1a1e1f03
  7. 06 6月, 2018 1 次提交
    • H
      preliminary implementations of the ComputationTask, Algorithm, and Model classes (#9) · 4b4b5824
      Haonan 提交于
      * prelimary implementations of ComputationTask, Algorithm and Model classes
      
      * remove "model_func" from the args of an algorithm
      
      * a clean clone() function for Algorithm and Model
      
      * add use_next_value as a input to learn()
      
      * further re-structure
      
      * added Feedforward and RLAlgorithm classes
      
      * maxid -> argmax
      
      * discrete_distribution -> category_distribution
      
      * category -> categorical
      
      * revisions
      4b4b5824
  8. 17 5月, 2018 2 次提交