* Update utils.py

* Update utils.py

* update ddpg

* Update train.py

* use cartpole-v0 in dqn

* Update README.md

* state to obs

* yapf & update softlink in offline-q-learning

* first version; unittest in parl/remote is passed

* add windows local unittest shell; fix some incompatible problem

* fix save api

* refine comments and remove log of xparl stop

* fix bug

* Update scripts.py

* Update utils.py

* Update agent_base_test.py

* add simple dqn

* Update README.md

* Update train.py

* update

* update image in README

* update readme

* simplify

* yapf

* Update README.md

* Update README.md

* Update README.md

* Update train.py

* yapf

* update docs

* update docs

* update

* update

* update

* update

* update

* update

* remove version 1.3 warnings

* update

* yapf

* add algorithms test

* Update algs_test.py

* Update algs_test.py

add SAC DDPG TD3 tests

* yapf

* generate static library libEvoKit_torch.a

* fix end of the file

* find EvoKit libraries by CMAKE_PREFIX_PATH

* set library path EVOKIT_LIBRARY

* rename namespace

* update torch code

* rename deepes to evokit

* update readme

* Update CMakeLists.txt

* update build.sh

* update code format to meet icode requirement

* update torch code

* update directory structure to support the icode platform

* remove source code generated by protobuf

* move code into the core directory

* add gaussian sampling method with noise table

* add table sampling test and agent param_size test

* add model param_size test

* get param size of paddle demo

* rename gaussian_table_sampling to cached_gaussian_sampling

* add unittest to sampling method and uniform indentation to 2 spaces
Co-authored-by: NTomorrowIsAnOtherDay <2466956298@qq.com>

* remove depedence on predictor.clone()

* remove commented lines

* remove FATAL logging

* remove ESAgent's construnction function based on cxx_config

* mv prototxt

* rename SamplingKey to SamplingInfo

* add asynchronous lsagent

* rename AsyncAgent to AsyncESAgent

* fix comments

* Update async_es_agent.cc

* Sampling Info

* commemt

* commemt

* add es torch effect test

* test the performance using the gtest framework

* update

* delete last blank line of CMakeLists.txt

* optimizer sin demo and use vector for data storage

* optimize sin demo test

* release v1.2.3

* change dep of liftsim a2c

* Add UnitTest for DeepES

* update Dockerfile

* only unittest

* remove the commented lines and empty functions.

* update CMakefile

* add optimizer unittest and torch demo test

* use optimizer_factory and add fail unittest case

* remove duplicate files, and simplify unittest

* teamcity test

* delete test case

* remove comment line

* shield progress display of downloading and unzip libtorch

* remove deepes torch demo test

* delete useless comment

* fix a2c cannot run in paddle 1.6.0

* fix impala compatibility

* yapf

* add optimizer factory

* add file:optimizer_factory

* copyright

* remove dependence on algorithm.h

* fix compatibility issue with the newest paddle

* remove logging lines

* resolve the compatibility issue with the newest paddle

* yapf
Co-authored-by: Nrobot <zenghongsheng@baidu.com>

* add SGD and Adam Optimizer for DeepES

* update deepes readme

* add warning when input different size in the same param update()

* add error return in update(), add optimizer.cc

* separate SGD and Adam, optimizer type in config is not case sensitive

* delete optimizer.cc

* config optimizer in deepes.proto

* more readable

* update maddpg readme, fixed gym version

* add tutorial of deepes, written with numpy, less than 100lines

* modify learning_rate as an arugment of Agent