1. 26 6月, 2019 1 次提交
    • Y
      Update lamb optimizer (#18333) · 23941e43
      Yibing Liu 提交于
      * Update lamb optimizer
      
      test=develop, test=document_preview
      
      * Regenerate api spec
      
      test=develop, test=document_preview
      23941e43
  2. 21 5月, 2019 1 次提交
    • Y
      Add LAMB Optimizer support (#17489) · f9796b12
      Yibing Liu 提交于
      * Add LAMB optimizer
      
      * Expose LAMB Optimizer's APIs
      
      test=develop, test=document_preview
      
      * Cleanup code & doc
      
      test=develop, test=document_preview
      
      * Update lamb optimizer's formula
      
      test=develop
      f9796b12
  3. 15 1月, 2019 1 次提交
  4. 07 1月, 2019 1 次提交
  5. 27 12月, 2018 1 次提交
  6. 17 12月, 2018 1 次提交
  7. 14 12月, 2018 1 次提交
  8. 13 12月, 2018 1 次提交
  9. 15 8月, 2018 1 次提交
  10. 26 7月, 2018 2 次提交
  11. 24 2月, 2018 2 次提交
  12. 13 2月, 2018 1 次提交
    • X
      Run Python OP tests in a single Python process to improve test time. (#8362) · cde6241a
      Xin Pan 提交于
      Currently, our tests run with 2 GPUs, the init time is absurdly long:
      about 4s for each process.  Currently, we run each OP test on
      different processes. This PR:
      
      1. create cmake function py_test_modules which will generate the
      Makefile that runs a list of Python unittest module in a single Python
      process.
      
      2. move all "python unittest compatible" (e.g., used the unittest
      package, not just a regular python file). from fluid/tests to
      fluid/tests/unittests.
      
      3. cmake now will run all OP tests in fluid/tests/unittests in a
      single process, except the time-consuming tests, they are separated
      into different processes to utilize parallelism. Please make sure to
      use the unittest package if you put the python test file in
      fluid/tests/unittests
      
      4. remove all exit(0) from fluid/tests/unittests/*.py, exit(0) is used
      to disable unittest, we can not do it when running all tests in a
      single process since it will terminate the process without running the
      other tests. Instead, the test is disabled in
      fluid/tests/unittests/CMakeLists.txt. FIXME is added for each disabled
      item. Please disable the unittest from
      fluid/tests/unittests/CMakeLists.txt, instead of adding exit(0) to the
      Python file, for all Python file in fluid/tests/unittests/.
      
      5. add an option WITH_FAST_BUNDLE_TEST. When OFF, will run the unit
      tests in separate process so that they can be tested individually.
      cde6241a
  13. 12 2月, 2018 1 次提交
  14. 24 1月, 2018 1 次提交
  15. 21 1月, 2018 1 次提交
    • D
      "fix decode bug" (#7711) · e983cc90
      dzhwinter 提交于
      * "fix decode bug"
      
      * "follow commnet"
      
      * "fix error"
      
      * "fix hook bug"
      
      * fix based comment
      
      * fix copyright
      
      * fix based on comment
      e983cc90
  16. 15 1月, 2018 1 次提交
    • D
      Feature/hooks (#7513) · b9b75377
      dzhwinter 提交于
      * add copyright hook
      
      * add copyright hook
      
      * refine copyright hook
      
      * "test copyright hook"
      
      * fix check style
      
      * fix ci
      b9b75377
  17. 29 12月, 2017 1 次提交
  18. 27 12月, 2017 1 次提交
  19. 26 12月, 2017 2 次提交
  20. 14 11月, 2017 1 次提交
  21. 20 10月, 2017 1 次提交
  22. 13 10月, 2017 1 次提交
    • A
      Adding the Adam Optimizer operator (#4733) · 11680037
      Abhinav Arora 提交于
      * add adam op
      
      moment1_out = beta1 * moment1 + (1 − beta1) * grad
      moment2_out = beta2 * moment2 + (1 − beta2) * grad * grad
      moment1_hat =  moment1_out / (1 - beta1^t)
      moment2_hat =  moment2_out / (1 - beta2^t)
      param_out = param - learning_rate * moment1_hat / (sqrt(moment2_hat) +
      epsilon)
      
      * fix moment 2
      
      * Adding the Adam optimization operator
      
      * Adding more tests for Adam op
      11680037