1. 13 10月, 2017 1 次提交
    • A
      Adding the Adam Optimizer operator (#4733) · 11680037
      Abhinav Arora 提交于
      * add adam op
      
      moment1_out = beta1 * moment1 + (1 − beta1) * grad
      moment2_out = beta2 * moment2 + (1 − beta2) * grad * grad
      moment1_hat =  moment1_out / (1 - beta1^t)
      moment2_hat =  moment2_out / (1 - beta2^t)
      param_out = param - learning_rate * moment1_hat / (sqrt(moment2_hat) +
      epsilon)
      
      * fix moment 2
      
      * Adding the Adam optimization operator
      
      * Adding more tests for Adam op
      11680037
  2. 10 10月, 2017 1 次提交
    • A
      Implementing the Adamax optimizer operator (#4538) · 4cb5bd90
      Abhinav Arora 提交于
      * Implementing the Adamax optimizer step operator
      * Adding unit tests for adamax_op
      
      * Changing learning rate and time step to inputs from attributes
      
      * Changing learning rate and time step to input(tensors)
      
      * Making the Adamax operator conform to naming convention
      
      * Removing Tensor<float> from comments
      
      * Rectifying the Adamax implementation
      
      * Changing Unit Test values and adding comments
      
      * Changing Unit Test to test multiple steps
      4cb5bd90
  3. 06 10月, 2017 1 次提交
  4. 03 10月, 2017 2 次提交
  5. 28 9月, 2017 1 次提交
  6. 06 9月, 2017 1 次提交
  7. 04 9月, 2017 1 次提交
  8. 03 9月, 2017 1 次提交
  9. 18 8月, 2017 1 次提交
  10. 07 8月, 2017 1 次提交
  11. 05 8月, 2017 1 次提交
  12. 02 8月, 2017 2 次提交
  13. 01 8月, 2017 1 次提交
    • Q
      use operator context and infer context (#3024) · 61ebacbc
      Qiao Longfei 提交于
      * use operator context
      
      * optimize code
      
      * update net infershape
      
      * update InferShape
      
      * disable override InferShape(scope) in OperatorBase
      
      * change InferShapeImpl to InferShape
      
      * add template to OperatorContext Input/Output
      
      * merge Input InputVar, Output OutputVar
      
      * change Inputs to MultiInput
      
      * fix conflict
      
      * fix MultiInput bugs and add unit test
      
      * rename KernelContext to ExecutionContext
      
      * clean code
      
      * change InferShape to protected
      
      * fix template bug
      
      * refine code
      
      * use InputVar instead of Input<Variable>
      
      * typo
      
      * optimize code
      61ebacbc
  14. 25 7月, 2017 1 次提交
  15. 19 7月, 2017 4 次提交
  16. 17 7月, 2017 3 次提交
  17. 14 7月, 2017 1 次提交
  18. 13 7月, 2017 2 次提交
    • Y
      Follow comments · 79b70c2d
      Yu Yang 提交于
      * Convert `op` --> `operators`
      * Remove AddType in OpProtoMaker, because type is part of registry.
      * Rename CPU_OR_GPU --> DEVICE_TYPE in registry macro.
      79b70c2d
    • Y
      Add a sample op, `add_op` · a0aaafe9
      Yu Yang 提交于
      * Refine register methods, make Op can get rid of whole-archieve
      * `USE_OP` before a op is used.
      * Add unittest for add_op.
      a0aaafe9