1. 17 12月, 2021 1 次提交
    • S
      Refine some AMP operators for BERT (#37923) · d80fe268
      sneaxiy 提交于
      * support multi precision update for LAMB
      
      * hide some api
      
      * fix ci uts
      
      * fix lamb output of dygraph
      
      * remove some changes to some PR
      
      * try to fix Py3 CI compile error
      
      * fix test_imperative_optimizer, add lars ut, add layer_norm ut
      
      * fix ut, fix format
      
      * fix ut
      
      * fix windows ci
      d80fe268
  2. 31 5月, 2021 1 次提交
  3. 17 1月, 2021 1 次提交
  4. 24 11月, 2020 1 次提交
  5. 27 9月, 2020 1 次提交
  6. 28 8月, 2020 1 次提交
  7. 23 8月, 2020 1 次提交
    • M
      [WIP] update optimizer for 2.0 (#26288) · eeda90d6
      MRXLT 提交于
      refine Optimizer/Adam/Admax/RMSProp && add Admw
      
      * buf fix
      
      * update comment
      
      * unify arguments place; notest
      
      * fix ut, test=develop
      
      * bug fix
      
      * fix conflicts, test=develop
      
      * add examples code
      
      * bug fix
      
      * fix comments
      
      * fix sample code
      
      * add sample code for Optimizer
      
      * add adamax ut, test=develop
      
      * fix rmsprop ut, test=develop
      
      * add ut for optimizer.py and adamw.py
      
      * remove TestAdamOptimizerBetaVariable
      
      * update api && add ut
      
      * update doc && fix ut
      
      * add ut
      Co-authored-by: Nmapingshuo <mps2012@yeah.net>
      eeda90d6