• S
    Refine some AMP operators for BERT (#37923) · d80fe268
    sneaxiy 提交于
    * support multi precision update for LAMB
    
    * hide some api
    
    * fix ci uts
    
    * fix lamb output of dygraph
    
    * remove some changes to some PR
    
    * try to fix Py3 CI compile error
    
    * fix test_imperative_optimizer, add lars ut, add layer_norm ut
    
    * fix ut, fix format
    
    * fix ut
    
    * fix windows ci
    d80fe268
optimizer.py 50.2 KB