• Z
    Add multi_tensor for momentum optimizer and clear_grads (#37564) · 0cc5e22c
    zhangbo9674 提交于
    * add multi_tensor for momentum and clear_grads for optimizer
    
    * fix bug for dygraph
    
    * add unittest
    
    * refine comment
    
    * add param_group
    
    * refine regularizaiton logic
    
    * del clear_grads
    
    * add clear_grads
    
    * add dispensable check of None
    
    * refine clear_grad
    
    * fix build bug
    
    * refine code by comment
    
    * refine code
    
    * add multi tensor check
    
    * refine param_group update
    
    * add multi tensor for static mode
    
    * refine comments
    
    * delete useless comma for momentum
    
    * refine comment for momentum
    
    * refine code by commment
    0cc5e22c
optimizer.py 54.0 KB