• J
    Add some lr schedulers with warmup (#5256) · fee616e8
    Jiaqi Liu 提交于
    * add -linear-schedule-with-warmup
    
    * update lr scheduler usage in run_glue
    
    * add import info
    
    * add other 5 scheduler with warmup
    
    * add copyright, update usage in run_glue
    
    * simplify argument, make warmup arg support float and int
    
    * Add some LambdaDecay scheduler with warmup, update usage in run_glue
    
    * update classname and unify two cosine decays into one
    
    * update usage in run_glue
    
    * fix typo
    
    * update WarmUp to Warmup, and update class name about Const, and update doc, and usage
    
    * update usage of decay class
    
    * update usage of decay class
    fee616e8
train.py 11.8 KB