You need to sign in or sign up before continuing.
  • Z
    [AMP] support GPU BF16 amp for dygraph (#39029) · 7d6d3848
    zhangbo9674 提交于
    * support dtype param for auto_cast
    
    * add amp_dtype for tracer
    
    * add unsupported bf16 list
    
    * support bf16 amp for O2
    
    * refine python interface for bfloat16
    
    * refine code
    
    * refine code
    
    * refine unittest
    
    * refine code
    
    * refine code
    
    * add bf16 o1
    
    * refine code by comment
    
    * add gradient accumulator
    
    * add recompute
    7d6d3848
gradient_accumulator.cc 37.1 KB