1. 18 5月, 2023 1 次提交
    • shaojie_wang's avatar
      [AMP]Master grad in static graph (#53362) · 972581d8
      shaojie_wang 提交于
      * add master gradients on static graph
      
      * add unit test for bf16 master grad static graph
      
      * use float16 as v100 test dtype
      
      * only skip GPU which do not support bf16
      
      * use linear layer to test master grad
      
      * 1.push master grad creation before all optimizer ops; 2.remove useless unittest; 3.use a function to create master grad states
      972581d8
  2. 16 5月, 2023 2 次提交
  3. 15 5月, 2023 1 次提交
  4. 09 5月, 2023 1 次提交
  5. 08 5月, 2023 1 次提交
  6. 27 4月, 2023 1 次提交
  7. 24 4月, 2023 3 次提交
  8. 18 4月, 2023 2 次提交
  9. 14 4月, 2023 1 次提交
    • Y
      [AMP] Unify the static amp codes of fp16 and bf16. (#52694) · dfcba7f4
      Yiqun Liu 提交于
      * Unify the static amp codes of fp16 and bf16.
      
      * Polish apis and add unittest.
      
      * Add operator stats collecting tools for program.
      
      * Add the check of number of bloat16 operators in unittest.
      
      * Add warning for operator not supported for amp.
      
      * Add testing of BF16 O1 and O2.
      dfcba7f4
  10. 13 4月, 2023 1 次提交
  11. 12 4月, 2023 1 次提交
  12. 10 4月, 2023 1 次提交
  13. 03 4月, 2023 1 次提交
  14. 30 3月, 2023 1 次提交