• W
    [New features] Support batch_jacobian and batch_hessian (#37547) · 4d24d352
    Weilong Wu 提交于
    * native commit for triple grad of sigmod
    
    * Updated unittests files
    
    * init functional jacobian api
    
    * Updated trible_test func
    
    * Updated gradient_checker & test_script
    
    * finish test with dtype float32
    
    * add float64 test case
    
    * polish code
    
    * use atol=1e-5 with dtype float64
    
    * fix for ci
    
    * set timeout for test_jacobian
    
    * fix dygraph grad to support high differential
    
    * polish API docstring
    
    * Updated gradient checker and some related files
    
    * fix double grad strip error for high differential
    
    * fix double grad strip error for high differential
    
    * Add Sigmoid triple grad tests
    
    * fix dygraph double grad dtype error when calling for high differential senario
    
    * Updated triple grad teses func
    
    * Use np.random to initialize ddx
    
    * Updated triple_grad_check func
    
    * add todo for gradient checker and refine some comments
    
    * remove additional code
    
    * add test for warnging in backward.py
    
    * format python code
    
    * support multi input in triple gradient checker
    
    * Add matmul triple grad kernel
    
    * Updated comments of TODO
    
    * Supported some special tests
    
    * Change code-format to follow CI std
    
    * Updated gradient_checker.py
    
    * Fix conflicts
    
    * Removed unnecessary printing log
    
    * Change code style to follow CI std
    
    * support batch in jacobian and hessian
    
    * add batch jacobian and batch hessian
    
    * Add batch_jacobian test, draft version
    
    * [New features] Add elementwise_mul triple grad kernel (#37152)
    
    * Add elementwise_mul triple grad kernel
    
    * Removed InplaceInferer and polished code
    
    * Add numerical_batch_jacobian,numerical_batch_hessian and tests
    
    * Support batch_jacobian and batch_numerical
    
    * Use pre-commit to check code format
    
    * Update doc, polish code, add unit test
    
    * Reset the TIMEOUT properties of test_jacobian to pass CI
    Co-authored-by: Nlevi131 <limaolin01@baidu.com>
    Co-authored-by: NJiabin Yang <360788950@qq.com>
    4d24d352
utils.py 7.3 KB