• Q
    Support backward of backward for Relu and add a new gradient checker by... · c1c2633a
    qingqing01 提交于
    Support backward of backward for Relu and add a new gradient checker by comparing theoretical and numerical Jacobian. (#16862)
    
    * Support backward of backward and a new gradient checker
    * Rename decorators.py to decorator_helper.py, since Python on Windows CI has decorators package.
    
    1. Add ReluDoubleGradMaker when register relu_grad.
    2. Add a new gradient checker by comparing theoretical and numerical Jacobian.  Check double gradients by double_grad_check.
    c1c2633a
activation_op.cu 2.5 KB