Fix wrong idx bug in invertible LayerNormBackward1 (#692)
* fix wrong idx bug in invertible LayerNormBackward1
this index bug cause wrong scale grad
* fix unexpected deletion
* fix idx for LayerNormBackward1_fused_add
* move pos defination in LayerNormBackward1 kernels
* fix format error
Co-authored-by: NReza Yazdani <reyazda@microsoft.com>
Showing
想要评论请 注册 或 登录