未验证 提交 8511e030 编写于 作者: S sneaxiy 提交者: GitHub

Fix MemoryEfficientAttentionGradInferMeta error when bias is not None (#55388)

* fix mea backward seg fault

* fix bias stride error

* fix MemoryEfficientAttentionGradInferMeta
上级 39a386c7
...@@ -728,7 +728,7 @@ void MemoryEfficientAttentionGradInferMeta(const MetaTensor& query, ...@@ -728,7 +728,7 @@ void MemoryEfficientAttentionGradInferMeta(const MetaTensor& query,
value_grad->set_dtype(value.dtype()); value_grad->set_dtype(value.dtype());
value_grad->set_layout(value.layout()); value_grad->set_layout(value.layout());
if (bias) { if (bias && bias_grad) {
const int64_t bias_batch_size = bias.dims()[0]; const int64_t bias_batch_size = bias.dims()[0];
const int64_t bias_seq_length = bias.dims()[1]; const int64_t bias_seq_length = bias.dims()[1];
const int64_t bias_num_head = bias.dims()[2]; const int64_t bias_num_head = bias.dims()[2];
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册