Fix the tensor-slicing copy for qkv parameters (#2198)

Co-authored-by: N Olatunji Ruwase <olruwase@microsoft.com>

Fix the tensor-slicing copy for qkv parameters (#2198)
Co-authored-by: N Olatunji Ruwase <olruwase@microsoft.com>
8920308c · Reza Yazdani · GitHub · 28dfca8a · 8920308c
隐藏空白更改
内联并排

Showing with 2 addition and 2 deletion

deepspeed/module_inject/replace_module.py deepspeed/module_inject/replace_module.py +2 -2

未找到文件。
--- a/deepspeed/module_inject/replace_module.py
+++ b/deepspeed/module_inject/replace_module.py
@@ -483,8 +483,8 @@ def replace_transformer_layer(orig_layer_impl,
                        attn_block.attn_ow = mp_replace.copy(attn_block.attn_ow, dense_w)
                        attn_block.attn_ob = mp_replace.copy(attn_block.attn_ob, dense_b)
            else:
-                attn_block.attn_qkvw = mp_replace.copy(attn_block.attn_qkvw, qkvw)
-                attn_block.attn_qkvb = mp_replace.copy(attn_block.attn_qkvb, qkvb)
+                attn_block.attn_qkvw = mp_replace.qkv_copy(attn_block.attn_qkvw, qkvw)
+                attn_block.attn_qkvb = mp_replace.qkv_copy(attn_block.attn_qkvb, qkvb)

                attn_block.attn_ow = mp_replace.copy(attn_block.attn_ow, dense_w)
                attn_block.attn_ob = mp_replace.copy(attn_block.attn_ob, dense_b)