Fix Checkpoint-loading with Meta-tensor (#2781)
* Reset KV-cache at the beginning of text-generation * Pass the ckpt-loading arguments to work with meta-tensor * remove unrelated changes
Showing
想要评论请 注册 或 登录
* Reset KV-cache at the beginning of text-generation * Pass the ckpt-loading arguments to work with meta-tensor * remove unrelated changes