提交 f6a710ef 编写于 作者: K kinghuin 提交者: wuzewu

debug ernie tiny reader

上级 a2a9719b
......@@ -183,6 +183,7 @@ class WSSPTokenizer(object):
if not matched:
i = 1
words.append(unk_token)
print(chars[idx])
idx += i
return words
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册