提交 4a11ec10 编写于 作者: T tianxin 提交者: Yibing Liu

tiny fix (#3024)

上级 7fdde01a
......@@ -159,7 +159,7 @@ class DataReader(object):
src_ids = origin_src_ids[:origin_sep_index + 1] + pair_src_ids[
pair_sep_index + 1:]
if len(src_ids) >= self.max_seq_len:
if len(src_ids) > self.max_seq_len:
miss_num += 1
continue
sent_ids = [0] * len(origin_src_ids[:origin_sep_index + 1]) + [
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册