mask issue during pretraining
Created by: Sherriiie
共有2个问题,
-
在这个函数里 _convert_example_to_record(), 下面的label_id是怎么来的? ` if self.is_inference: Record = namedtuple('Record', ['token_ids', 'text_type_ids', 'position_ids']) record = Record( token_ids=token_ids, text_type_ids=text_type_ids, position_ids=position_ids) else: if self.label_map: label_id = self.label_map[example.label] else: label_id = example.label
Record = namedtuple('Record', [ 'token_ids', 'text_type_ids', 'position_ids', 'label_id', 'qid' ]) qid = None if "qid" in example._fields: qid = example.qid record = Record( token_ids=token_ids, text_type_ids=text_type_ids, position_ids=position_ids, label_id=label_id, qid=qid)`
-
论文里面的 incremental learning, 是通过多次数据预处理生成不同的mask labels 实现的吗? 这样的话需要根据不同的数据跑代码多次?