1. 19 12月, 2020 1 次提交
    • L
      Fix hung (#5121) · 4d87afd6
      liu zhengxi 提交于
      * fix hung
      
      * add shuffle batch
      
      * update
      
      * reader_seed to shuffle_seed
      
      * seed for shuffle batch
      4d87afd6
  2. 18 12月, 2020 1 次提交
  3. 16 12月, 2020 1 次提交
  4. 15 12月, 2020 1 次提交
  5. 10 12月, 2020 1 次提交
    • J
      Add TokenEmbedding (#4983) · e59f15a1
      Jack Zhou 提交于
      * Add TokenEmbedding
      
      * download corpus embedding data
      * load embedding data by specifying corpus name
      * extend the vocab of tokenizer from corpus embedding data
      
      * add unk token setting
      
      * modify tokenizer
      
      * add extend voacb
      
      * move jieba tokenizer and rename corpus_name->embedding_name
      
      * use bos url instead of localhost
      
      * add log when loading data
      
      * add token dot computation; add __repr__ of TokenEmbedding
      
      * add color logging
      
      * use paddlenlp.utils.log
      
      * adjust repr
      
      * update pretrained embedding table
      
      * fix padding idx
      e59f15a1
  6. 08 12月, 2020 1 次提交
  7. 07 12月, 2020 2 次提交