1. 26 10月, 2021 1 次提交
    • S
      [Cherry-pick] Add FasterTokenizer Operator (#36716) · edff5b79
      Steffy-zxf 提交于
      * Add FasterTokenizer Operator (#34491)
      
      Add Tokenizer related functionalities for Transformer model in order that the process of training and predicting is consistent.
      
      * support the text string as an input Tensor
      * support the "VOCAB"unordered_map<wstring, int> as an input Tensor to lookup tokens
      * Tokenizer used for BERT. This tokenizer applies an end-to-end, text string to wordpiece tokenization.
      * It first applies basic tokenization, followed by wordpiece tokenization.
      
      * optimize fast tokenizer
      
      * remove const_cast
      Co-authored-by: Nzhoushunjie <zhoushunjie@baidu.com>
      Co-authored-by: Nwawltor <fangzeyang0904@hotmail.com>
      edff5b79
  2. 14 7月, 2021 1 次提交
  3. 05 3月, 2021 1 次提交
  4. 03 2月, 2021 1 次提交
  5. 13 1月, 2021 1 次提交
  6. 04 1月, 2021 1 次提交
  7. 21 12月, 2020 1 次提交
  8. 07 12月, 2020 1 次提交
  9. 11 11月, 2020 1 次提交
  10. 28 8月, 2020 1 次提交
  11. 14 7月, 2020 1 次提交
  12. 02 7月, 2020 1 次提交
  13. 10 6月, 2020 1 次提交
  14. 05 6月, 2020 1 次提交
  15. 01 6月, 2020 1 次提交
    • S
      support C++ inference shared library on windows (#24672) · 126d3d69
      silingtong123 提交于
      * add SetCommandLineOption
      
      * add the print_FLAGS function
      
      * remove the test demo
      
      * modify the location of macro
      
      * add the 'WITH_STATIC_LIB' option on windows
      
      * modify the macro of PD_INFER_DECL
      
      * modify the the fuction name
      
      * modify the unittest
      
      * modify the code style
      126d3d69
  16. 05 4月, 2020 1 次提交
  17. 03 4月, 2020 1 次提交
  18. 04 2月, 2020 1 次提交
  19. 17 9月, 2019 1 次提交
  20. 26 3月, 2019 1 次提交
  21. 20 3月, 2019 1 次提交
    • N
      cherry-pick from feature/anakin-engine: add data type for zero copy #16313 · 4f4daa4b
      nhzlx 提交于
      1. refine anakin engine
      2. add data type for zero copy
      
      align dev branch and PaddlePaddle:feature/anakin-engine brach
      the cudnn workspace modify was not included for now, because we use a hard code way
      in feature/anakin-engine branch. There should be a better way to implement it,
      and subsequent submissions will be made.
      
      test=develop
      4f4daa4b
  22. 08 3月, 2019 2 次提交
  23. 07 3月, 2019 1 次提交
  24. 01 3月, 2019 1 次提交
  25. 21 2月, 2019 1 次提交
  26. 14 2月, 2019 1 次提交
  27. 29 1月, 2019 1 次提交
  28. 28 1月, 2019 2 次提交
  29. 18 1月, 2019 1 次提交
  30. 17 1月, 2019 1 次提交
  31. 09 1月, 2019 1 次提交
  32. 08 1月, 2019 1 次提交
  33. 23 11月, 2018 2 次提交
  34. 14 11月, 2018 1 次提交
  35. 24 10月, 2018 1 次提交
  36. 19 10月, 2018 2 次提交