1. 26 10月, 2021 1 次提交
    • S
      [Cherry-pick] Add FasterTokenizer Operator (#36716) · edff5b79
      Steffy-zxf 提交于
      * Add FasterTokenizer Operator (#34491)
      
      Add Tokenizer related functionalities for Transformer model in order that the process of training and predicting is consistent.
      
      * support the text string as an input Tensor
      * support the "VOCAB"unordered_map<wstring, int> as an input Tensor to lookup tokens
      * Tokenizer used for BERT. This tokenizer applies an end-to-end, text string to wordpiece tokenization.
      * It first applies basic tokenization, followed by wordpiece tokenization.
      
      * optimize fast tokenizer
      
      * remove const_cast
      Co-authored-by: Nzhoushunjie <zhoushunjie@baidu.com>
      Co-authored-by: Nwawltor <fangzeyang0904@hotmail.com>
      edff5b79
  2. 02 9月, 2020 1 次提交
  3. 12 4月, 2020 1 次提交
  4. 29 11月, 2019 1 次提交
    • H
      Add dygraph execution context (#20157) · ac854670
      hong 提交于
      * add_dygraph_execution_context
      
      * add dygraph infershape context and execution context; test=develop
      
      * fix imperative bug; test=develop
      
      * remove inputs outputs interface from execution context,
      because it have same function with inputNames;
      test=develop
      
      * remove tracer_test ctest; test=develop
      
      * fix split op bug; test=develop
      
      * fix unitests bug; test=develop
      
      * fix distribute test bug; test=develop
      
      * fix ngraph compile bug; test=develop
      
      * fix grad maker bug; test=develop
      
      * fix load op bugs; test=develop
      
      * fix operator.cc construct bug; test=develop
      
      * remove useless name find in operator; test=develop
      
      * add tracer_test; test=develop
      
      * fix concat, split bug; test=develop
      
      * remove tracer_test unitest; test=develop
      
      * fix attribute check bug; test=develop
      
      * add test code to fix converage; test=develop
      
      * remove useless code, change check backward input in engin; test=develop
      
      * unlock var type infer shape;test=develop
      
      * add ShareAllLoD api; test=develop
      
      * add dygraph infershape context unitest; test=develop
      
      * remove increase and decrease lod in dygraph; test=develop
      
      * addd override; test=develop
      
      * fix increase descrease lod; test=develop
      
      * fix paddle_enforce; test=develop
      
      * disable lod op dygraph check; test=develop
      
      * fix paddle enforce error; test=develop
      
      * add comment for op_registry and OperatorBase; test=develop
      
      * optimize the comment of op_registry; test=develop
      
      * fix format of comment; test=develop
      
      * fix format of comment; test=develop
      
      * optimize the format of comment; test=develop
      
      * optimize the format of the comment; test=develop
      
      * optimize comment of op_registry; test=develop
      ac854670
  5. 31 7月, 2019 1 次提交
  6. 12 6月, 2019 1 次提交
  7. 20 3月, 2019 2 次提交
  8. 15 2月, 2019 1 次提交
  9. 29 12月, 2018 2 次提交
  10. 28 12月, 2018 1 次提交
  11. 12 12月, 2018 1 次提交
  12. 06 12月, 2018 2 次提交
  13. 08 11月, 2018 1 次提交
  14. 05 11月, 2018 1 次提交
  15. 26 10月, 2018 1 次提交
  16. 24 10月, 2018 2 次提交
  17. 16 10月, 2018 1 次提交
  18. 16 5月, 2018 1 次提交
  19. 08 5月, 2018 1 次提交
    • Y
      Clean OpProtoAndCheckerMaker · 0e78cb69
      Yu Yang 提交于
      Do not use ctor
      
      * Reduce line of codes.
      * We can use virtual function for Maker now.
      * The implementation does not care what maker holds, it is easier to
      refactor later.
      0e78cb69
  20. 15 2月, 2018 1 次提交
    • Y
      Update tensor_util.h (#8422) · cfffb1a3
      Yi Wang 提交于
      * Update tensor_util.h
      
      * Update with moved TensorDesc
      
      * Fix tensur_utils.cu
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Make tensor_util.cu a symbolic link
      cfffb1a3
  21. 12 2月, 2018 1 次提交
  22. 10 2月, 2018 2 次提交
  23. 09 2月, 2018 1 次提交
  24. 31 1月, 2018 1 次提交
    • S
      Add variant of new load and save ops for storing model params in a single file (#7909) · 2e907c36
      Siddharth Goyal 提交于
      * Add save_combine_op
      
      * Add load_combine_op and test
      
      * Add unit-test
      
      * Add a delete to free buffer memory
      
      * Add new variant of load/save
      
      * Fix unit-test
      
      * Add another unit test for compatibility with original save/load
      
      * Address review comments and simplify logic
      
      * Address review comments and simplify code - part 2
      
      * Fix naming issues and CMake problems
      
      * Address review comments
      
      * Fix LoD information in tests
      
      * Address review comments: round 2
      2e907c36