1. 26 10月, 2021 1 次提交
    • S
      [Cherry-pick] Add FasterTokenizer Operator (#36716) · edff5b79
      Steffy-zxf 提交于
      * Add FasterTokenizer Operator (#34491)
      
      Add Tokenizer related functionalities for Transformer model in order that the process of training and predicting is consistent.
      
      * support the text string as an input Tensor
      * support the "VOCAB"unordered_map<wstring, int> as an input Tensor to lookup tokens
      * Tokenizer used for BERT. This tokenizer applies an end-to-end, text string to wordpiece tokenization.
      * It first applies basic tokenization, followed by wordpiece tokenization.
      
      * optimize fast tokenizer
      
      * remove const_cast
      Co-authored-by: Nzhoushunjie <zhoushunjie@baidu.com>
      Co-authored-by: Nwawltor <fangzeyang0904@hotmail.com>
      edff5b79
  2. 24 9月, 2020 1 次提交
    • W
      use iwyu clean include (#27267) · df43905f
      wanghuancoder 提交于
      * use iwyu clean include, test=develop, test=win
      
      * compilation error, test=develop
      
      * fix compilation error2, test=develop
      
      * fix compilation error3, test=develop
      
      * fix compilation error4, test=develop
      
      * fix compilation error5, test=develop
      
      * fix compilation error6, test=develop
      
      * fix compilation error7, test=develop
      
      * fix compilation error8, test=develop
      
      * fix compilation error8, test=develop
      
      * fix compilation error10, test=develop
      
      * fix compilation error11, test=develop
      df43905f
  3. 19 4月, 2020 1 次提交
    • G
      Support LoDTensorArray in fetch (#23645) · 2b896c1f
      guofei 提交于
      * Support LoDTEnsorArray in fetch op
      
      test=develop
      
      * Support LoDTensorArray in fetch
      
      test=develop
      
      * Support LoDTensorArray in fetch
      
      test=develop
      
      * Support LoDTensorArray in fetch
      
      test=develop
      
      * Support LoDTensorArray in fetch
      
      test=develop
      
      * Support LoDTensorArray in fetch
      
      test=develop
      
      * Support LoDTensorArray in fetch
      
      test=develop
      
      * Support LoDTensorArray in fetch
      
      test=develop
      
      * Support LoDTensorArray in fetch
      
      test=develop
      
      * Support LoDTensorArray in fetch
      
      test=develop
      2b896c1f
  4. 13 2月, 2019 1 次提交
  5. 09 12月, 2018 1 次提交
  6. 07 12月, 2018 2 次提交
  7. 06 12月, 2018 1 次提交
  8. 03 12月, 2018 2 次提交
  9. 26 11月, 2018 1 次提交
  10. 08 11月, 2018 1 次提交
  11. 17 10月, 2018 1 次提交
  12. 16 10月, 2018 2 次提交
  13. 15 10月, 2018 1 次提交
  14. 13 10月, 2018 1 次提交
  15. 12 10月, 2018 1 次提交
    • X
      Avoid GetMutable implicitly reset Var Type. · 22850661
      Xin Pan 提交于
      This can cause a lot of problem:
      1. Wrong operator implementation, Op can get a wrong type without failure.
      2. Anytype can be Get without defined in VarType.
      
      Also fix wrong STEP_SCOPE usage.
      
      test=develop
      22850661
  16. 19 4月, 2018 1 次提交
  17. 12 2月, 2018 1 次提交
  18. 10 2月, 2018 2 次提交
  19. 26 1月, 2018 1 次提交
    • K
      New Run() method for framework::Executor (#7807) · 788f5c6d
      kexinzhao 提交于
      * initial commit
      
      * add new executor run function
      
      * fix bug
      
      * fix multiple definition of feed_fetch_method issue
      
      * fix cmake
      
      * fix tensor copy error
      
      * refine executor code
      
      * add comments
      
      * temporary modification
      
      * address comments
      
      * fix bug
      788f5c6d
  20. 20 10月, 2017 4 次提交
    • Y
      Feature/remove global scope (#4950) · 102a5f34
      Yu Yang 提交于
      * Unify `set_feed_variable` to one method
      
      * Move global scope to python, not in C++
      102a5f34
    • Y
      Unify `set_feed_variable` to one method (#4949) · 42f2dd40
      Yu Yang 提交于
      42f2dd40
    • Y
      Remove template parameter for Tensor methods (#4937) · c532b967
      Yu Yang 提交于
      * Remove template parameter for Tensor methods
      
      * Also check the type is correct when data()
      * Simplize holder_
      
      * Fix accuracy_op
      
      * Register Code
      c532b967
    • Y
      Feature/py executor test (#4922) · 3db52783
      Yu Yang 提交于
      * Implement FC layer with helper
      
      * Update LayerHelper
      
      * Add debug string for Python ProtoBuf
      
      and Rename `Sync` to `Flush`
      
      * Add check of ProtoBuf initialization
      
      * Layer wrapper for FC
      
      * Fix unittest
      
      * Fix CI
      
      * Add code generator
      
      * AttributeChecker Better error log and speicalize bool
      
      Since lots of types can be cast to bool
      
      * Complete mlp, fit_a_line
      
      * Expose get global scope
      
      * Make global scope not thread-safe
      
      1. It is no need to make global scope thread-safe, since it will be
      invoked in Python main thread.
      2. Do not free the global scope when C++ exit. Let the OS free memories,
      otherwise, we need to handle the destroy dependencies.
      
      See
      https://google.github.io/styleguide/cppguide.html#Static_and_Global_Variables
      
      * Fix
      
      * Implementation of simple conv_2d layer
      
      * Stash
      
      * Remove private data members in OpRegister
      
      * Fix bugs
      
      * Stash
      
      * Expose FeedFetchList as VarType
      
      * Change ProgramDesc not a global variable
      
      * Polish code style
      
      * Stash
      
      * Correct implement BlockDesc destructor
      
      * Correct implement BlockDesc destructor
      
      * Unify program as parameter name
      
      * Fix bugs
      
      * Add unittest
      
      * Fix unit test error
      
      * Remove unused functions
      
      * Add clone for Python Program
      
      * Working on executor
      
      * Stash
      
      * Add glog as dependencies of ops
      
      * Use VLOG to logging some information is helpful when we debug Paddle
      
      * Expose VarDesc::persistable to Python
      
      * Test executor
      
      * Complete unittest
      
      * Polish code
      
      * Fix merge error
      
      * Follow comment
      
      * Polish Python Code
      3db52783
  21. 17 10月, 2017 2 次提交