1. 02 3月, 2020 1 次提交
    • C
      Speed up dygraph DataLoader based on shared memory and LoDTensor serialization (#22541) · 7d8d5734
      Chen Weihang 提交于
      * add lodtensor share memory & serialization, test=develop
      
      * fix windows compile error, test=develop
      
      * deal vartype pickle & fix unittest matching error message, test=develop
      
      * update timeout variable name, test=develop
      
      * refactor memory map implement, test=develop
      
      * clear mmap file discripter when exit unexpectedly, test=develop
      
      * remove the child process fd in advance, test=develop
      
      * remove mmap fds after Queue.put in child process, test=develop
      
      * add hard unittests for register exit func, test=develop
      
      * fix python2 compatibility problem in unittest, test=develop
      
      * fix exception unittest error, test=develop
      
      * polish code based review comment, test=develop
      7d8d5734
  2. 28 2月, 2020 1 次提交
  3. 17 2月, 2020 1 次提交
  4. 19 1月, 2020 1 次提交
  5. 16 1月, 2020 1 次提交
    • C
      Speeding up dygraph DataLoader with multiprocessing (#21762) · 35efbe6d
      Chen Weihang 提交于
      * add multiprocess for dygraph data loader, test=develop
      
      * polish code & add safe gurad, test=develop
      
      * refactor dygraph dataloader & add signal handler, test=develop
      
      * fix member initializer compile error on ci, test=develop
      
      * fix member initializer compile error one more, test=develop
      
      * remove useless config, test=develop
      
      * skip windows incompatible problem, test=develop
      
      * add unittest for coverage, test=coverage
      
      * add more exception unittest case, test=develop
      
      * deal with signal handler coverage, test=develop
      
      * polish code & add signal handler tests, test=develop
      
      * deal with coverage ci problem, test=develop
      
      * split data loader test & coverage ci fix, test=develop
      
      * remove test_imperative_data_loader_with_exception, test=develop
      
      * remove singal process except test case, test=develop
      
      * add exception tests again & remove sample list test, test=develop
      
      * split normal and exception unittests to diff class, test=develop
      
      * polish doc for use_multiprocess effect in static mode, test=develop
      35efbe6d
  6. 16 12月, 2019 1 次提交
  7. 10 12月, 2019 1 次提交
  8. 29 10月, 2019 1 次提交
  9. 14 10月, 2019 1 次提交
    • Z
      Refine py_reader exit (#20331) · 40effc61
      Zeng Jinle 提交于
      * refine py_reader exit, test=develop
      
      * fix multiprocess_reader exception unittest, test=develop
      
      * increase code coverage for legacy fluid.layers.py_reader, test=develop
      40effc61
  10. 12 10月, 2019 1 次提交
  11. 10 10月, 2019 1 次提交
  12. 26 9月, 2019 1 次提交
  13. 23 9月, 2019 1 次提交
    • Z
      Unify DataLoader APIs (#19305) · 0436efd6
      Zeng Jinle 提交于
      * unify DataLoader APIs, test=develop
      
      * integrate iterable CPU Dataset, test=develop
      add GPU dataset supporting, test=develop
      
      * add unittests for dataset, test=develop
      
      * add more docs to dataloader apis, test=develop, test=document_preview
      
      * refine doc, test=develop
      
      * refine doc again, test=develop
      
      * increase coverage, test=develop
      0436efd6
  14. 22 7月, 2019 1 次提交
  15. 02 7月, 2019 1 次提交
  16. 19 6月, 2019 1 次提交
    • H
      Fix API example code (#18176) · bbc29292
      Huihuang Zheng 提交于
      The fixed APIs:
      6 Methods in paddle.fluid.io.PyReader
      paddle.fluid.layers.Preprocessor
      paddle.fluid.layers.py_reader
      paddle.fluid.io.save_params
      paddle.fluid.io.save_persistables
      
      test=develop
      test=document_preview
      bbc29292
  17. 06 6月, 2019 1 次提交
  18. 08 5月, 2019 1 次提交
    • H
      Fix some data and reader related API code (#17202) · 648320bb
      Huihuang Zheng 提交于
      * Fix data and reader related api doc
      
      * Fix data and reader related api doc
      
      Review and fix the example code in some reader related API doc.
      
      These APIs are:
      
      Fix existing API example codes:
      
      paddle.fluid.io.PyReader
      paddle.fluid.layers.batch
      paddle.fluid.layers.data
      paddle.fluid.layers.Preprocessor
      paddle.fluid.layers.py_reader
      paddle.fluid.program_guard
      
      Add new example codes:
      
      paddle.fluid.io.PyReader.decorate_batch_generator
      paddle.fluid.io.PyReader.decorate_sample_generator
      paddle.fluid.io.PyReader.decorate_sample_list_generator
      paddle.fluid.io.PyReader.reset
      paddle.fluid.io.PyReader.start
      
      test=develop
      
      * Add changes to API.spec after changing doc.
      
      test=develop
      
      * Add blanks after python example code
      
      test=develop
      
      * Add blank line at py_reader example code
      
      test=develop
      
      * Merge API.spec
      
      test=develop
      
      * Modify reader.py based on reviewer's comment
      
      test=develop
      
      * Modify API.spec after changing doc
      
      test=develop
      
      * Change reader.py based on reviewer's comment
      
      * Modify example code of decorate_sample_generator
      
      test=develop
      
      * Fix example code of PyReader based on reviewer
      
      test=develop
      648320bb
  19. 20 3月, 2019 1 次提交
  20. 19 3月, 2019 1 次提交
  21. 11 3月, 2019 1 次提交
  22. 01 3月, 2019 1 次提交
  23. 27 2月, 2019 1 次提交
  24. 26 2月, 2019 1 次提交
    • S
      add doc · 2e67f8ae
      sneaxiy 提交于
      test=develop
      2e67f8ae
  25. 25 2月, 2019 2 次提交
  26. 20 2月, 2019 2 次提交