1. 02 3月, 2020 1 次提交
    • C
      Speed up dygraph DataLoader based on shared memory and LoDTensor serialization (#22541) · 7d8d5734
      Chen Weihang 提交于
      * add lodtensor share memory & serialization, test=develop
      
      * fix windows compile error, test=develop
      
      * deal vartype pickle & fix unittest matching error message, test=develop
      
      * update timeout variable name, test=develop
      
      * refactor memory map implement, test=develop
      
      * clear mmap file discripter when exit unexpectedly, test=develop
      
      * remove the child process fd in advance, test=develop
      
      * remove mmap fds after Queue.put in child process, test=develop
      
      * add hard unittests for register exit func, test=develop
      
      * fix python2 compatibility problem in unittest, test=develop
      
      * fix exception unittest error, test=develop
      
      * polish code based review comment, test=develop
      7d8d5734
  2. 16 2月, 2020 1 次提交
  3. 16 1月, 2020 1 次提交
    • C
      Speeding up dygraph DataLoader with multiprocessing (#21762) · 35efbe6d
      Chen Weihang 提交于
      * add multiprocess for dygraph data loader, test=develop
      
      * polish code & add safe gurad, test=develop
      
      * refactor dygraph dataloader & add signal handler, test=develop
      
      * fix member initializer compile error on ci, test=develop
      
      * fix member initializer compile error one more, test=develop
      
      * remove useless config, test=develop
      
      * skip windows incompatible problem, test=develop
      
      * add unittest for coverage, test=coverage
      
      * add more exception unittest case, test=develop
      
      * deal with signal handler coverage, test=develop
      
      * polish code & add signal handler tests, test=develop
      
      * deal with coverage ci problem, test=develop
      
      * split data loader test & coverage ci fix, test=develop
      
      * remove test_imperative_data_loader_with_exception, test=develop
      
      * remove singal process except test case, test=develop
      
      * add exception tests again & remove sample list test, test=develop
      
      * split normal and exception unittests to diff class, test=develop
      
      * polish doc for use_multiprocess effect in static mode, test=develop
      35efbe6d