1. 08 12月, 2021 1 次提交
    • F
      Fix CUDAGraphAllocator bug for StreamSafeCUDAAllocator (#37821) · b4a67491
      From00 提交于
      * Fix CUDAGraph bug for StreamSafeCUDAAllocator
      
      * Add CUDAGrapthAllocator check in multi-stream interface
      
      * Set FLAGS_use_stream_safe_cuda_allocator defaulted to false
      
      * Fix environment error for cmake
      
      * Fix cmake error
      
      * Add UT of GetAllocatorInterfaceTest
      
      * Add UT of CUDAGraphExceptionTest
      
      * Enhance CUDAGraphExceptionTest
      b4a67491
  2. 25 11月, 2021 1 次提交
    • F
      Support multi-stream allocation for CUDA place (#37290) · b9c464c3
      From00 提交于
      * Support multi-stream allocation for CUDA place
      
      * Do not notify the retrying from other streams when free CUDA allocation
      
      * Fix compile error for CPU
      
      * Fix compile error for HIP
      
      * Release memory for StreamSafeCUDAAllocaRetry in malloc_test
      
      * Add FLAGS_use_stream_safe_cuda_allocator
      
      * Fix CI error for 'set_tests_properties'
      
      * Invalidate stream safe CUDA allocator for naive_best_fit and thread_local strategy
      
      * Performance improvement: insert allocation pair to outstanding_events_map when free but not alloc; replace recursive_mutex with SpinLock
      
      * FLAGS priority changes: FLAGS_use_system_allocator > FLAGS_use_stream_safe_cuda_allocator
      
      * Performance improvement: directly delete allocation when the recorded_streams is empty in FreeImpl of StreamSafeCUDAAllocator
      
      * Add UT for alloc interface
      
      * Changes multi-stream interface; move retry code from AllocatorFacadePrivate to StreamSafeCUDAAllocator
      b9c464c3
  3. 01 2月, 2021 1 次提交
  4. 14 1月, 2021 1 次提交
  5. 14 1月, 2020 1 次提交
  6. 24 9月, 2019 1 次提交
  7. 11 9月, 2019 1 次提交
    • H
      Replace TemporaryAllocator by CUDADeviceContextAllocator (#18989) · 12542320
      Huihuang Zheng 提交于
      TemporaryAllocator is a singleton used for allocating memory for Cudnn. Since it is a singleton, we can delete it for better performance in memory.
      
      We replace TemporaryAllocator by CUDADeviceContextAllocator and CUDADeviceContextAllocation, which uses stream callback to delete the memory allocated for the stream to avoid singleton.
      
      Also added data_feed_proto to operator to fix CI in CPU compilation
      12542320
  8. 11 3月, 2019 1 次提交
  9. 04 3月, 2019 3 次提交
  10. 01 3月, 2019 1 次提交
  11. 02 2月, 2019 2 次提交
  12. 16 11月, 2018 1 次提交
  13. 10 10月, 2018 1 次提交
  14. 28 9月, 2018 1 次提交
  15. 08 4月, 2018 3 次提交
  16. 03 4月, 2018 2 次提交
  17. 30 3月, 2018 1 次提交
  18. 10 2月, 2018 1 次提交
  19. 06 2月, 2018 1 次提交
  20. 30 1月, 2018 1 次提交
  21. 23 1月, 2018 2 次提交
  22. 16 1月, 2018 1 次提交
  23. 24 11月, 2017 1 次提交
  24. 28 10月, 2017 1 次提交
  25. 15 8月, 2017 1 次提交
  26. 04 8月, 2017 2 次提交
  27. 29 7月, 2017 1 次提交
  28. 27 7月, 2017 1 次提交
  29. 23 7月, 2017 2 次提交
  30. 22 7月, 2017 2 次提交