1. 07 8月, 2023 2 次提交
    • T
      Update Build docker images (#55835) · bbafed4c
      tianshuo78520a 提交于
      * Test Build;test=document_fix
      
      * Test Build;test=document_fix
      
      * Fix gcc error
      bbafed4c
    • U
      [WIP] Integration flash attention 2 (#55758) · 0473369f
      umiswing 提交于
      * Work for fa-2 padded fwd. Code to be cleaned.
      
      * Work for fa2 unpadded fwd.
      
      * Work for padded-bwd, dk get small diff on np.random.seed(0)
      
      * Anyway I pass paddle's utest, except return softmax without dropout.
      
      * Clean code.
      
      * Modify interface.
      
      * Clean code and add some check.
      
      * Easy compile for dev.
      
      * Fix ci.
      
      * Fix ci-build.
      
      * Add std c++17 option again.
      
      * Limit max job when compiling fa2.
      
      * Remove const_cast
      
      * Add fwd params, to be cleaned.
      
      * Clean code.
      
      * Add bwd params.
      
      * Clean code.
      
      * Add enforce.
      
      * Use v2.0.4
      
      * Pass RNG state to fa2 capi
      
      * Fix review.
      
      * Add assert
      
      * Skip compile for sm less than 80.
      0473369f
  2. 06 8月, 2023 1 次提交
  3. 05 8月, 2023 1 次提交
  4. 04 8月, 2023 14 次提交
  5. 03 8月, 2023 22 次提交