1. 16 12月, 2021 8 次提交
    • L
      Add sparse_attention mask ,test=develop (#37973) · fa463b90
      Liu-xiandong 提交于
      Add key_padding_mask and attn_mask in sparse_attention Api
      
      1.Key padding mask is a tensor with dimensions [batch_size, seq_len], and attention mask is a tensor with dimensions [seq_len, seq_len]. The data types of the two masks are consistent with Q, K, and V, which are float32 or float64. If the value in Mask is 0, it means that the position needs to be masked.
      
      2.The changed files are mainly paddle/fluid/operators/sparse_attention_op.cu and python/paddle/fluid/tests/unittests/test_sparse_attention_op.py. sparse_attention has three parts: sddmm, softmax, and dsd. Adding the mask operation only needs to modify the softmax. It has no effect on the other two parts. In addition, in order to test the mask function, related tests has been added.
      fa463b90
    • N
      Add the transformop parameter in TensorReduceFunctorImpl (#38135) · 524389ee
      niuliling123 提交于
      * Add the transformop parameter in TensorReduceFunctorImpl
      524389ee
    • Y
      [Pten]Modify registered kernel name (#38109) · be874c08
      YuanRisheng 提交于
      * Reduce reshape kernel functions in pten
      
      * delete notes
      
      * fix bugs when compile
      
      * modify register name
      
      * fix compile bugs
      be874c08
    • C
      [PTen] Unify device context entrance in pten part 1 (#38172) · 047ee26c
      Chen Weihang 提交于
      * unify device context entrance
      
      * move all_context include to header
      
      * polish cmake relay for device_context
      
      * fix npu compile failed
      
      * fix npu compile failed
      
      * revert part of change
      047ee26c
    • C
      fix header match error (#38175) · 4ef59f08
      Chen Weihang 提交于
      4ef59f08
    • C
      pylayer support tuple/list type args and fix check args bug (#38146) · 861053eb
      chentianyu03 提交于
      * Revert "Revert "pylayer support tuple/list type args (#37727)" (#37956)"
      
      This reverts commit d848ff04.
      
      * move check args,kwargs before forward execute
      861053eb
    • L
      Add float16 type for scatter op. (#38136) · 9bac4a76
      Li Min 提交于
      * Add float16 type for scatter op.
      
      * Add fp16 test for scatter op.
      
      * Add int and int64 support for scatter_grad on gpu.
      
      * Add int and int64 for check_variable_and_dtype routine.
      
      * Minors.
      
      * Code format.
      9bac4a76
    • Z
      Enabled Eager AutoCodeGen for All Existing Operators & Possible Future Operators (#37969) · 08482a86
      Zhanlue Yang 提交于
      * Rearranged Eager AutoCodeGen directory structure
      
      * Removed USE_OP in Eager AutoCodeGen
      
      * Enabled generation for Operators without Grad/Inputs/Outputs
      
      * Resolved operators without input
      
      * Fixed merge conflicts
      
      * Enabled Eager AutoCodeGen for 10+ more operators
      
      * Refactored Eager AutoCodeGen with more organized helper objects
      
      * Enabled Eager AutoCodeGen for operators with multiple OpBases
      
      * Adjusted Eager AutoCodeGen to Enable Passing Output Tensor as Input Argument
      
      * Handled Dispensable Inputs/Outputs in Eager AutoCodeGen
      
      * Enabled Eager AutoCodeGen for All Existing Operators & Possible Future Operators
      
      * Fixed CI issues
      08482a86
  2. 15 12月, 2021 21 次提交
  3. 14 12月, 2021 11 次提交