1. 15 1月, 2021 1 次提交
    • P
      Add Inplace strategy (Output reuse Input Varbase) in dygraph (#30103) · 13d75736
      pangyoki 提交于
      * add view strategy on squeeze,unsqueeze,reshape,flatten
      
      * add squeeze unittest
      
      * add unittests
      
      * use View strategy as name rather than Reuse Allacation
      
      * fix view api doc
      
      * fix format
      
      * use core.ops when input of reshape2 is Tensor
      
      * fix test_cross_entropy_loss error because of reshape2
      
      * fix test_cross_entropy_loss error because of reshape2
      
      * add inplace strategy
      
      * add elementwise_add sub
      
      * let backward op not use inplace
      
      * grad op do not use inplace
      
      * fix memory increase error and add leaf error message
      
      * delete selected_rows
      
      * change op_function
      
      * little change
      
      * solve HandleViewBetweenInputAndOutput
      
      * add unittest and leaf error message
      
      * merge view error
      
      * optimize op_function_generator format and support sum inplace op
      
      * fix format of basic_engine
      
      * fix format for framework
      
      * little change of variable wrapper
      
      * add reshape, squeeze, unsqueeze, scatter api
      
      * add relu elu tanh softmax inplace api
      
      * fix test_squeeze_op unittest
      
      * fix test_relu_op unittest
      
      * fix comment problems
      
      * delete sample code of inplace api
      
      * add reference of grad_pending_nodes in basic_engine
      
      * fix unittest name
      
      * add inplace apis into wlist
      
      * fix error message
      
      * add PADDLE_ENFORCE for set grad op twice
      
      * fix head file error
      13d75736
  2. 08 1月, 2021 1 次提交
    • L
      Fix dtype of ungenerated grad var (#28511) · 8696335f
      Leo Chen 提交于
      * fix dtype of ungenerated grad var
      
      * update ut
      
      * refine code
      
      * set default dtype
      
      * fix could_use_cudnn bug
      
      * remove debug code
      
      * re-implement
      
      * fix bug
      8696335f
  3. 25 12月, 2020 1 次提交
    • C
      [Complex] Handle complex to real after type promotion (#29855) · a6072055
      Chen Weihang 提交于
      * try to add fwd op input dtypes
      
      * refactor base impl
      
      * return tmp_ins after dygraph prepare data
      
      * fix typo found in debug
      
      * polish comment & add complex net test
      
      * revert detail change
      
      * fix unittest failed
      
      * add complex kernel condition control
      
      * fix xpu test failed & polish comment
      
      * polish details by review comments
      a6072055
  4. 01 12月, 2020 1 次提交
  5. 30 11月, 2020 1 次提交
    • L
      Check whether there is any inplace operation affecting gradient calculation. (#27901) · 865a4598
      liym27 提交于
      * Add a class TensorInplaceVersion to count the inplace version and put it in framework::Tensor instead of Allocation or Variable.
      
      * Add a new attribute `_inplace_version` for VarBase.
      
      * Raise exception if an inplace operation can result in incorrect gradient computation.
      
      * Add a new interface _bump_inplace_version() for VarBase to bump the version whenever the Tensor is modified through an inplace operation.
      
      * For api assign, call _bump_inplace_version() when it's an inplace operation inn dynamic mode.
      
      * Use original var_wrapper if the inplace_version is not changed.
      
      * Replace SnapshotVarWrapperList with SnapshotVarWrapper to optimize performane.
      865a4598
  6. 18 11月, 2020 1 次提交
  7. 28 8月, 2020 2 次提交
  8. 24 7月, 2020 1 次提交
  9. 16 7月, 2020 1 次提交
    • H
      Add Support for SelectedRows for Transpose OP and Fix a Bug That SelectedRows... · d8fe517b
      Huihuang Zheng 提交于
      Add Support for SelectedRows for Transpose OP and Fix a Bug That SelectedRows Cannot be Supported in SimNet (#25536)
      
      This PR fixes a bug that SelectedRows cannot be supported in SimNet. The reason of this bug is that dygraph basic_engine didn't copy var's type when the var needs to be accumulated during backward. So when a var is SelectedRows and needs to be accumulated, like SimNet which calls net for two times, the var's type will be changed to default LoDTensor thus bug happens. To fix it, we just also copy the type.
      
      Without this PR, the accumulated SelectedRows parameters in dygraph will be changed into LoDTensor. So when we fixed the bug of supporting SelectedRows in SimNet, we found `test_imperative_lod_tensor_to_selected_rows` failed and threw the error that SelectedRows was not supported for Transpose OP. To fix it, too, this PR also added support for SelectedRows for Transpose OP.
      d8fe517b
  10. 06 4月, 2020 1 次提交
    • C
      Implement StaticModelRunner to support dygraph fine-tune static graph pre-training model (#23171) · 75bd3507
      Chen Weihang 提交于
      * static model runner basic implement, test=develop
      
      * add run program op to execute loaded program, test=develop
      
      * refactor static model runner & run program op, test=develop
      
      * reset engine.cc to resolve conflict
      
      * adapt the change of dygraph double grad, test=develop
      
      * refactor impl to solve control flow error, test=develop
      
      * clear debug code, test=develop
      
      * fix ci str compatible error & checkout dygraph grad maker & add example, test=develop
      
      * hide api & add op test, test=develop
      
      * fix run program op test places error, test=develop
      
      * fix program by review comment, test=develop
      
      * delete change var desc name, test=develop
      
      * fix other program by review comment, test=develop
      
      * remove _static_graph_guard, test=develop
      
      * add selectedrows test, test=develop
      
      * remove desc parser, test=develop
      
      * fix detail program, test=develop
      
      * change socpe create & add test, test=develop
      75bd3507
  11. 27 3月, 2020 1 次提交
    • Z
      Expose dygraph.grad api (#23124) · 8bfd62ff
      Zeng Jinle 提交于
      * expose dygraph.grad api, test=develop, test=document_fix
      
      * add more parameter in dygraph.grad API, test=develop
      
      * add only_inputs=True parameter, test=develop
      
      * follow comments, test=develop, test=document_fix
      
      * fix typo, test=develop, test=document_fix
      8bfd62ff
  12. 20 3月, 2020 1 次提交
    • Z
      Add dygraph double grad implementation (#22939) · a31d7328
      Zeng Jinle 提交于
      * add double grad implementation for dygraph, test=develop
      
      * polish code, add uts, test=develop
      
      * fix place bug, test=develop
      
      * polish codes, add more uts for coverages, test=develop
      
      * add no_grad_set, test=develop
      
      * add star gan ut, test=develop
      
      * follow comments, test=develop
      a31d7328