1. 14 4月, 2023 1 次提交
    • F
      1. modify set_value op, use Scalars to represent attr `values`, instead of a... · dd2a749a
      Feiyu Chan 提交于
      1. modify set_value op, use Scalars to represent attr `values`, instead of a bunch of attributs of various types; (#52408)
      
      2. add program converter and set_value op as an example, which provides the functionality to convert `paddle::framework::ProgramDesc` between old and new formats(the differences are mainly some operators with incompatible updates in the definition);
      3. program version and operator version map now are always saved when serializing `paddle::framework::ProgramDesc` to identify the version;
      3. provide an option `legacy_format=false` in  serialization of `paddle::framework::ProgramDesc`, it decided whether to convert ProgramDesc back to a legacy format, which is compatible for paddle 2.4.2 or earlier versions to load and execute;
      4. deserialization of `paddle::framework::ProgramDesc` is now automatically detecting whether the bytes it receives is in legacy format(contains any of the operators that has been incompatibly updated and have any attribute of type `Scalar`) and convert it to new format. But if you want a faithful deserialization without the automatic conversion, you can use protobuf's deserialization instead. Though it is not recommended, it can be used for the purpose of testing.
      dd2a749a
  2. 21 3月, 2023 1 次提交
    • G
      【fluid clean】remove fluid.data (#50699) · 72c711bb
      GGBond8488 提交于
      * remove fluid.data
      
      * fix typro
      
      * fix somme unitest error
      
      * fix conflicts
      
      * fix sample code error
      
      * fxi sample coder error
      
      * fxi sample code error
      
      * fxi sample code error
      
      * fix xpu test error
      
      * fix xpu test error
      
      * Delete ps_pb2.py
      
      * fix test error
      
      * fix typro
      
      * fix sample code error
      
      * fix comments
      
      * fix test norm op data
      
      * fix sample code error
      
      * fix conflicts
      72c711bb
  3. 08 3月, 2023 2 次提交
  4. 01 3月, 2023 1 次提交
  5. 20 1月, 2023 1 次提交
    • G
      Fluid clean remove io data (#49301) · 5670644c
      GGBond8488 提交于
      * replace paddle.fluid.layers.data and remove io.data
      
      * partial commit
      
      * partial commit
      
      * partial commit
      
      * partial commit
      
      * partial commit
      
      * partial commit
      
      * remove data in fluid.layers.io.__all__
      
      * fix errors
      
      * fix unitests
      
      * fix unitest
      
      * fix unitests
      
      * fix unitest
      
      * fix unitest
      
      * fix unitests
      
      * fix unitest
      
      * fix test_layers unitests
      
      * fix typro
      
      * fix unitest
      
      * fix unitest
      
      * fix unitest
      
      * fix typro
      
      * fix unitest test_model_cast_to_bf16
      
      * fix test_reducescatter
      
      * fix collective unitest
      
      * fix collective unitests
      
      * fix collective unitests
      
      * add coverage
      
      * fix add layers.data
      
      * re run ci
      
      * fix some typro
      
      * fix samplecode error
      
      * fix samplecode error
      5670644c
  6. 03 1月, 2023 1 次提交
  7. 16 12月, 2022 1 次提交
  8. 15 12月, 2022 1 次提交
  9. 08 12月, 2022 1 次提交
  10. 02 12月, 2022 1 次提交
  11. 08 11月, 2022 1 次提交
  12. 03 11月, 2022 1 次提交
  13. 01 11月, 2022 1 次提交
    • N
      [CodeStyle][E711] use `is`/`is not` for comparison with `None` (#47452) · a35a4a53
      Nyakku Shigure 提交于
      * [CodeStyle][E711] use `is`/`is not` for comparison with `None`
      
      * `self.assertTrue($A is None)` -> `self.assertIsNone($A)`
      
      * `self.assertTrue($A is not None)` -> `self.assertIsNotNone($A)`
      
      * `self.assertFalse($A is None)` -> `self.assertIsNotNone($A)`
      
      * `self.assertEqual($A, None)` -> `self.assertIsNone($A)`
      
      * `self.assertNotEqual($A, None)` -> `self.assertIsNotNone($A)`
      a35a4a53
  14. 23 10月, 2022 1 次提交
  15. 19 10月, 2022 1 次提交
  16. 18 10月, 2022 1 次提交
    • N
      [CodeStyle][py2] remove `compat` module (to_text) (#47036) · ad4c773b
      Nyakku Shigure 提交于
      * [CodeStyle][py2] remove `compat` module (to_text)
      
      * remove some unnecessary decode
      
      * remove to_text definition and unittest
      
      * Revert "remove to_text definition and unittest"
      
      This reverts commit a6b69cb8dca8b9b031ce10ea32d1040e7e0dd267.
      
      * remove an assertion
      
      * empty commit
      ad4c773b
  17. 27 9月, 2022 1 次提交
  18. 23 9月, 2022 1 次提交
  19. 14 9月, 2022 1 次提交
  20. 08 8月, 2022 1 次提交
    • ReganYue's avatar
      【Fix en docs】 Fix document formatting*test=document_fix (#43996) · 8537edaa
      ReganYue 提交于
      * Update creation.py
      
      修复Returns格式问题
      
      * 【Fix en docs】 Fix document formatting
      
      修复Returns和Return Type格式问题。
      
      * 修复格式,解决中英文文档不一致问题
      
      为了解决中英文不一致的问题,统一将Returns内容第一个标点符号改成逗号。删掉Return Type
      
      * fix大量 与 Return Type 和 Return相关的文档
      
      * Convert Variable and LoDTensor to Tensor
      
      * Update python/paddle/nn/functional/common.py
      Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>
      
      * Update detection.py
      
      * Update io.py
      
      * Update io.py
      
      * Update loss.py
      
      * Update loss.py
      
      * Update io.py
      
      * Update io.py
      
      * Update nn.py
      
      * Update nn.py
      
      * Update nn.py
      
      * Update nn.py
      
      * Update nn.py
      
      * Update nn.py
      
      * Update nn.py
      
      * Update nn.py
      
      * Update nn.py
      
      * Update nn.py
      
      * Update sequence_lod.py
      
      * Update sequence_lod.py
      
      * Update sequence_lod.py
      
      * Update sequence_lod.py
      
      * Update sequence_lod.py
      
      * Update sequence_lod.py
      
      * Update sequence_lod.py
      
      * Update sequence_lod.py
      
      * Update sequence_lod.py
      
      * Update sequence_lod.py
      
      * Update sequence_lod.py
      
      * Update metrics.py
      
      * Update metrics.py
      
      * Update metrics.py
      
      * Update metrics.py
      
      * Update metrics.py
      
      * Update nets.py
      
      * Update reader.py
      
      * Update nn.py
      
      * Update io.py
      
      * Update nn.py
      
      * Update io.py
      
      * remove Return Type to Returns
      
      * Update sequence_lod.py
      
      * Update sequence_lod.py
      
      * Update common.py
      
      * Update common.py
      
      * Update extension.py
      
      * Update creation.py
      
      * update*test=document_fix
      
      * Update io.py
      
      * Update manipulation.py
      
      * Update sequence_lod.py
      
      * Update common.py
      
      * Update common.py
      
      * Update common.py
      
      * Update common.py
      
      * update*test=document_fix
      
      * update*test=document_fix
      
      * Update loss.py
      
      * Update loss.py
      
      * update*test=document_fix
      
      * paddle.crop
      
      * for ci;test=document_fix
      
      * update io;test=document_fix
      
      * Update io.py
      
      * update sequence_expand docs;test=document_fix
      
      * update note typos;test=document_fix
      Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>
      Co-authored-by: NLigoml <39876205+Ligoml@users.noreply.github.com>
      8537edaa
  21. 05 7月, 2022 1 次提交
  22. 01 7月, 2022 1 次提交
  23. 05 6月, 2022 1 次提交
    • S
      【code format check upgrade】 step2:yapf (#42944) · a072fca8
      Sing_chan 提交于
      * use yapf to format all python file
      
      * yapf exclude two unittests file for they rely on writing and reading file, and format will break them
      
      * disable diff_py_file because too many diff files cause command following failed
      a072fca8
  24. 09 5月, 2022 1 次提交
  25. 25 4月, 2022 1 次提交
    • Y
      fix en docs of some Apis (gradients, scope_guard, cuda_places, name_scope,... · 6dd9dd39
      Yilingyelu 提交于
      fix en docs of some Apis (gradients, scope_guard, cuda_places, name_scope, device_guard, load_program_state, scale, ParamAttr and WeightNormParamAttr) (#41604)
      
      * Update scope_guard; test=document_fix
      
      * gradients; test=document_fix
      
      * gradients; test=document_fix
      
      * name_scope; test=document_fix
      
      * cpu_places; test=document_fix
      
      * WeightNormParamAttr; test=document_fix
      
      * cuda_places; test=document_fix
      
      * load_program_state; test=document_fix
      
      * device_guard; test=document_fix
      
      * device_guard; test=document_fix
      
      * ParamAttr; test=document_fix
      
      * scale; test=document_fix
      
      * scale; test=document_fix
      
      * update code example;test=document_fix
      Co-authored-by: NChen Long <1300851984@qq.com>
      6dd9dd39
  26. 03 3月, 2022 1 次提交
    • J
      Support slim eager (#39874) · da47544c
      Jiabin Yang 提交于
      * eager, test=develop
      
      * fix bug, test=develop
      
      * eager, test=develop
      
      * merge legacy to fluid
      
      * eager, test=develop
      
      * eager, test=develop
      
      * Refactor TensorAdd func by template and remove gradient_accumulation in eager
      
      * Remove needless target name
      
      * eager, test=develop
      
      * eager, test=develop
      
      * Use overload instead of template
      
      * Remove legacy code
      
      * Remove legacy code
      
      * selectedrows, test=develop
      
      * Remove DataType test
      
      * eager, test=develop
      
      * eager, test=develop
      
      * support gan, test=develop
      
      * Using Tensor directly instead of using EagerTensor
      
      * support gradient_accumulation
      
      * make test_imperative_lod_tensor_to_selected_rows longer
      
      * make test_imperative_lod_tensor_to_selected_rows longer
      
      * refine code
      
      * ptb, test=develop
      
      * Rename all EagerTensor to Tensor
      
      * Rename some EagerTensor to Tensor
      
      * rename EagerTensor to EagerVariable
      
      * eager, test=develop
      
      * eager, test=develop
      
      * eager, test=develop
      
      * eager, test=develop
      
      * add more test
      
      * eager, test=develop
      
      * Support copiable selected rows and merge develop
      
      * save load, eager, test=develop
      
      * save load, eager, test=develop
      
      * refine, test=develop
      
      * remove useless _set_value method
      
      * refine, test=develop
      
      * refine, test=develop
      
      * revert static_runner, test=develop
      
      * EagerTensor to Tensor, test=develop
      
      * refine, test=develop
      
      * refine, test=develop
      
      * clear grad, test=develop
      
      * merge, develop
      
      * merge, develop
      
      * merge, test=develop
      
      * merge, test=develop
      
      * Support quant and part of slice
      
      * support legacy static save
      
      * extend slim tests time
      
      * remove imperative on inference
      
      * remove imperative on inference
      
      * merge develop
      
      * fix typo
      
      * fix typo
      
      * split slice related code into 2 part for imperative and eager
      
      * split slice from inference
      
      * split slice from inference
      
      * fix test_tensor_register_hook
      Co-authored-by: NWang Huan <wanghuan29@baidu.com>
      Co-authored-by: NWeilong Wu <veyron_wu@163.com>
      Co-authored-by: Nwanghuancoder <wanghuancoder@163.com>
      da47544c
  27. 31 12月, 2021 1 次提交
  28. 27 9月, 2021 1 次提交
    • H
      support saving model defined parameters without add scale_op (#36119) · 8db6d221
      Haipeng Wang 提交于
      * add scale_op in model save step is not necessary, just fix the prune method to support static graph and inplace op
      
      * fix jit.save, no need to add scale_op to each outputvar anymore.
      fix prune_with_input, now it supports inplace op
      
      * temporarily disable test_trt_dynamic_shape.TRTDynamicShapeOutOfBound2Test
      
      * allow user to export parameters defined in model
      8db6d221
  29. 17 9月, 2021 1 次提交
  30. 15 9月, 2021 1 次提交
  31. 27 8月, 2021 1 次提交
  32. 28 7月, 2021 1 次提交
  33. 21 6月, 2021 1 次提交
  34. 09 6月, 2021 1 次提交
    • W
      paddle.save support object save to memory. (#32999) · cdd6437a
      WeiXin 提交于
      * support state_dict save to memory.
      
      * Perfect unittest
      
      * perfect unittest.
      
      * suport saving binary var to memory
      
      * polish code.
      
      * packag save/load files into pybind/io.py
      
      * polish code .
      
      * add example for save to memory; remove useless save load function(_load_static_dict,_save_dygraph_dict)
      
      * delete _load_static/dygraph_dict;_save_static/dygraph_dict
      
      * edit example of paddle.save/load
      cdd6437a
  35. 14 5月, 2021 1 次提交
  36. 27 4月, 2021 1 次提交
  37. 19 4月, 2021 1 次提交
    • L
      [NPU] cherry-pick gc/dataloader/save&load/optimization from ascendrc to develop (#32294) · cbe5c9f8
      Leo Chen 提交于
      * [NPU] support GarbageCollector for npu (#31874)
      
      * support GarbageCollector for npu
      
      * fix typo
      
      * fix gather_grad
      
      * disable NPUDefaultStreamGarbageCollector on NPU
      
      * [NPU] support npu for memcpy op (#31808)
      
      * support npu for memcpy op
      
      * add ut
      
      * fix ut
      
      * fix typo
      
      * 【NPU】fix bug of using temp vector (#31963)
      
      * fix bug when beta1_pow on cpu (#31995)
      
      * [NPU] support npu profiler (#31684)
      
      * support npu profiler
      
      * add python api
      
      * fix bugs
      
      * add wrapper for incomplete type
      
      * update profile proto
      
      * record npu wait
      
      * add xpu placeholder
      
      * fix adam (#32016)
      
      * [NPU] enable async copy and  add wait before sync operation (#31956)
      
      * enable async copy and  add wait before sync operation
      
      * remove unneccessary wait
      
      * add FillNpuTensorWithConstant
      
      * refine
      
      * fix fill_constant
      
      * make TensorFromVector/TensorToVector sync
      
      * [NPU] Support dataloader on npu place. (#31867)
      
      * [NPU] Wait on NPUPlace (#32086)
      
      * [NPU] fix cast op (#32121)
      
      * fix npu kernel of cast op to handle casting to same dtype
      
      * add comments
      
      * [NPU] support cann 20.3 (#32044)
      
      * fix compile problem on cann 20.3
      
      * fix ut
      
      * fix test_mul
      
      * fix check_finite_and_scale
      
      * fix lookup_table_v2_grad
      
      * fix cmake
      
      * support print op
      
      * [NPU] Support npu save load (#31893)
      
      * support save load for NPU
      
      * add save load npu unittest
      
      * support np.array transform in NPU
      
      * fix errors
      
      * delete dygraph in unittest
      
      * add Wait
      
      * fix unittest
      
      * fix review comment
      
      * fix unittest problem
      
      * fix little problem
      
      * change aclrtSynchronizeDevice to aclrtSynchronizeStream for better performance (#32196)
      
      * change aclrtSynchronizeDevice to aclrtSynchronizeStream for better performace
      
      * refine code
      
      * fix NPUDeviceContext in all c++ unittest (#32198)
      
      * fix NPUDeviceContext in all c++ unittest
      
      * refine log
      Co-authored-by: Npangyoki <pangyoki@126.com>
      
      * [NPU] Remove TensorFromVector and avoid sync copy in npu op kernel for better performance (#31994)
      
      * enable async copy and  add wait before sync operation
      
      * remove unneccessary wait
      
      * add FillNpuTensorWithConstant
      
      * refine
      
      * fix fill_constant
      
      * change TensorFromVector to FillNpuTensorWithConstant
      
      * fix ignored api
      
      * delete extra unittest
      
      * fix little error
      
      * fix update_loss_scaling_op_npu and check_finite_and_unscale_op_npu
      
      * change TensorCopySync to TensorCopy
      
      * delete useless Wait and add StreamWait
      
      * fix npu_stream error
      
      * fix check_finite_and_unscale_op_npu TensorCopy
      
      * only save stream wait
      
      * fix NPUDeviceContext in all c++ unittest
      
      * delete wait
      Co-authored-by: Nzhiqiu <chenqiuliang@baidu.com>
      
      * delete useless unittest file (#32206)
      
      * Fix op test (#32231)
      
      * fix conditional block (#32243)
      
      * fix adam bug again (#32246)
      
      * fix compile
      
      * fix ut
      
      * fix ut
      Co-authored-by: Nliym27 <33742067+liym27@users.noreply.github.com>
      Co-authored-by: Npangyoki <pangyoki@126.com>
      cbe5c9f8
  38. 02 4月, 2021 1 次提交
    • W
      support save/load single tensor (#31756) · 43367e4b
      WeiXin 提交于
      * support save/load single tensor
      
      * compatibility modification according to unnittest
      
      * Some python2.7 don't have 'copyreg' modules
      
      * Handle a syntax error.
      
      * Dealing with compatibility problems on Mac.
      
      * Dealing with compatibility problems on Mac.
      
      * edit unittest to improve coverage.
      
      * Modify the code according to the review comments
      
      * Reduce redundant code.
      
      * support for static graph loading dygraph state_dict
      
      * edit code according to CI
      
      * edit unittest
      
      * edit unnittest
      
      * delete redundant file
      
      * edit code according to Comments
      
      * edit english doc
      
      * edit english doc
      
      * edit English DOC.
      
      * get/set_tensor->get/set_value; return_numpy=False
      
      * get/set_tensor->get/set_value; return_numpy=False
      
      * edit unnittest
      
      * edit unnittest
      
      * polish code.
      43367e4b
  39. 23 2月, 2021 1 次提交