Skip to content

O
oneflow

Oneflow-Inc / oneflow
上一次同步 2 年多

通知 13
Star 2733
Fork 0
O
oneflow

前往新版Gitcode，体验更适合开发者的 AI 搜索 >>

切换分支/标签
  1. 01 11月, 2021 1 次提交
    • Z
      Change maybe to optional (#6611) · 380d2414
      由 Zhanghuihong Guan 提交于 
      * initial commit, add code for async construct tensor from numpy array

* inital commit to change Maybe to Optional

* delete redundant code

* replace Maybe with Optional

* fix compile errors

* format code

* changes based on review

* format code, fix based on review

* format code

* fix multiclient type

* changes based on review

* changes based on review

* unify calling to IsMultiClirnt

* refector multi_client related code

* restore InMultiClient interface

* double check for unnecessary changes

* remove unnecessary changes

* format code

* Update oneflow/api/python/symbol/job_conf_symbol.cpp

* Update oneflow/api/python/symbol/op_conf_symbol.cpp

* Update oneflow/api/python/symbol/op_node_signature_symbol.cpp

* Update oneflow/core/common/optional.h

* Update oneflow/api/python/symbol/string_symbol.cpp

* Update oneflow/api/python/symbol/scope_symbol.cpp

* Update oneflow/api/python/symbol/placement_symbol.cpp

* Update oneflow/api/python/symbol/op_conf_symbol.cpp
Co-authored-by: NHoujiang Chen <chenhoujiangcug@gmail.com>
Co-authored-by: NTwice <i@twice.moe>
      380d2414
  3. 18 10月, 2021 1 次提交
  5. 15 10月, 2021 1 次提交
    • G
      refactor slice boxing (#6413) · fadf39c6
      由 guo ran 提交于 
      * refactor slice boxing

* refine

* slice boxing node use compute stream

* refine

* refine

* refine

* refine
      fadf39c6
  7. 23 9月, 2021 2 次提交
  9. 11 9月, 2021 1 次提交
  11. 08 9月, 2021 1 次提交
  13. 06 9月, 2021 1 次提交
  15. 31 8月, 2021 1 次提交
  17. 26 8月, 2021 1 次提交
  19. 19 8月, 2021 2 次提交
  21. 17 8月, 2021 1 次提交
  23. 15 8月, 2021 1 次提交
  25. 12 8月, 2021 1 次提交
  27. 07 8月, 2021 1 次提交
    • Y
      Feat empty op (#5659) · ed9b5a50
      由 Yinggang Wang 提交于 
      * fix bugs in shareing EagerBlobObject::blob_desc_.shape and EagerBlobObject::blob_.shape

* feat(EmptyOp): add flow.empty

* docs(EmptyOp): add doctest and refine document

* docs(EmptyOp): refine document

* refactor(Tensor): Tensor constructor use empty_op

* refactor(Tensor): remove useless code

* feat(EmptyOp): support construct in given device and add
               consistent_empty op

* feat(EmptyOp): support unpacked tuple shape

* refine array functor code

* docs(EmptyOp): update empty op document

* refine code

* docs(EmptyOp): add test and document for consistent empty op

* update document

* fix merge bugs

* fix(*): fix infer distribution

* test(EmptyOp): fix ConsistentEmptyOp CPU_ONLY test bug

* fix(*): init shape when InitBlob

* fix(*): Constant and Empty Op use broadcast sbp

* fix(indexing): replace MakeTensor with functional::Empty

* fix(*): fix compile bug

* refine code

* fix(nnGraph): make eager tensor

* auto format by CI

* fix(Stride): infer stride before initializing shape
Co-authored-by: NXinqi Li <lixinqi0703106@163.com>
Co-authored-by: NLi Xinqi <lixinqi2010@gmail.com>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: Noneflow-ci-bot <ci-bot@oneflow.org>
      ed9b5a50
  29. 06 8月, 2021 1 次提交
  31. 02 8月, 2021 1 次提交
    • L
      0-dim tensor support (#5552) · 62a8cd84
      由 Luyang 提交于 
      * 0-dim tensor support

* test case

* add more test

* refine

* update

* update default constructor

* reconstuct

* merge master

* remove notes

* remove useless codes

* fix comments

* fix comment

* add test case

* format

* refine

* refine

* refine

* refine

* MirroredTensorMeta::MirroredTensorMeta()

* support 0-dim slice

* support 0-dim slice grad

* refine

* auto format by CI

* refine

* refine

* auto format by CI

* refine

* fix slice bug

* auto format by CI

* fix resnet50 0-im loss uasge

* fix 0-dim tensor usage in test cases

* add skip test

* auto format by CI

* fix test_dataset

* check blobdesc.shape init

* auto format by CI

* remove useless empty shape init

* fix l1loss 0-dim error

* auto format by CI

* fix argmax op test

* fix add_n op test

* auto format by CI

* fix bce loss op test

* auto format by CI

* fix squeeze op test

* fix conv2d op test

* fix xpu_shape for clip_grad_norm

* auto format by CI

* resolve confilct

* fix multi-cpu slice_copier 0-dim bug

* auto format by CI

* add memory copy for 0-dim

* auto format by CI

* support copy0dim

* refine

* auto format by CI

* remove unuse codes

* fix check for kldivloss

* gpu 0-dim copy

* auto format by CI

* fix clip_grad_norm doctest

* fix reduce_ops doctest

* fix argmax doctest

* fix loss module doctests

* fix math_ops doctests

* fix norm modules doctest
Co-authored-by: NXinqi Li <lixinqi0703106@163.com>
Co-authored-by: Noneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
      62a8cd84
  33. 16 7月, 2021 1 次提交
  35. 14 7月, 2021 1 次提交
  37. 01 7月, 2021 2 次提交
    • L
      Infer consistent tensor meta (#5118) · c3238bfd
      由 Li Xinqi 提交于 
      * Device::compute_dep_object_

* sequantialize instructions in the same stream.

* refactor AttrMap

* refactor Tensor

* Export ConsistentTensor::is_cuda

* remove ConsistentTensor::blob_object

* refactor TensorImpl

* minor fix

* fix compiler' complains

* Implements EagerConsistentTensorImpl::New

* minor fix

* fix compiler complains

* remove unused code

* skip test_creating_consistent_tensor

* backup code

* Symbol::shared_from_symbol

* remove redundant header file includes

* fix bug in Symbol::shared_from_symbol

* symbolize ParallelDesc and ParallelDistribution

* symbolize Scope::GetParallelDesc()

* IsScalarType

* fix compiler complains

* InputConsistentTensorMeta

* refactor Scope with PlacementScope

* fix bug in exporting Scope to python

* backup code

* refactor DType

* fix compiler complains

* backup code

* DType is only allowed to be used in python code

* backup code

* dtype api bugfix

* fix error on exiting
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* lazily get rank
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* Export const DType* into python

* minor fix

* fix bug

* refine

* refactor signature of OpExpr::InferLogicalShapeAndDtype

* fix bug

* backup_code

* fix bug

* refactor SbpXXX to cfg::SbpXXX

* merge refactor_sbp_to_cfg_sbp

* fix bug

* Infer ConsistentTensorMeta

* Implement EagerConsistentInterpret::ApplyImpl

* 1) move XXXTensorMeta into the new file tensor_meta.h; 2) add new Class ConsistentTensorInferCache

* add class ConsistentTensorInferResult

* remove unused OpArgMutConsistentTensorMeta::parallel_distribution_

* fix stack-overflow bug in Tensor::mut_eager_mirrored_tensor_impl

* ignore empty parallel distribution constaint

* fix bug

* add explicit of cfg

* fix xla compile bug

* auto format by CI

* fix according comment

* fix bug
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: qq_22305325's avatarclackhan <han_binbin@163.com>
Co-authored-by: Ndaquexian <daquexian566@gmail.com>
Co-authored-by: NShenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: Noneflow-ci-bot <ci-bot@oneflow.org>
      c3238bfd
    • D
      add missing JUST (#5357) · 95337ebc
      由 daquexian 提交于 
      * add missing JUST
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* remove redundant header
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* add missing JUST in master
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* fix compile error on gcc5
Signed-off-by: Ndaquexian <daquexian566@gmail.com>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
      95337ebc
  39. 30 6月, 2021 1 次提交
  41. 21 6月, 2021 1 次提交
    • L
      Refactor Memory Zone (#5072) · 50f32b61
      由 leaves-zwx 提交于 
      * MemZoneId


Former-commit-id: 7550a129f15554c5a6e480b728079e431c00be25

* move mem zone id source code


Former-commit-id: 3859fc2a0fcda2fb23e57e886a0e3f1c0833d111

* revert


Former-commit-id: 5cf3ad7caebe787918d1ca1c0467415656d9b491

* refine GetProxyNode using MemZoneId


Former-commit-id: fba035f20b44b1acce2900b86b5bd24654e0d982

* refactor MemZoneId121


Former-commit-id: 0868a6139f1cf20dc7474d0a88714e03721c8e8e

* replace using IDMgr interface


Former-commit-id: 98b5db9ed879cd1d8197efd174c6d680bec69560

* fix linkage

* rm useless comment

* replace IsGpuMemZone

* format

* rm deprecated mem zone api in IDMgr

* fix merge conflict error

* refine mem zone id to include node index

* revert added header

* direct init device_id

* address review

* address review
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
      50f32b61
  43. 15 6月, 2021 1 次提交
  45. 03 6月, 2021 2 次提交
  47. 02 6月, 2021 1 次提交
  49. 26 5月, 2021 1 次提交
  51. 08 5月, 2021 1 次提交
  53. 05 5月, 2021 1 次提交
  55. 29 4月, 2021 1 次提交
    • C
      Pipeline Parallelism by stage buffer (#4666) · 080d8eab
      由 cheng cheng 提交于 
      * Pipeline Parallelism: checkpointing insert identity buffer op

* fix complier err

* identity buffer op custom out regst num

* fix bug and runnable

* Chain merge divide fw/bw; MemChain ignore merge; copyhd regst num hack

* Pipeline buffer pass

* Pipeline runnable

* rollback NOT merge mem chain hack

* pipeline_stage_id_hint and rollback checkpointing buffer

* Pipeline buffer only. test pass.

* rollback repeat hack

* Remove CopyHd Hack; Add buffer cross label loader and loss

* refine code for review & fix for new dtype infer

* add note
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
      080d8eab
  57. 28 4月, 2021 2 次提交
  59. 23 4月, 2021 1 次提交
  61. 19 4月, 2021 2 次提交
  63. 12 4月, 2021 1 次提交
  65. 07 4月, 2021 1 次提交
  67. 06 4月, 2021 1 次提交