* Refactor oneflow.Size

* refine

* add pybind11 caster

* Support Shape cast

* refine

* fix size index

* include size header if need export C++ Shape to Python.

* Async access blob and copy data between python object, and fix deadlock.

* revert

* fix

* refine code style

* optimize treat single as tuple

* Fix tensor numpy api.

* adapt interface to compatiblility test

* auto format by CI

* refine

* Back up the numpy array when copy data from array to tensor async

* fix pybind blob api

* Make sure array is C-style contiguous.

* decrease ref

* fixup

* Move foreign lock helper base into core/common.

* Release GIL before call SpinWaitUntilTimeout
Co-authored-by: NZhanghuihong <garfield.gzhh@gmail.com>
Co-authored-by: Noneflow-ci-bot <ci-bot@oneflow.org>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* fix clang error
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* enable

* update

* fix

* fix

* refine

* refine

* refine

* supress mismatched-tags
Co-authored-by: Ndaquexian <daquexian566@gmail.com>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Functional support multiple signatures.

* Add TypeError and refine error message.

* Finish py function.

* Refactor add, sub, mul and div functional apis.

* Fix merge error

* Support scalar add/sub/mul/div tensor.

* auto format by CI

* Fix optional argument

* Set inplace keyword only

* Fix throw and treat long as float

* Fixup merge error

* Check tensor type

* Optimize recursive

* Fix add static zero

* Fix merge

* Fix warning as error

* Fix warning as error

* Fix merge

* Fix merge
Co-authored-by: Noneflow-ci-bot <ci-bot@oneflow.org>

* Refactor functional matmul and add apis.

* Export batch matmul and fix python module

* Check inplace valid in C++

* Support scalar add tensor.

* Support inplace when broadcasting add

* Fix add
Co-authored-by: NYao Chi <later@usopp.net>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Support numpy advanced indexing.

* Finally adjust if continuos subspace.

* Finish integer array indexing and combining indexing.

* Finish index array parsing.

* Add tensor indexing unittest

* Add check

* Refine

* Refine tensor getitem unittest

* Support int64_t cuda atomicAdd.

* Not use PyObjectPtr since PySequence_Fast_GET_ITEM returns borrowed reference.

* Remove experimental in indexing unittest.
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* graph api

* add graph dummy test

* add test

* add recursive module mode

* graph.build test pass

* add detail check on graph inner node

* support config and train

* add repr for debug

* test buffer

* test buffer add

* refine test

* add comment

* refine test

* refactor Node to Block

* add named_state

* refine Graph.named_state()

* add state_tensortuple

* graph._compile()

* add mc session 0

* nn.graph: state tuple to private var; add BlockType; add simple multi client session

* NNGraphIf

* rm old graph.cpp

* nn.graph: add cpp NNGraph; export and call NNGraph

* add comment

* nn.Graph: rm prototype MultiClientSession

* nn.Graph: rm prototype MultiClientSession test

* nn.Graph: add TODO

* nn.Graph: format for review

* nn.Graph: format

* nn.Graph: format

* nn.Graph: pass flake8 check

* job_build_ctx

* support lazy context

* format

* lazy mode

* format

* format

* lazy mode add test

* debug session

* init session and job_build_context

* rm temp code

* build default scope

* add default scope

* add scope proto for debug

* chech scope

* format

* refine MultiClientSession.resource

* address review

* lazy init scope stack in single-client, instantly init scope stack after MultiClientSession created in multi-client

* fix typo

* address review

* fix clear default session

* merger and test
Co-authored-by: NXinqi Li <lixinqi0703106@163.com>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: Nleaves-zwx <kunta0932@gmail.com>
Co-authored-by: Ncheng cheng <472491134@qq.com>

* Optimize tensor getitem.

* Fix merge

* Refine code style

* Fix typo and copy input if it's getitem is identity.
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Dev functional interface.

* Remove repeated function_traits

* Implement add and add_scalar static functional op.

* Remove unused code

* Refactor

* Refine

* Generate and export functional apis.

* Refine

* Refine

* Refine

* Generate functional api and pybind cpp when building the project.

* Refine code style and implement normalization functor.

* Fix cmake

* Add PyYAML requirement.

* Add JUST

* Fix scalar IsIntegral and IsSigned

* Add scalar add grad func.

* Fix norm grad func to support dynamic attrs.

* Support DataType.

* Recursive determine input tensors.

* Update generate_functional_api.py

* Fix conversion from python object to dtype.

* Fix crash since function has been cast with wrong function signature, the converted function behavior is undefined.

* Check and throw error.

* Refine

* Use Maybe instead of throwing exception directly.
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>