* half implement of build task graph by 1regst1blob

* Complete support 1 regst 1 blob

* fix check

* Add Lbis in TaskEdge and check valid

* reduce NormalForward out regst name prefix

* refine hasher and proxy key

* fix bug of ProxyKey ==

* fix bug of collective boxing broadcast task edge lbi
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Signed-off-by: Ndaquexian <daquexian566@gmail.com>
Co-authored-by: binbinHan <han_binbin@163.com>

* variable_conf add parallel_distribution, rm split axis

* rm modularity

* refine

* refine

* add rpath

* update tests

* refine

* update py version

* refine arg

* refine extra_oneflow_cmake_args

* refine extra_oneflow_cmake_args

* merge macOS into matrix

* add actions/cache@v2

* refine restore-keys

* refien restore keys

* make mac ci optional

* add notes

* add notes

* refine

* refine

* fix yml indention

* Revert "fix yml indention"

This reverts commit 5c6a539e22c1359f9a5cd0aeff4c80130a7dbe41.

* Revert "refine"

This reverts commit cfa3dec9e52f021888b629266e9c456071c2d10b.

* refactor whl script to support multiple cmake -D

* fix typo

* refine

* fix

* refine

* add

* filter extra_oneflow_cmake_args

* fix

* refine log

* add more flags in sysconfig

* add with cuda with xla

* fix typo

* refine

* refine

* fmt

* reorder

* refine

* fmt

* add skif for new cases

* rm unused

* refine
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add round to zero point

* atol to rtol
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add_node_size_config

* add IsThisProcessMaster

* fix error

* add CHECK_EQ

* mutil_process_on_single_client

* fix error

* minor fix

* fix error

* fix bug

* new_ci_about_mutil_process_on_single_clien

* fix unittest.py

* refactor parallel_desc

* fix bug

* backup code

* fix ResourceDesc::ResourceDesc

* make of_format

* fix test bug

* fix bug

* backup

* minor fix

* backup

* minor fix

* del useless log

* optimize code

* add ci test

* Update test.yml

* minor fix

* backup

* run callback_notifier after all critical sections done

* group ticks originated from different critical sections

* minor fix about plan display

* backup

* refine code

* minor fix

* add comment

* fix path error

* add CHECK

* do not use oneflow_worker

* minor fix
Co-authored-by: NLi Xinqi <lixinqi2010@gmail.com>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>
Co-authored-by: Nlixinqi <lixinqi0703106@163.com>
Co-authored-by: NShenghang Tsai <jackalcooper@gmail.com>

* add Install dependencies

* add more args

* refine

* fix

* add

* refine

* refine

* fix
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add hierarchical_parallel_cast

* fix

* refine

* refine

Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* model_io_v2 support parallel_distribution

* check in changes

* use docker run

* rmt

* check in

* update

* naive workaround

* add

* revert

* add

* refine

* refine

* revert

* revert

* naive interface

* extract separate rpc client

* fix is_trivially_copyable

* fix container

* add log

* rename RPC_BACKEND

* whl

* Update type_traits.h

* backport changes

* refine

* refine

* fix license

* address review

* fix

* fix

* handle .h

* add flag

* restructure

* update guard

* add

* update include

* ctrl server

* fix ObjectMsgStructDefault

* fix std::min

* skip transport

* address review

* add subdirectory

* naive impl

* add some impl

* fix

* refine dev-requirements.txt

* check in

* update include

* fix link unsigned long

* use relative path

* add flag

* quick fix

* rm oneflow/core/common/using.h

* rm

* rm file

* add

* struct ArithemeticIf

* add

* refine

* fix crash

* refine

* refine include to introduce less changes

* dont generate py symbol for onnx if not available

* refine to reduce changes

* refine

* revert

* refine

* refine

* refine

* fix

* refine

* add some impl

* fix

* rm condition

* revert

* add -Wno-mismatched-tags

* revert

* revert

* fmt

* fix sefault for mutex

* fix memery size

* fix to prevent overflow

* impl try lock

* refine

* fix dev tag

* refactor DeviceTag4DeviceType

* refactor DeviceTag4DeviceType

* add

* rm includes

* add cv for kv

* add log incase there is dead lock

* add log in case there is dead lock

* refine

* refine

* typo

* refine

* refine

* refine

* refine

* refine

* refine

* refine

* add vitual destructors for persistence classes

* refine

* add

* rm condition

* add step

* fix math.h

* fix path

* add type release

* refine

* fix uint64_t overflow int64_t

* refine

* refine

* refine

* rm server

* rm build dir to save disk

* check in fix

* refine

* add header and proto field

* simplify headers

* refactor

* rm unused headers

* rm unused headers

* fix indentation

* refine

* rename local

* rename base

* refactor

* reorder

* fix

* impl grpc ctrl client

* add rpc manager for grpc

* continue-on-error

* refien header

* mv files

* add

* rm unused

* change equal to matches

* refine

* refine

* refine

* add license

* rm break

* refine

* revert

* fix guard

* fix header

* refine

* rm

* rm unused

* fix symbol missing

* fix parentheses

* refine condition

* fix condition

* fix

* refine

* add line break

* refine

* refine

* repostion

* mv Custom Op test after copy wheel

* fix order

* refine

* only use 2 core to prevent crash

* rm continue on error

* skip checkout if built

* rm unnecessary forward declaration
Co-authored-by: Ntsai <caishenghang@oneflow.org>
Co-authored-by: NYour Name <you@example.com>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* fix_epoll_comm_network

* minor fix
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Half implement of remove LogicalGraph by OpGraph

* Remove Logical Graph/Node

* rename CompTaskNode::op and src_logical

* fix compiler err of xrt

* fix bug of REIGSTER in graph dir
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Optimize InferOpTimeShape

* refine

* refine
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Fix FillOpParallelDesc order

* CHECK_JUST
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* rm job_helper identical_sbp_oba_pairs

* feat(PySize): support slicing

* style(PySize): slice.compute throw error_already_set
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* add set methods for op builder

* format

* change to use UNIMPLEMENTED_THEN_RETURN()

* of format

* replace rfind as find

* refactor public methods

* format

* minor fix

* add is_leaf, refactor parallel desc and device getter

* change device to parallel desc to maybe
Co-authored-by: NHoujiang Chen <chenhoujiangcug@gmail.com>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* pytorch-style module
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* fix typo, update parameter
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* add TODO, remove unused import, set consistent to True in parameter
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* set placement of parameter
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* reformat
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* add __init__.py in oneflow.python.nn.modules
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* fix deprecated module test
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* align with latest checkpoint api
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* fix missing scope_symbol_id
Signed-off-by: Ndaquexian <daquexian566@gmail.com>
Co-authored-by: NLi Xinqi <lixinqi2010@gmail.com>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* optimize_dot_file

* minor fix

* minor fix

* optimize
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: hjchen2 <hjchen2>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* support python nvtx push&pop

* of_format

* modify api name

* add range_push/range_pop in profiler.py

* of_format

* fix

* str -> range_name
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* refactor workflow

* refine

* fix permission

* refine

* refine
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Signed-off-by: Ndaquexian <daquexian566@gmail.com>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Do mem reuse in compiler

* fix XLA complie err of include

* remove useless code
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Remove OpEdge::InitDistributeHierarchyInfo

* fix
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: hjchen2 <hjchen2>
Co-authored-by: NLi Xinqi <lixinqi2010@gmail.com>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* [one::OpBuilder] Export and extend BoxingUtil in python.

* [one::OpBuilder] Deprecate boxing util python api.

* [one::OpBuilder] Reformat

Co-authored-by: hjchen2 <hjchen2>
Co-authored-by: NLi Xinqi <lixinqi2010@gmail.com>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>

* Generate unique name if the op name was not given.

* Refine

Co-authored-by: hjchen2 <hjchen2>

* export flow.placement, support creating ConsistentTensor
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* move functions to PlacementExportUtil
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* wrap get_variable with global_function_or_identity, test set_placement
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* Fix wrong condition

* format
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* fix comments
Signed-off-by: Ndaquexian <daquexian566@gmail.com>

* move PlacementSymbolExportUtil to anonymous namespace
Signed-off-by: Ndaquexian <daquexian566@gmail.com>
Co-authored-by: Noneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com>