Former-commit-id: 3a0686c4ecd3244208be34318bbd492b4fb0bf6c

Former-commit-id: 13be72ab489a32018581e6209a5a9244fd81c57a

Former-commit-id: ec9dbb469eede0795bc7f93bbe9924d0e0946996

Former-commit-id: d918c7d9bc9d92d835867c56652df56d79baa1fd

Former-commit-id: 554f4d46f3b8d3a611375d7355dabea3bd3d44ec

Former-commit-id: cb5add3da1a69a21d67d8af5708a03bb45ad50f2

Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: cb0a741b

Former-commit-id: 1f2ca91872a262e4a950a242f2ddeab4bd4111ac

* refactor user_op_registry Attr

* Replace the User Op Registry Attr with a new interface (#3714)

* replace user op attr
Co-authored-by: Nlixinqi <lixinqi0703106@163.com>
Former-commit-id: 856ba4ab

* detect_cxx11_abi_availibility

* crash on compiling error

Former-commit-id: 72532324

* fix unpacked mirrored blob object shape

* add missing import

* add missing import

* address comments

Former-commit-id: 27e9de2d

Former-commit-id: 24dec54c

Co-authored-by: NLi Xinqi <lixinqi2010@gmail.com>
Former-commit-id: d8201479

* fix cfg bug when the package of .proto is none

* remove *cfg.cpp generator

* fix python code format

* Move body of cfg-constructor from proto obj to InitFromProto() primary

* move InitFromProto() & ToProto() to message.h

* add a comment line & remove template.cfg.cpp

* delete a useless word in comment line

* finetune cfg

* fix complier bug at only_cpu mode

* remove useless line

* remove useless line

* remove useless line

* add Instruction.proto to cfg.cmake

* adjust cfg struct

* fintune cfg struct

* fix oneflow.cmake

* fix oneflow.cmake bug

* delete useless line in oneflow.cmake
Co-authored-by: NShenghang Tsai <jackalcooper@gmail.com>
Former-commit-id: deb614e8

* slice_assign implementation

* new slice op

* check step > 0, add more tests, refine the code

* revert the initializer changes

* remove print

* set y to 0 for partialsum

* check sbp, fix incorrect attr check

* add more tests

* rename slice2->logical_slice

* update tests

* extract common python code into a function

* get_size_in_slice -> GetSizeInSlice, rm unused test file

* minor update about step > 0

* minor update on tests

* add WITH_CUDA guard

* address comments

* split ConstructSliceParams into two functions

* add comments for SliceContext

* remove duplicated registeration

* add TODO comment

* rename slice_assign -> logical_slice_assign, move logical_slice(_assign) to experimental namespace

* logical_slice AlwaysComputeWhenAllOutputsEmpty true -> false

* address comments

* fix tests in eager mode

* BROADCAST -> SPLIT_AXIS_FOR_BROADCAST

* move SPLIT_AXIS_FOR_BROADCAST into anonymous namespace

Former-commit-id: 42ea05c6

Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: 2acaf036

Former-commit-id: 5bb3701c

* universal start global device for one machine

* update machine_id() and device_id()
Co-authored-by: Nlixinqi <lixinqi0703106@163.com>
Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: 112b7866

* Remove CheckNoCycle in chain graph

* remove hack code in oneflow.where op test

* new rule for order in graph

* remove ordered_chain_nodes_ in chain graph
Co-authored-by: NShenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: fbc09890

* add ops needed by clip gradient

* pass compiling

* add xla tests

* transform square_sum into user op

* add square_Sum kernel

* fix square sum kernel bug

* mv square sum op into user op and pass test

* fix shape bug

* update test scripts

* modify as reviewed

* fixparallel_conf

* run ci/check/run_license_format.py, run_clang_format.py, run_py_format.py

* format code

* fix ScopeSymbolId

* rm SquareSum op_conf

* format code
Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: e660f87f

* add eager

* conv's filter_diff is never dynamic

* fix test_coco_reader bug at eager mode

* add blank line at the end of file

* skip model_io & interface_op_read_and_write test case under eager mode

* sikp ops/test_sparse_softmax_cross_entropy_ms under eager mode

* skip test_softmax case under eager mode

* fix test_TestMultiOutputOrder bug

* fix test_pool bug under eager mode

* fix VirtualCloseJob() bug

* fix bug test_pool_pad

* Fix eager mode bug (#3681)

* fix(eager): close eager job but not release Glabol<JobDesc>

* refactor(job): refactor job_build_mgr when closing

* style(*): use clang format

* chore(gdb): remove all gdb function

remove gdb.h(cpp) and calling in kernel.cpp

https://github.com/Oneflow-Inc/oneflow/pull/3681#discussion_r505137787

* fix test_sparse_cross_entropy_ms bug

* fix code style

* add TODO in test_pool & test_pool_pad

* fix test_image_resize bug

* remove magic num

* fix code format
Co-authored-by: NShenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: Nlixinqi <lixinqi0703106@163.com>
Co-authored-by: Nwyg1997 <wyg19970408@gmail.com>
Former-commit-id: 887719bb

Co-authored-by: Nguo <guo@example.com>
Co-authored-by: Nguoran <guoran@oneflow.org>
Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: 6c690fe5

* add api docs

* fix docs

* add api doc in math_ops

* Change the theme to read_the_docs

* add equation docs in math_add

* add equation docs in sub, mul, addn

* add mod div tanh docs

* add gelu, relu docs

* add sigmoid unsorted_segment_sum api docs

* add unsorted_segment example docs

* add equal to greate_equal example docs

* add logical and example docs

* add other example docs, include squared difference

* add requirements of sphinx_rtd_theme

* delete the requirement of sphinx-material

* use make of format

* add optimizer docs

* add scheduler docs

* fix multiplier docs in warmup

* add api docs for math binary elementwise ops

* add math unary api docs

* fix docs about round

* add api docs for reduce mean

* add api docs for reduce ops

* fix code block for reduce ops

* fix math equation

* fix math equation erf

* add code example for layers

* fix docs in layers

* fix of format

* add warmup module in rst

* fix focs for sbp author:yaochi

* fix details in api docs

* add nn api docs and add optimizer_grad_clip module in rst

* fix details in api docs

* fix details in nn

* add prelu api docs

* add smooth l1 loss api docs

* add api docs for matmul

* add api docs for constant op

* fix docs format in RMSProp

* add api docs for array ops

* add docs for random ops

* add api docs for tensor buffer ops

* fix an error in instance_dims doc

* add api docs for tensor_list_ops

* fix annotation in image_decode

* fix of_format

* fix docs for gather_nd

* fix docs

* fix error in constant op

* fix conflict and little error

* fix index to indices

* fix error and add link

* fix broadcast like example and update flow.scope.placement docs
Co-authored-by: Ndoombeaker <later@usopp.net>
Co-authored-by: NShenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: 8d956a42

* Try to Delete the check of Batch Axis

* log about op

* fix of_format

* add a attribute for transpose op

* fix format and delete some test code

* fix bug

* add test case and annotation

* add todo

Former-commit-id: f42dd82c

* update index.rst

* add api docs of flow.typing

* rm placement.rst
Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: db31d35f

Former-commit-id: 6fdaf35a

* fix fuse_scalar_mul_by_tensor sbp

* refine
Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: 1d32adf4

* fix read_images_by_cv

* "L" can't convert to "BGR" directly
Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: 898d379a

* fix readme

* Update README.md

Former-commit-id: 276e56b6

* test use uuid log dir

* mv random to paralell run

* better docker ignore

* add readme

* add

* conver type uuid

Former-commit-id: 4d412c4a

Former-commit-id: c4b3dd94

* run check_license_and_format in every branch

* wildcard match any branch

* base_ref

* rm conditon check_license_and_format

* fix branch name
Co-authored-by: Ntsai <caishenghang@oneflow.org>
Former-commit-id: 6bf2fcc7

* rm skip

* fix image resized static shape

* extract image related function to common module

* fix image target resize static shape infering

* format
Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: 4d84afbf

Former-commit-id: bcb2fb68

* add chunk 1

* support chunk at 1 2 5

* fix action="store_true",

* fix --verbose

* run xla and pure cpu only when cuda test succeeds

* rm comment

* add raise

* fix time

* verbose log for parallel

* refactor parallel

* add pass

* test_util don't import tf on top level

* print which file failed

* dont run DEVICE_NUM=2 in parallel

* Revert "test_util don't import tf on top level"

This reverts commit 69507343d9fec93d2f1f7ad629ae4d4ddc91c9e4 [formerly c042afca63d8951c651ba866d90381307828ed1e].

* find free port in parallel run

* add discover
Co-authored-by: Ntsai <caishenghang@oneflow.org>
Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: ff1dcbe2

Former-commit-id: 77dd75d5

* add backward in broadcast_like

* fix of_format

* add static cast for attr

* add param for axis

* fix format

* add broadcast_like grad test case

* delete static cast
Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: cbcb8b5c

Co-authored-by: NShenghang Tsai <jackalcooper@gmail.com>
Former-commit-id: 2ae6f32f

Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: 40ca3eca

* add api docs

* fix docs

* add api doc in math_ops

* Change the theme to read_the_docs

* add equation docs in math_add

* add equation docs in sub, mul, addn

* add mod div tanh docs

* add gelu, relu docs

* add sigmoid unsorted_segment_sum api docs

* add unsorted_segment example docs

* add equal to greate_equal example docs

* add logical and example docs

* add other example docs, include squared difference

* add requirements of sphinx_rtd_theme

* delete the requirement of sphinx-material

* use make of format

* add optimizer docs

* add scheduler docs

* fix multiplier docs in warmup

* add api docs for math binary elementwise ops

* add math unary api docs

* fix docs about round

* add api docs for reduce mean

* add api docs for reduce ops

* fix code block for reduce ops

* fix math equation

* fix math equation erf

* add code example for layers

* fix docs in layers

* fix of format

* add warmup module in rst

* fix focs for sbp author:yaochi

* fix details in api docs

* add nn api docs and add optimizer_grad_clip module in rst

* fix details in api docs

* fix details in nn

* add prelu api docs

* add smooth l1 loss api docs

* add api docs for matmul

* add api docs for constant op

* fix docs format in RMSProp

* add api docs for array ops

* add docs for random ops

* add api docs for tensor buffer ops

* fix an error in instance_dims doc

* add api docs for tensor_list_ops

* fix annotation in image_decode

* fix of_format

* fix docs for gather_nd

* fix docs

* fix error in constant op

* fix conflict and little error

* fix index to indices
Co-authored-by: Ndoombeaker <later@usopp.net>
Co-authored-by: NShenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: Noneflow-bot <69100618+oneflow-bot@users.noreply.github.com>
Former-commit-id: 2fa74232