Former-commit-id: bccf2887bb5f23081deda2814e457455a9445963

Former-commit-id: eef978462c30f95f374e59aa383796f68fb1f1cb

Former-commit-id: 3a320ecf4e94cc9d2a26942a9b3375125bdf510a

Former-commit-id: 7628e866e8246f41960c5b03e1fa92376fb661c7

Former-commit-id: 4972580f59bb8e082871b3f7c78f737b2e4cc3fa

Former-commit-id: 94f61e0d37100fe29c55966f4bec854db5c4f876

Former-commit-id: f3c4c39bf376c3f2c9197aee80871c02dbb782df

Former-commit-id: ebceff288f3cc978e122f93b473b4c3d49e32094

Former-commit-id: 13d5c657a8aa4f678c51d9c8bb32ae56689c951d

Former-commit-id: 1ed122ebaec8ba90c4d1ecf4762f02de1e5de2fd

Former-commit-id: c41299c4d2d999c686fcfe40a24d202e25446028

Former-commit-id: b780c94966aec7048bac921ce1844a624dc704fe

Former-commit-id: 11d0754810cb51fc3919339b529693af9ae8e0fe

Former-commit-id: 5b1d4a918d46205f0465352cf2d17f7cf4e3bc4d

Former-commit-id: 9b8869f3075cbf0b4d77113fe26a18fccbfe4644

Former-commit-id: 193f69c0b4695abcbb89728d7867ea8ad8873a5b

Former-commit-id: d1eba08d1903fceb50bf9e0f77bf4548b2ddedb4

Former-commit-id: ba7dfe9c4054e438ea32d35c494952708b2becc0

Former-commit-id: 4cdb2026114e7d654644465ae2f9329e70d8f7dc

Former-commit-id: dec54d6fa794b9a28f73b21cd5f86c002fe9c6d3

Former-commit-id: 2f625c9bb2e0199b734b09dc2330f10ce85bd80a

Former-commit-id: ce92c2d972aa74760351052e9d89cf6e3c40282c

* top_k

* dev top_k op

* refine

* fix bug

* refactor top_k op, cooperate with gather op to get values now

* customized TOPK_KERNEL_ENTRY in auto factory

* batch gather op

* refine

* Backup: batch_gather op, pass compile

* fix bugs, pass the test

* fix no new line at the end of file

* const

* refine by review

* fix bugs

* rename: instance_dim -> instance_size

* remove a blank line

* refine coding style by Juncheng's suggestions, Bravo

* refine top_k

* more refine

* compatible with new model parallel

* refine

* rename

* cpu only in top_k


Former-commit-id: 67ade80ed5d7e6ef3f3e1ca4edc541686e15d8f2

Former-commit-id: e3497f7a84e8e0e8335bfc8e20aa276ace25211a

Former-commit-id: adbcd5892337be272571220858483ca9c3a97bee

Former-commit-id: 259692de6651eb6a146adc9916932184b9da6bd6

Former-commit-id: bd6bb915b862fe49b266304531d3eae59e7eaa10

Former-commit-id: fe7f367d4410e66d9559566ccc175bf0632ecf0f

Former-commit-id: 2a44d999cdbd091854e8e5de94a363fdfc65f3c9

Former-commit-id: abc066fc8255a1fbfe607e7f84aa01ff778b14db

Former-commit-id: e9ca9288a04d3ce65ef1c711b34c916b29151dbb

* fix a bug in OpGraph::InferNoParallelBlobDesc

* fix a bug in OpGraph::InferNoParallelBlobDesc


Former-commit-id: c0b1071fc6fbe72f1207d02fdb794dc1076eb59a

* Global<OpGraph> is only available duraing compilation

* small record_piece_size for InferNoParallelBlobDesc


Former-commit-id: 5eb1012703f8f9389ac8e2f16131bfd36411b0db

* mem_shared_hint_id

* sharable memory block

* rm useless code

* remove useless code

* bugfix: no redundant edges

* rename: MemBlockGroup => MemBlock

* put constrcutor of SharableMemBlockNode into header file

* bugfix

* rename field: MemBlock.block_id => MemBlock.mem_block_id

* replace piece_size with logical_blob_dim0

* BlobParallelConf

* BlobParallelDesc

* infer out blob model_split_axis

* int64_t => int32_t

* InferOutBlobParallelDesc

* gather out blob model split (#1624)

* InferBlobParallelDesc

* let variable op support kModelParallel

* rename lbi2blob_desc_ => lbi2no_parallel_blob_desc_

* Global<OpGraph>

* SplitLogicalInputBlobDesc

* ConcatOutputBlobDescs

* rename: BlobDataParallel => DataBlobParallel; BlobModelParallel => ModelBlobParallel; BlobGridParallel => GridBlobParallel

* OpGraph::CheckBlobDescs(...)

* exact division is unnecessary

* fix bugs

* rename InferOutBlob* => InferOutputBlob

* exact division in variable_op is unnecessary

* bug fix

* fix bugs

* fix bugs

* IsInputBlobAllowedModelSplit

* use Global<OpGraph> to InferModelSize

* add OpGraph::GetDataBalancedSplitter and OpGraph::GetModelBalancedSplitter

* fix IdentityOp::IsInputBlobAllowedModelSplit

* no implementation for pure virtual function Operator::IsInputBlobAllowedModelSplit

* refine BlobParallelDesc: replace CopyParallelConf with operator=

* refine ParallelDesc: remove unused functions

* more checks on ParallelDesc

* remove unused function Operator::MaxModelSplitNum

* bugfix: SoleOp() => op_vec().at(0)


Former-commit-id: be1f820b2927f7f79f55b7891f6575cdeb4b2053

* mem_shared_hint_id

* sharable memory block

* rm useless code

* remove useless code

* bugfix: no redundant edges

* rename: MemBlockGroup => MemBlock

* put constrcutor of SharableMemBlockNode into header file

* bugfix

* rename field: MemBlock.block_id => MemBlock.mem_block_id

* replace piece_size with logical_blob_dim0

* BlobParallelConf

* BlobParallelDesc

* infer out blob model_split_axis

* int64_t => int32_t

* InferOutBlobParallelDesc

* gather out blob model split (#1624)

* InferBlobParallelDesc

* let variable op support kModelParallel

* rename lbi2blob_desc_ => lbi2no_parallel_blob_desc_

* Global<OpGraph>

* SplitLogicalInputBlobDesc

* ConcatOutputBlobDescs

* rename: BlobDataParallel => DataBlobParallel; BlobModelParallel => ModelBlobParallel; BlobGridParallel => GridBlobParallel

* OpGraph::CheckBlobDescs(...)

* exact division is unnecessary

* fix bugs

* rename InferOutBlob* => InferOutputBlob

* exact division in variable_op is unnecessary

* bug fix

* fix bugs

* fix bugs

* IsInputBlobAllowedModelSplit

* use Global<OpGraph> to InferModelSize

* add OpGraph::GetDataBalancedSplitter and OpGraph::GetModelBalancedSplitter

* fix IdentityOp::IsInputBlobAllowedModelSplit

* no implementation for pure virtual function Operator::IsInputBlobAllowedModelSplit

* refine BlobParallelDesc: replace CopyParallelConf with operator=

* refine ParallelDesc: remove unused functions

* more checks on ParallelDesc


Former-commit-id: 2b78c6e1f37e514e39f1dc807ccce455190b00a7

* accuracy

* accuracy_task_node add fw_buf

* fw_buf=>data_tmp


Former-commit-id: ab900061ce8f1050ec6d2ee39057addcfcd44f57

* multithreads register coloring

* refine code


Former-commit-id: 3be07992331e7f62fe9d56b2f8d1357a72ef1a09

Former-commit-id: 2550030088fb6b15f1784a2bd1cfb78eeabe3b0d

Former-commit-id: 92b9ff1ae7efc90391581eafe8253347a5712b9c

Former-commit-id: f41ed5783928b6427b28d92f372d3826651ee7a2