Former-commit-id: 54f694906a09b8828b9dacecb38b45b92cdba123

Former-commit-id: 50cf37fd43c7c343da4f436c4226bd7229ef1a5d

Former-commit-id: bd8f19466c91b5d21d10657371e493fe51ff9bd9

Former-commit-id: 29e3089d13a523a828ed94e28acaee50cfc57561

Former-commit-id: a015f8a8e018cfc7ce06c4f2564601e296e08cb8

Former-commit-id: a6a5ceea0347a8689d6037913ece4c1b9c22b3e0

Former-commit-id: 7eb36204f8530e3d912266a2ca375d29902e96d4

Former-commit-id: c51a6494070557302b4753f425c362b8107ab6b9

Former-commit-id: 506df293b368d79a785cc68461c946ad414b79a0

Former-commit-id: fe13fb22c5725ea200589868fce5e7be48ff830e

Former-commit-id: bebeb08a2a64687fe91d854dc687064a324f45ef

Former-commit-id: 29d73e1c3fae3b050a8d6362493a4decd6ff626d

Former-commit-id: 81741c59cafc5914b8b233ec0ced9e0a48860ebf

Former-commit-id: 651e80d133e3c545f1ae87c0dc28fa1d4c3db3de

Former-commit-id: 30c0518e

* add l1 l2 regularization

* fix some problem

* Fix bug

* fix op API

* Fix a bug in op

* add l1l2

* remove regularization_diff_blob

* remove sign in kernel_util

* fix naming problem and add l1l2 function

* simplify code

* remove else

* update modelupdate API

* Fix bug

* ~

* fix bug

* add basic_rnn_op

* Fix naming problem

* clang-format

* Fix bug for hidden_diff_blob update

* Fix bug for hidden_diff compute

* fix bug for h0 initilizer

* fix bug for h0 initilizer

* add else

* remove else

* fix

* optimize

* optimize

* add has_init_hidden_initilizer

* optimize


Former-commit-id: c7bf405e

* reshape op

* fix bug

* add check


Former-commit-id: 2c2b79b5

* add l1 l2 regularization

* fix some problem

* Fix bug

* fix op API

* Fix a bug in op

* add l1l2

* remove regularization_diff_blob

* remove sign in kernel_util

* fix naming problem and add l1l2 function

* simplify code

* remove else

* update modelupdate API

* Fix bug

* ~

* base_rnn

* fix bug

* base_rnn_kernel

* BasicRnnKernel

* basic_rnn_kernel

* Fix bug and add comment

* remove useless blob

* remove in_ip_op_blob hidden_ip_op_blob

* fix conflict and change blasmatrixmatrix to blobgemm

* basic_rnn

* remove has_bias_term

* fix config problem

* Fix some problem

* fix naming problem

* naming problem

* clang format

* add basic_rnn_op

* basic_rnn_op

* change createkernel function

* fix bug

* recurrent op

* UNEXPECT_RUN

* change config

* remove recurrentopconf

* kernel refactor

* Fix some problem

* remove util declare

* fix bug for non-virtual deconstruct


Former-commit-id: 283e7163

* add l1 l2 regularization

* fix some problem

* Fix bug

* fix op API

* Fix a bug in op

* add l1l2

* remove regularization_diff_blob

* remove sign in kernel_util

* fix naming problem and add l1l2 function

* simplify code

* remove else

* update modelupdate API

* Fix bug

* ~

* fix bug

* add basic_rnn_op

* remove useless code and add virtual for deconstruct

* remove useless code


Former-commit-id: e06ff99f

* add l1 l2 regularization

* fix some problem

* Fix bug

* fix op API

* Fix a bug in op

* add l1l2

* remove regularization_diff_blob

* remove sign in kernel_util

* fix naming problem and add l1l2 function

* simplify code

* remove else

* update modelupdate API

* Fix bug

* ~

* fix bug

* add basic_rnn_op

* recurrent op

* UNEXPECT_RUN

* change config

* remove recurrentopconf


Former-commit-id: 3a83164a

Former-commit-id: 498ab041

Former-commit-id: c8127f4e

Former-commit-id: 7a8ce23c

* fix bugs

* rename op name

* fix kernel names

* remove useless var


Former-commit-id: d6be5427

Former-commit-id: 2cde376c

Former-commit-id: 8e8cdab2

Former-commit-id: 0ed0a2df

* split pooling op

* remove stochastic pooling

* updt pooling proto

* refine code

* updt interface

* add PoolingCUDACtx

* PoolingCUDACtx -> PoolingCudaCtx

* updt proto

* fix format

* fix names

* add PoolingKernel && updt interfaces


Former-commit-id: 8e59ee92

Former-commit-id: 29ff1484

* change CopyFromIterToIter() to make it able to process invalid blobs

* a version with bug

* change struct

* refactoring to reuse some code

* split SetColIdAndMaxColId() method to SetColId() and SetMaxColId()

* rewrite SetColId() and SetMaxColId()

* refactor Iterator

* complete refactor

* debug

* move the function isValidBlob() to Blob::IsColValid()

* changes requested by willzhang and make it runnable in CNN

* rename some variables


Former-commit-id: 48f0a47b

Former-commit-id: 47ac8d11

* add l1 l2 regularization

* fix some problem

* Fix bug

* fix op API

* Fix a bug in op

* add l1l2

* remove regularization_diff_blob

* remove sign in kernel_util

* fix naming problem and add l1l2 function

* simplify code

* remove else

* update modelupdate API

* Fix bug

* ~

* fix bug

* sumop

* change sum_op to reduce_sum_op

* rm sum_op

* Fix specification


Former-commit-id: d55b3234

Former-commit-id: cc2ee9fc

* feat: update MdUpdtActor to support shared model

* fix: fix due to the comment


Former-commit-id: 6f0754f6

* add eigen support

* add eigen cmake


Former-commit-id: 2e916235

* fix compile bugs

* fix bug

* rollback changes to op

* rollback correctly

* add interface to fix bug

* fix model_updt_actor bug

* fix boxing bug

* refine code

* refine code

* fix bug of init model

* fix bug

* fix names

* replace HasSameLbns with HasSameBlobDescs

* fix bug


Former-commit-id: 131947ed

* fix compile bug 1

* fix bug and add col num in ops

* fix compile bug and add scripts for rnn test

* fix for review

* test boxing op


Former-commit-id: b586114b

* add default operations to col_num field in forward and backward

* change some function in terms of reusing

* change name and test runtime

* rename some variables and restate some functions

* change name of CopyFieldFromInToOut()


Former-commit-id: c26a32b1

* updt names in ip

* updt comment && fix bug

* fix bug && updt proto

* rename innerproduct to fullyconnected

* updt field names in fully connected op

* roll back impl of initialization of bias

* fix bug of bias_multiplier_initializer

* remove redundant SetHasDataIdField

* remove redundant set_data_type

* refine code


Former-commit-id: 534138dc

Former-commit-id: 79d00a28