* fix bug of print kernel to print useless content

* fix bug of weight blob shape in recurrent op

* fix bug of clone in recurrent op

* replace fill with initialize

* fix job.proto

* branch init

* init rdma_comm_network interface

* Rdma rebuild (#369)

* rebuild rdma main class

* remove linux dir

* fix bugs

* Rdma rebuild (#370)

* rebuild rdma main class

* remove linux dir

* add connection rpc

* Post API params change to const ptr

* fix compile bugs

* implement read recv send function

* updt connection interface & implement poll queue

* fix bugs & updat interface

* implement RdmaCommNet functions

* Rdma rebuild (#371)

* rebuild rdma main class

* remove linux dir

* add connection rpc

* Post API params change to const ptr

* Add MemDesc rpc and registerdone

* Add clear rpc

* Useless file

* Rdma rebuild (#372)

* rebuild rdma main class

* remove linux dir

* add connection rpc

* Post API params change to const ptr

* Add MemDesc rpc and registerdone

* Add clear rpc

* remove connection_pool and change API for MenDesc

* remove connection pool file

* remove .file

* rebuild connection to endpoint manager

* remove GetConnection

* fix constructor and destructor fir rdmacommnet

* fix bugs

* fix deconstructor

* Rdma rebuild (#373)

* rebuild rdma main class

* remove linux dir

* add connection rpc

* Post API params change to const ptr

* Add MemDesc rpc and registerdone

* Add clear rpc

* remove connection_pool and change API for MenDesc

* remove connection pool file

* remove .file

* rebuild connection to endpoint manager

* remove GetConnection

* Add RDMA to JOBCONF

* Rdma rebuild (#374)

* rebuild rdma main class

* remove linux dir

* add connection rpc

* Post API params change to const ptr

* Add MemDesc rpc and registerdone

* Add clear rpc

* remove connection_pool and change API for MenDesc

* remove connection pool file

* remove .file

* rebuild connection to endpoint manager

* remove GetConnection

* Add RDMA to JOBCONF

* fix RdmaInit bug

* add log

* Rdma rebuild (#375)

* rebuild rdma main class

* remove linux dir

* add connection rpc

* Post API params change to const ptr

* Add MemDesc rpc and registerdone

* Add clear rpc

* remove connection_pool and change API for MenDesc

* remove connection pool file

* remove .file

* rebuild connection to endpoint manager

* remove GetConnection

* Add RDMA to JOBCONF

* fix RdmaInit bug

* add log

* Add Log

* fix bug

* fix bugs

* Rdma rebuild (#376)

* rebuild rdma main class

* remove linux dir

* add connection rpc

* Post API params change to const ptr

* Add MemDesc rpc and registerdone

* Add clear rpc

* remove connection_pool and change API for MenDesc

* remove connection pool file

* remove .file

* rebuild connection to endpoint manager

* remove GetConnection

* Add RDMA to JOBCONF

* fix RdmaInit bug

* add log

* Add Log

* commnet add establish network

* add qpn

* fix bug

* create conn_info and qp for each conn

* Add commit and destruct for endpointmanager

* Add proto use_rdma

* fix bug

* Delete redundent file

* Dev rdma yx (#377)

* rebuild rdma main class

* remove linux dir

* add connection rpc

* Post API params change to const ptr

* Add MemDesc rpc and registerdone

* Add clear rpc

* remove connection_pool and change API for MenDesc

* remove connection pool file

* remove .file

* rebuild connection to endpoint manager

* remove GetConnection

* Add RDMA to JOBCONF

* fix RdmaInit bug

* add log

* Add Log

* commnet add establish network

* add qpn

* fix bug

* create conn_info and qp for each conn

* Add commit and destruct for endpointmanager

* Add proto use_rdma

* fix rpc bug

* fix some problem

* int64 and uint64

* Dev rdma yx (#378)

* rebuild rdma main class

* remove linux dir

* add connection rpc

* Post API params change to const ptr

* Add MemDesc rpc and registerdone

* Add clear rpc

* remove connection_pool and change API for MenDesc

* remove connection pool file

* remove .file

* rebuild connection to endpoint manager

* remove GetConnection

* Add RDMA to JOBCONF

* fix RdmaInit bug

* add log

* Add Log

* commnet add establish network

* add qpn

* fix bug

* create conn_info and qp for each conn

* Add commit and destruct for endpointmanager

* Add proto use_rdma

* fix rpc bug

* fix some problem

* int64 and uint64

* Fix bug

* remove useless head file

* fix bug

* fix bug

* fix bug

* updt interface

* change conninfo rpc (#379)

* change conninfo rpc

* swap the place of var declare

* fix zlib dependency

* remove useless function (#381)

* updt recv buffer size

* updt proto & sh for multi-machines

* remove useless LOG

* updt cmake

* remove soft link file

* rearrage code

* rdma proto & updt to ctrl

* merge & fix bugs

* updt to KV

* add debug info

* fix bug

* remove redudant code

* remove redundant code

* recover blank line

* updt interfaces & fix bug

* updt proto

* updt proto

* updt proto

* merge master

* add macro guardian

* fix include

* fix rdma_memory

* add RdmaMem

* fix code

* add endpoint_manager & rdma_comm_network

* remove EstablishNetwork

* updt resource port

* refine SendMsg

* refine connection interface

* refine code

* refine code

* remove redundant changes

* fix macro guardian bug

* refine endpoint_manager && ibverbs_comm_net

* merge master

* refine code

* replace ptr with normal var

* fix bugs

* remove useless log

* rollback changes to job.prototxt

* fix proto

* refine code

* updt to LOG(FATAL)

* add endpoint_manager & rdma_comm_network

* refine code

* refine code

* fix macro guardian bug

* refine endpoint_manager && ibverbs_comm_net

* merge master

* refine code

* replace ptr with normal var

* fix bug

* updt interface

* refine code

* feat: add seq_len in Blob and BlobDesc

* fix: rename PieceStatus to BlobHeader and insert it to mem_ptr of Blob

* fix: fix the comments

* fix: fix typos and remove  vim .swp file

* fix: fix the comment

* fix: update max_col_num() to col_num() in Register

* fix: fix due to the comment

* add dataloader buffer blob

* debug

* change the comment

* add col_num and max_col_num

* change the bug

* add CommMemMgr

* refine code

* rename folder name

* refine macro guardian

* updt class name && fix bug

* add final

* fix name && updt interfaces

* fix name

* add l1 l2 regularization

* fix some problem

* Fix bug

* fix op API

* Fix a bug in op

* add l1l2

* remove regularization_diff_blob

* remove sign in kernel_util

* fix naming problem and add l1l2 function

* simplify code

* remove else

* update modelupdate API

* Fix bug

* refine produce & consume regst

* add virtual func

* fix bug & add FixRegisterNumRange

* add CanBindInDiffWhenRecurrent func

* refine code

* refine virtual func

* change func name

* comsume regst in recurrent fw task node

* is ready for build in fw cmp task node

* recurrent and non recurrent forward compute task node

* fix regst num for fw task node

* fix bug

* fix bug of recurrent fw task node check is build ready

* unified implement of recurrent and nonrecurrent op

* remove register num improve of predict

* add recurrent op init hidden type

* fill conf

* make the use of idx in pooling op based on pooling method

* change the use of != to ==

* add the condition of kStochastic

* use  brackets

* fix recurrent op for h0 may be trained

* fix max_seq_size in recurrent_op

* fix for data tmp blob has data id

* delegate construct

* refine CommNet

* remove EstablishNetwork func