* init data_type_transform

* split data_layout_transform

* tmp rm data_transform_test

* change device_data_transform to data_device_transform

* clean code

* clean code

feature/parallel_gpu

* "init use all default devices"

* "fix init test"

* add lod tensor ToAbsOffset test

* add share lod to topk op and softmax op

Added backward.calc_gradient to backpropagate gradient from given targets to inputs.

* test dist word2vec

* multiple trainers work

* Rename Tensor::CopyFrom to Tensor::Copy

* Fix CI

* Fix compile

* Remove unused LoDTensor methods

* Update

* create tensor in recv op

* static global function to global function

* "reuse ShareLoD with no regret"

* "removed base class shareLayout"

* "fix CI"

* add rename guard

* add device_data_transform

* add device_data_transform_test

* modify GetExpectedKernelType

* update operator.run

* support test test_label_semantic_roles

* optimize code

* optimize code

* rename GetActualKernelType to GetExpectedKernelType

* fix chunk_eval_op and device_data_transform_test

* add is_same_place to place

* optimize code, refine rename_guard

* refine rename guard, add GetKernelTypeForVar

* optimize code

* add some log

* rename guard

* use sub scope to create var

* fix compile

* add IsInitialized for Tensor

* add VarIsTensor

* fix op_registry_test

* test

* tmp disable priority

* restore switch_kernel.md

* code clean

This can make it easier to locate error.

It will be used for LoD information in LoDTensor since LoD is a copy
on write field.

It is pretty slow for copying LoD information between operators. For
resnet it will cost roughly 10% time of whole time, including reading
data.

* "add c++ side kernel selection"

* "add multiple kernel op test"

* "kernel selection only support cudnn"

* "better formatter"

* "small fix with UseCPU"

* "depends on change interface Get(Place, Library)"

* "fix CI"

* "fix python cudnn test"

* "leave the register cudnn op to another PR"

* "fix CI"

* "use all kernel by default"

* "fix CI"

* send_recv variable

* delete unused logs

* fix ci failed

* update

* resize tensor before tensor copy

* add selectedrows unit test

* check rows

* "remove cudnndevicecontext"

* "remove unused init code"

* "fix hash functions"

* "fix typo"

* "fix based on comments"

* "follow gogle style"

* "fix based on comemnts"

* fix bug in SetAttrDescVisitor

* add comments

* "fix data transform"

* "data transformer"

* "add device pool"

* "add test"

* "fix ci"

* "fix datalayout implementation "

* "fix based on comment"