Make lookup_table_op and softmax_op supporting high rank tensor

enforce test_parallel_executor_transformer and test_image_classification_resnet to run in serial (#12545)

Improve profiler

Fix pserver can NOT start with DebugString problem

fix: add batch size check in loading data process

Add tensorrt elementwise add

* api clean

* update API.spec

* "cherry picked cpp tests"

* "cherry picked"

* "cherry picked tests"

* "merge develop branch"

* "add gradient register"

* "make some enhance"

* "better format"

* "fix typo"

* "fix reuse"

* "fix get expected kernel"

* "change the mkldnn code"

* "fix mkldnn"

* "fix mkldnn failed test"

* "add comment"

add conv2d trt converter

fix warning

* reopen test_parallel_executor_transformer

* save the CPU runing time

Fix bug in cudnn_determistic

Add transformer dist test and factor out some common utils.