Rewrite Matmul, make code cleaner

add prependAllocatedop

Add float16 support to load op

fix tensorrt_engine compiler error

* "add float64 tests"

* "fix based comment"

* "fixed based comment"

Our tests interfere with each other and cause random failure.

save metrics data to csv file

Dockerfile: fix production dockefile when WITH_GOLANG=OFF.

decrease the pass number of test_label_semantic_roles

Revert "CI: rerun failed tests. (#10536)"

We should improve our test isolation before raising the
level of parallelism.

This reverts commit 0446220e.

Reason:

Rerun failed test hides flaky test.
Flaky test can be bugs, for example, race condition.
Test shouldn't be flaky, if a test is flaky, it should be fixed.

* CI: rerun failed tests.

* fix check style error.

* Put all new tests under high-level-api

* be consistent with the naming

Add a multi-dim add layer test.

Bump MKL-DNN version

V2 deadlinks

* init refactor

* init

* update some comment

* fix build

* fix errorrr

* fix bug

* fix comment

* update

Fix typo in wmt16

We need to figure out if tensorrt
use row-major or col-major for tensor
layerout inorder to do conversion.

yes

Fix fetch_op_handle