* add launch mp distributed mode module test=develop

* delete unused file test=develop

* refine usage test=develop

* refine usage test=develop

* move distributed package test=develop

* add to whl package test=develop

* fix compile issue with_distribute test=develop

* simplified logic test=develop

* use ngraph dependency test=develop

* set cpu only test=develop

* update test and eliminate fp16 test test=develop

test=develop

* Added accuracy ngraph op test=develop

* fixed name type test=develop

* chang the timeout of test_pe_resnet
test=develop

* follow comment
test=develop

* expose peak gpu memory API to python test=develop

* add unittest for peak gpu memory monitoring test=develop

* add pybind change test=develop

* add mutex to gpu mem usage monitor test=develop

* update benchmark flag definition file test=develop

* tweak unittest for memory monitoring test=develop

test=develop

* Add calibration README; test=develop

* Add INT8 calibration support in Paddle package; test=develop

* Enable pool2d operator for a ngraph engine
test=develop

* Update
test=develop

* move var strusted to vars_distributed.py, add optimizer's block name, test=develop

* rename optimzier's seems complex, revert it, test=develop

* replace * with details, test=develop

* Enable performance measurement in INT8 calibration unit test

test=develop

* Some improvements to support bert mixed precision training

test=develop

* Revert the cast in layer_norm

test=develop

* Refine beam_search_op to output an extra parent_idx tensor.
test=develop

* Fix the unittest test_beam_search_op.
test=develop

* Fix the merging mistake.
test=develop

test=develop