* optimize adam speed by removing _finish_update test=develop

* fix SparseAdamFunctor param list test=develop

* Remove scale_op in expect_list of adam_op test=develop

* fix test optimizer loss assert error test=develop

* fix test optimizer loss assert error test=develop

* modify PADDLE_ENFORCE usage test=develop

* fix op_type in lamb_op.cc test=develop

* fix errors ostream format bug test=develop

* add betaPowOut in ngraph op test=develop

* fix ngraph::op api for gcc8 test=develop

* clean code test=develop

* modify struct into class test=develop

* remove code of beta1Tensor in lamb_op test=develop

* update ngraph ops test=develop

* update unittest test=develop

* increase coverage test=develop

test=develop

* Enable ngraph layer_norm operator

test=develop

* Disable/Enable cuda, new unit-test test=develop

* Fix use_cudnn test=develop

* Fixed test_layer test, new funciton is added test=develop

* set use_cudnn by default test=develop

* delay infershape test=develop

* fall back subblock to paddle test=develop

* fix edge cases test=develop

* remove output duplicates test=develop

* handle reshape2_grad infershape test=develop

* Enable elementwise_div operator test=develop

* Fix update date test=develop

test=develop

* Enable less_than ngraph operator

test=develop

* Added compare unit-tests test=develop

* Update: date && removed import test=develop

test=develop

* add depthwise_conv2d test=develop

* use cpu for ngraph test=develop

This reverts commit f34830e2.

* Enable sqrt operator for the nGraph Bridge.

test=develop

* Update activation_op.h

test=develop

test=develop

*  Enable assign operator for a ngraph, test=develop

* Cross_entropy operators needs to be updated

test=develop

* add increment op to ngraph engine

test=develop

* fix style errors

test=develop

* added lrn op test=develop

* Added CreateConstant method test=develop

* avoid duplicates test=develop

resolve #17147
test=develop

* Add softmax_with_cross_entropy_op test=develop

* simplify implementation test=develop