* wip

* wip

* wip

* wip for test

* add fp16 tests test=develop

* fix cpu build test=develop

* fix test=develop

* fix py3 tests test=develop

* fix lr_scheduler dtype test=develop

* fix test=dvelop

* test fix ci compile test=develop

* fix build and merge test=develop

* fallback momentumop change to general test=develop

* fix api format and examples

test=develop

* Update executor.py

test=develop

* Update nn.py

* Update nn.py

test=develop

* Update nn.py

test=develop

* fix nccl2 lars dist support

* put lars in momentum op

* add tests lars

* fix ci

* fix cpu kernel

* soft warning

* remove lars in test_recognize_digits.py

* move to another op

* add file

* update api.spec test=develop

* update test=develop

* fix api.spec test=develop

* wip

* wip, finish grad merge ops

* wip, finish graph build

* wip test running

* work on 1 gpu

* workable version

* update

* fix tests

* fuse broadcast op

* fix compile failed

* refine

* add batch merge test mnist

* fix CI test=develop

* fix build

* use independent bn params for batch merge test=develop

* update api.spec

* follow comments and for test

* wip

* refine tests test=develop

* follow comments test=develop

* remove startup bn modify test=develop

* follow comments test=develop

* fix merge test=develop

* wip

* clean up

* should fix running with memopt

* add ut

* mark lr schedule op role

* hide lr_schedule_guard

* use op_role_var instead of ufind

* unify dist test name

* wip for py3 support

* fix var deref

* fix python3 mem_opt order

* remove comments

Add neural transformer leanring rate decay function

* change learning_rate_decay to learning_rate_scheduler
* optimize code
* change nn.cast to tensor.cast

* init polynomial_decay

* test polynomial_decay

* complete polynomial_decay

* fix conditional block op

* init scalar-switch-case-op

* switch op can compile

* complete forward switch_op

* add GetMatchCaseIndex

* add switch_grad_op

* init switch Python API

* add test_switch

* support set block list in python

* fix scope problem

* complete test

* optimize test

* optimize test

* rm backward part

* clear grad op

* polynomial_decay use switch op

* revert conditional_block_op and reshape_op

* add piecewise_decay and test

* fix piecewise_decay

* try to use condition op for switch

* can work

* clean old code

* revert

* rm switch_op.cc

* optimize code

* add attr is_scalar_condition for condition_block_op

* fix comment

* fix comment

* add export

* add basic interface for learning rate decay
* add exponential_decay
* add natural_exp_decay
* add inverse_time_decay