Fix anakin subgraph shufflenet

test=release/1.4 cherry-pick (#16845)

Imperative untrack op in eval mode

fix model_stat import bug

* optimize lstmp and sample_logits op, test=develop

* update op_use_default_grad_op_maker.spec, test=develop

* delete useless file,test=develop

* append 0 to dim variable to avoid memory reusage, test=develop

* test=release/1.4, fix hsigmoid dereference nullptr

* test=release/1.4, refine condition

* test=release/1.4, refine comments

test=release/1.4

cherry-pick dygraph serenext unit test

test=release/1.4

fix the hang bugs of memory copying. test=develop

Cherry-pick from 16837 & 16846 to 1.4

test=release/1.4

Support ShuffleNet and MobileNet-v2, test=release/1.4

Cherry pick from feature/anakin-engine2

* cherry-pick 16763,test=release/1.4

* cherry-pick 16763, test=release/1.4

* fix some comments, include cosine_decay,l2_normalize,pixel_shuffle

* Add api.spec, test=develop

* update api.spec, test=develop

* add api.spec,test=develop

* test=develop

* test=develop

* fix conflict,test=develop

* Add Pixel shuffle OP (#15782)

* add pixel_shuffle op

* add pixel_shuffle op, test=develop

* rewrite code, test=develop

* delete useless comment, test=develop

* Refine pixel_shuffle_op and unit testing

* refine code,test=develop

* refine .cu,test=develop

* fix unittest,test=develop

* Fix unit testing
test=develop

* resolve conflict, test=develop

* fix test, test=develop

* fix API, test=develop

* fix test datatype bug,test=develop

* polish comments,test=develop

* add API,test=develop

* test=develop

* Add Pixel_Shuffle OP,test=develop

* support python3,test=develop

* add include memory to travis CI bug,test=develop

* cherry-pick 16763,15782 , test=release/1.4

test=release/1.4

cherry pick move api

cherry-pick 16520, add NN and utest

Fix auto growth bug of optimizer in dygraph mode

* fix the bug of reusing different types of variables in memory_optimiz… (#16547)

* fix the bug of reusing different types of variables in memory_optimize_pass, test=develop

* disable SELECTED_ROWS AND LOD_TENSOR_ARRAY reusage, test=develop

* only use the latest version variable for inplace strategy (#16736)

* bug-fix, test=develop

* tweak code, test=develop

* cherry-pick PR 16547,16736,16739 test=release/1.4

test=release/1.4

* Fix imperative bugs

test=release/1.4

* Polish code

test=release/1.4

* Imperative deep-first backward process (#16605)

* Fix bug of gradient interface

* shrink transformer

* Right transformer

* Change from width-first backward to deep-first backward process

test=develop

* Reverse iterator op's input

test=develop

* Polish code

* Change the iteration direction in ingrads' map slots

test=develop

* Polish code

test=develop

* test=develop, cherry-pick fix for transformer in dygraph

* test=develop, fix transformer in dygraph
/

* test=develop, ptb_rnn fix op

* test=release/1.4, refine code

* test=release/1.4, fix ci failed error