* add data layout

* fix ci

* "remove GPU Sync Interface"

* "fix typo"

* "fix type cast error"

* "fix related Copy with stream"

* "fix failed tests with DevicePool"

* "fix stupid removed position error"

It is useful to reorder RNN memory block.

* Support Clip in param_attr

* Fix the order of clip & regular

Regular is not need to be clipped

* Simplize system_allocator and fix GPU_INFO

* Remove main_program/startup_program

* Fix optimizer

* Fix CI

* Follow comments

* Make cast op support bool

Also add `elemwise_sub/mul/abs/clip` layers

* Make fuild.layers as a module

* Move layers as a module

* Split layers.py into layers module

* Fix CI

* Fix CI

Fix #6531

* "add registry interface"

* "move function to registry"

* "rename with meaningful name"

* "add exposed layers"

* "fixed based on comments"

* "remove unsed comments"

* Add fill_op

* Fix bug

* Fix documentation

* Address review comments

* init decoder_trainer

* can run

* fix lod

* add sharelod to cross_entropy_grad_op

* add avg_cost to fetch list

* modify learning rate

* can run

* optimie code

* add early exit

* fix print

* revert test_understand_sentiment_conv.py

* add act to fc

Add LRN efficient GPU implement