* Support Clip in param_attr

* Fix the order of clip & regular

Regular is not need to be clipped

* Simplize system_allocator and fix GPU_INFO

* Remove main_program/startup_program

* Fix optimizer

* Fix CI

* Follow comments

* "add DeviceContextPool"

* "add devicecontextpool in pybind"

* "add comments in python side "

* "fix static link error"

* "fix CI error"

* "add executor.py"

* "fix CI error"

* "add with gpu macro"

* "remove comment out codes"

* "add TODO items"

* "update init devices"

* Make cast op support bool

Also add `elemwise_sub/mul/abs/clip` layers

* Make fuild.layers as a module

* Move layers as a module

* Split layers.py into layers module

* Fix CI

* Fix CI

Also add `elemwise_sub/mul/abs/clip` layers

Fix #6531

* "add registry interface"

* "move function to registry"

* "rename with meaningful name"

* "add exposed layers"

* "fixed based on comments"

* "remove unsed comments"

* Add fill_op

* Fix bug

* Fix documentation

* Address review comments

* "add global regularization"

* Polish `append_regularization_ops`