* "add float64 tests"

* "fix based comment"

* "fixed based comment"

1. Add attr 'average' into ParamAttr.
2. Make 'params_grads' optional for AverageModel.
3. Add option 'average_mean' and 'average_variance' for batch_normal.

* Add RMSProp optimizer warpper.

* Follow comments.

1. Implement 'with model_average.apply()' syntax
2. Init apply_program and restore_program in __init__ functin of ModelAverage

* Add reset and guard to unique_name

* add basic interface for learning rate decay
* add exponential_decay
* add natural_exp_decay
* add inverse_time_decay

* "fix decode bug"

* "follow commnet"

* "fix error"

* "fix hook bug"

* fix based comment

* fix copyright

* fix based on comment

* add copyright hook

* add copyright hook

* refine copyright hook

* "test copyright hook"

* fix check style

* fix ci

* Support Clip in param_attr

* Fix the order of clip & regular

Regular is not need to be clipped

* Simplize system_allocator and fix GPU_INFO

* Remove main_program/startup_program

* Fix optimizer

* Fix CI

* Follow comments

* "add global regularization"

* Polish `append_regularization_ops`