* math => layer_math
* Fix #903

test_rest_hook.py => test_reset_hook.py

Change-Id: I84909ade4a1ea2bec4311264626dd000cd6bc86c

To solve this, we maintain the list of DefaultNameFactory used in by trainer_config_helper,
and reset the state at the beginning of each parse_config call.

Change-Id: I13c7574dc8f0b6bc6f6b7c92eb425e2c52c926e8

* Make float equal works well.
  * compare 0.01 and 0.009999999999 will return true.

out = w * input
where w is a parameter of size 1

Change-Id: Ife682d62323ceb1a20cbbf6269421b20a862d888

* Fix #436

Making '*' support the multiplication between a scalar and LayerOutput

Also changing '+' to support adding between a vector and a scalar.

Change-Id: I7daf35590dc2b2f855a29d9ef43ac57979442e0f

* set mixedlayer output size according to input operator
* change from num_channel to num_channels for conv_operator (the old one is
really misleading because all the others are num_channels)

* also changed the arg name in projections.py

* some tiny fixs

* use VLOG(3)

And rebase

Change-Id: I7ea234b3aa8fc70675af15d91db08242c43fb5ff

This allows user to implement any type of cost by summing over the output of non-cost layers.

Change-Id: Ic55aaabbf0c1299e70b8e48a0effcc91f8f5bd29

Fix #342

* Add elementwise math operations
This allows use to use expressions like: y=log(1+exp(x))
Also added unittests for ActivationFunction
* Enforce keyword arguments for non-positional arguments
* Add LogActivation to doc