Created by: Superjomn

According to the paper 《Exact solutions to the nonlinear dynamics of learning in deep linear neural networks》, orthogonal initialization is a good methodology for RNNs.