Created by: jacquesqiao

Gradient Clipping is a useful trick for training a very deep neural network. There could be many kinds of clipping methods:

1. Clipping by a value directly
2. Clipping by a global norm.