Created by: mapingshuo

Forward Recomputation Backpropagation(FRB) splits a deep network to k segments. For each segment in forward propagation, most of the temporary variables are erased in time, thus saving memories.