Created by: jacquesqiao

In the distributed train, the loaded parameter should be broadcast to all trainer and parameter server, currently, we have not implement this.