Created by: QiJune
We now support testing when training. But in each testing, a new inference program will be created. We should avoid this.