Created by: seiriosPlus

PR types

Performance optimization

PR changes

Others

Describe

UT optimizes: old:

TestDistMnistAsync2x2: 25.103
TestDistMnistAsync2x2WithDecay: 27.082
TestDistMnistAsync2x2WithGauss: 28.421
TestDistMnistAsync2x2WithUnifrom: 27.214
TestDistMnistSync2x2: 31.538

new:

TestDistMnistAsync2x2: 5.777
TestDistMnistAsync2x2WithDecay: 4.675
TestDistMnistAsync2x2WithGauss: 5.850
TestDistMnistAsync2x2WithUnifrom: 5.464
TestDistMnistSync2x2: 5.403