Created by: kbinias

Make sure for scoring weights in CONV are only converted once.

On ResNet-50, this change speeds up the whole topology on OMP_NUM_THREADS=1 and batch_size=1 by 15%