Created by: jczaja

Rework of #14337 so softmax for inference is enabled when ON_INFER flag is used to build paddle.